User-agent
User-agent: * Disallow: /brandkit/ Disallow: /audio/ Disallow: /images/ Disallow: /js/ Disallow: /videos/
MJ12bot
User-agent: MJ12bot Disallow: /
SemrushBot
User-agent: SemrushBot Disallow: /
GeedoBot
User-agent: GeedoBot Disallow: /
googlebot
User-agent: googlebot Allow: /
Googlebot-Video
User-agent: Googlebot-Video Allow: /
Applebot
User-agent: Applebot Allow: /
bingbot
User-agent: bingbot Allow: /
Baiduspider
User-agent: Baiduspider Allow: /
Baiduspider-mobile
User-agent: Baiduspider-mobile Allow: /
Baiduspider-video
User-agent: Baiduspider-video Allow: /
Baiduspider-image
User-agent: Baiduspider-image Allow: /
NaverBot
User-agent: NaverBot Allow: /
Yeti
User-agent: Yeti Allow: /
Yandex
User-agent: Yandex Allow: /
YandexBot
User-agent: YandexBot Allow: /
YandexMobileBot
User-agent: YandexMobileBot Allow: /
YandexVideo
User-agent: YandexVideo Allow: /
YandexWebmaster
User-agent: YandexWebmaster Allow: /
YandexSitelinks
User-agent: YandexSitelinks Allow: /
SeznamBot
User-agent: SeznamBot Allow: /
AdsBot-Google
User-agent: AdsBot-Google Allow: /
Twitterbot
User-agent: Twitterbot Allow: /
Adidxbot
User-agent: Adidxbot Allow: /
Yahoo Pipes 1.0
User-agent: Yahoo Pipes 1.0 Disallow: /
008
User-agent: 008 Disallow: /
voltron
User-agent: voltron Disallow: /
Bytespider
User-agent: Bytespider Disallow: /
Facebot
User-agent: Facebot Disallow: /
externalfacebookhit
User-agent: externalfacebookhit Disallow: /
EtaoSpider
User-agent: EtaoSpider Disallow: /
GPTBot (OpenAI)
User-agent: GPTBot Allow: /
ChatGPT-User
User-agent: ChatGPT-User Allow: /
ClaudeBot (Anthropic)
User-agent: ClaudeBot Allow: /
PerplexityBot
User-agent: PerplexityBot Allow: /
Googlebot-Extended (Google AI)
User-agent: Googlebot-Extended Allow: /
Host
Host: https://migma.ai
Sitemaps
Sitemap: https://migma.ai/sitemap.xml Sitemap: https://docs.migma.ai/sitemap.xml