Scoutern

cohere-ai

Honors robots.txt

cohere-ai crawls web content to train Cohere's enterprise-focused language models, which power a range of business AI products rather than a single consumer-facing chat assistant.

User-agent
cohere-ai
Operator
Cohere

Allow in robots.txt

User-agent: cohere-ai
Allow: /

Block in robots.txt

User-agent: cohere-ai
Disallow: /

Lower consumer visibility than OpenAI, Anthropic or Google, but relevant for brands targeting enterprise or developer audiences where Cohere-powered products are more common.

Frequently asked questions

If your audience includes enterprise developers or teams building on Cohere's models, allowing it costs nothing and keeps you eligible for inclusion in a smaller but relevant model ecosystem.

More AI crawlers

OpenAI

GPTBot

OpenAI

OAI-SearchBot

OpenAI

ChatGPT-User

Verify your robots.txt against every AI crawler

Scoutern's free AI bot checker tests exactly which bots can reach your site.

Check my robots.txtSee pricing