cohere-ai
Cohere · reviewed 2026-11-05
About cohere-ai
robots.txt opt-out token for Cohere; has no user agent of its own.
Operates Command models; cohere-ai is a robots.txt opt-out token, the training crawler carries its own user agent.
Usually means: A model provider fetched this URL for future training data. It does not mean today's answers cite the page.
Identity
This token is declared in robots.txt only. It does not send an HTTP user agent, so it cannot be matched by user-agent strings.
robots.txt token
Use this token in a User-agent line to allow or block the crawler.
Block this token
User-agent: cohere-ai Disallow: /
A Disallow only stops crawlers that honor robots.txt. Classify the category before blocking; check the live file with the robots.txt checker.
Verify a hit
This entry exists only as a robots.txt token. It does not send an HTTP request of its own, so there is no user agent, reverse DNS or IP range to verify. Fetches that honor the token arrive under the vendor's HTTP crawler identity.
cohere-ai: common questions
What is cohere-ai?
cohere-ai is a robots.txt token from Cohere, filed under Training — robots.txt opt-out token for Cohere; has no user agent of its own.
Does cohere-ai train AI models?
It is a control rather than a fetcher: the token lets a site opt out of Cohere's use of its content for training, and it produces no hits of its own.
How do I block cohere-ai in robots.txt?
Add User-agent: cohere-ai with Disallow: / to robots.txt. cohere-ai is an opt-out token, not a fetcher: the directive changes how Cohere may use your content, while the vendor's HTTP crawlers keep their own tokens.
How do I verify a cohere-ai hit?
There is no cohere-ai hit to verify: the token sends no request of its own. Fetches you see arrive under Cohere's HTTP crawler identity instead.
Testing a block? Run the live file through the robots.txt tester or check the whole AI crawler access group.
See when cohere-ai hits your site
Page scripts never see AI crawlers because they do not run JavaScript. Install the server probe and each hit lands in the Crawlers block with its path and status.