ChatGPT-User
Stated to honor robots.txtChatGPT-User fetches a specific page in real time when a user explicitly asks ChatGPT to open, read or summarize a URL, or via a connected plugin or action — an on-demand fetch rather than a broad, scheduled crawl.
- User-agent
- ChatGPT-User
- Operator
- OpenAI
Allow in robots.txt
User-agent: ChatGPT-User
Allow: /Block in robots.txt
User-agent: ChatGPT-User
Disallow: /Blocking this breaks the specific case of a user pasting your URL into ChatGPT and asking it to summarize the page — a small but real use case for content-heavy sites and documentation.