GPTBot

GPTBot is OpenAI's crawler (indexing robot) that browses the web to collect data used by ChatGPT in its responses. Its user-agent is GPTBot and it respects robots.txt directives.

GPTBot and visibility in ChatGPT

If your robots.txt blocks GPTBot, your pages won't be accessible to ChatGPT and you can't be cited in its responses. This is a common mistake: some sites block all bots by default, including AI crawlers. Check your configuration with our guide Robots.txt and AI crawlers.

Main AI crawlers

In addition to GPTBot, other AI crawlers to know are PerplexityBot (Perplexity AI), ClaudeBot (Anthropic/Claude), Bingbot (Microsoft/Copilot) and Google-Extended (Gemini). All must be allowed in your robots.txt to maximize your GEO visibility.