Free tool
Most robots.txt templates are built to block bots. This tool does the opposite: you choose which AI crawlers to let in, so AI models can actually read and cite your website.
No paths blocked. Everything else is allowed for the AI crawlers above with Allow: /.
User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Google-Extended Allow: / User-agent: PerplexityBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / User-agent: meta-externalagent Allow: / User-agent: * Allow: /
Blocking AI crawlers is one of the most common reasons businesses are invisible in ChatGPT and Claude. Check the rest of your AI readiness, or read why robots.txt for AI crawlers matters so much.
Letting AI crawlers in is necessary, but not enough. Run a free visibility check to see whether AI actually finds and recommends you.