revnu-ai-crawler-access
Find out whether ChatGPT, Claude, Perplexity, Google, Bing/Copilot, Apple, Meta and other AI crawlers can actually reach your site, and fix what blocks them without opening up what should stay private. Use when the user says or asks "is my site blocking AI crawlers", "can ChatGPT see my website", "check my robots.txt for AI bots", "should I block GPTBot", "GPTBot vs OAI-SearchBot", "block AI training but stay in ChatGPT search", "allow ClaudeBot", "what is Google-Extended", "why doesn't Perplexity cite us", "Cloudflare is blocking AI bots", "are AI bots getting 403s", "opt out of AI training", "noai meta tag", "X-Robots-Tag for AI", "fix robots.txt for AI search". Runs a dependency-free Python checker against the live site and reports each crawler by name and job. Works without a Revnu account.
- Version
- 1.4.0
- License
- MIT
Pinned to revision 40cb17bbc5bd, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/revnu-ai-crawler-access/SKILL.md
- skills/revnu-ai-crawler-access/agents/openai.yaml
- skills/revnu-ai-crawler-access/assets/icon.png
- skills/revnu-ai-crawler-access/evals/evals.json
- skills/revnu-ai-crawler-access/references/crawlers.md
- skills/revnu-ai-crawler-access/references/robots-recipes.md
- skills/revnu-ai-crawler-access/references/sources.md
- skills/revnu-ai-crawler-access/scripts/check_ai_crawlers.py
Every link opens the file at its source, pinned to the revision this page describes.