Skip to main content
Menu
Free website tool

Are you letting
AI find you?

Check which AI crawlers your robots.txt allows, which it blocks, and what each decision means for your site.

Free to check. No sign-up needed.

Different bots. Different jobs.

One check shows who you let in — and what that access is for.

01

Search

Can AI find your pages and use them in answers?

Not checked

ChatGPT

OAI-SearchBot

ChatGPT search

Not checked

Perplexity

PerplexityBot

Perplexity search

Not checked

Claude

Claude-SearchBot

Claude search

Not checked

Google

Googlebot

Google Search, AI Overviews and AI Mode

Not checked

Bing & Copilot

bingbot

Bing Search and Copilot

02

Retrieval

Can an assistant open your page when someone shares its URL?

Not checked

ChatGPT

ChatGPT-User

User requests in ChatGPT

Not checked

Perplexity

Perplexity-User

User requests in Perplexity

Not checked

Claude

Claude-User

User requests in Claude

03

Training

Can your content be collected to train future models? Your choice, separate from search.

Not checked

ChatGPT

GPTBot

OpenAI model training

Not checked

Claude

ClaudeBot

Anthropic model training

Not checked

Gemini usage controls

Google-ExtendedControl token · not a crawler

Gemini training and grounding

Controls Gemini training and grounding. Does not remove pages from AI Overviews or AI Mode.

Training access is a business and rights decision. These settings do not affect the search-access headline above.

Registry verified 2026-09-15 · Reviewed quarterly. This checker fetches only robots.txt, using HeadingRobotsCheck/1.0. Contact the team.
AI crawler access checker | Heading