See which AI crawlers read your site, from Cloudflare
Connect Cloudflare and Picked reads your site's analytics to show which AI crawlers, like GPTBot, ChatGPT-User and ClaudeBot, opened which pages, how often, and which requests were turned away. It needs no code on your site and reads the last 30 days as soon as you connect.
Picked is an AI visibility tool for SEO and marketing agencies, and B2B SaaS teams. Every day it asks ChatGPT, Claude, Gemini, Perplexity and Google's AI answers the prompts your buyers ask, records which brands and pages they name, and writes the article built to become the source they quote.
30 days
of AI crawler visits read the moment you connect
Hourly
sync after that, until you disconnect
What you see
What does Picked read from Cloudflare?
Picked reads your zone's request analytics: which user agents asked for which paths, with what status, each hour. It keeps the AI crawlers and drops the rest.
Pages
- Which of your pages the AI bots opened, and how many times
Bots
- Which bots came and which company owns each, split by why they came: a live answer, an AI agent, a search index or training
Turned away
- Requests a bot made that were answered 401, 403 or 429: a firewall rule or rate limit standing between the bot and your page
| On the Analytics screen | What it tells you |
|---|---|
| Pages | Which of your pages the AI bots opened, and how many times |
| Bots | Which bots came and which company owns each, split by why they came: a live answer, an AI agent, a search index or training |
| Turned away | Requests a bot made that were answered 401, 403 or 429: a firewall rule or rate limit standing between the bot and your page |
Cloudflare classifies verified bots itself, so these hits carry Cloudflare's verdict on whether the visitor is who it says. Nothing about your visitors' identities is read: it is counts by user agent, path, status and country.
Connect
How do you connect Cloudflare?
- 1
Open Analytics
In your project, choose Connect Cloudflare.
- 2
Sign in to Cloudflare and approve
Picked asks for zone read, analytics read and offline access, which lets the hourly sync run without you signing in each time. It cannot change anything on your account.
- 3
Pick the site
If the account has several, choose the one that serves your domain.
- 4
Wait a few seconds
Picked reads the last 30 days, and then syncs every hour.
To stop, disconnect from the same screen. Picked revokes its access with Cloudflare and deletes the hits it stored.
Count the fetches, not the training crawls.
Limits
What should you know before connecting?
30 days back
Cloudflare keeps about a month of these analytics on the Free plan, and Picked reads 30 days when you connect. Older visits aren't there to read.
Estimates on busy sites
Cloudflare samples the analytics of high-traffic zones, so counts are close, not exact.
Visits from AI answers need referrers
Picked also counts people who clicked through from ChatGPT, Perplexity or Claude, but only when the zone's analytics include the referrer and query string. Cloudflare's Free plan doesn't share them, so on Free you see the crawlers and not those visits.
Only traffic that goes through Cloudflare
A site not proxied by Cloudflare has nothing to read.
One source per project
A project reads its crawlers from Cloudflare, Vercel or your server, not two at once, or the same visit would count twice. Connecting one removes the other.
Cloudflare's own verdict
Hits pushed from a server or Vercel are checked against the IP ranges the AI companies publish. Cloudflare hits are trusted as Cloudflare classifies them.
When not to
When this won't work for you
Honest answer: sometimes this isn't worth your time.
Your site isn't behind Cloudflare
Use Vercel or your own server instead.
You need more than 30 days of history
Picked can't read further back than Cloudflare keeps.
You can't sign in to the Cloudflare account
The person who connects needs access to the site's zone.
You expect to fix something here
This shows what the bots do. Blocking or allowing them is a setting in Cloudflare or your
robots.txt, and Picked doesn't change either.
Check first
Which bots should you not block by accident?
Look at Turned away before anything else. Blocking OAI-SearchBot can keep your pages out of ChatGPT's search answers, and OpenAI's crawler docs say ChatGPT-User isn't used for that decision. Anthropic says blocking Claude-User or Claude-SearchBot may reduce your visibility in Claude's search answers. Blocking training crawlers is your call. Crawler visits are half the picture: an AI visibility tool also tells you whether the answers name you.
Sources
How we checked
- What Picked reads and how often: the product as built on September 30, 2026: Cloudflare's GraphQL analytics, one query set per hour after the first read.
- What each bot is for: OpenAI, Anthropic and Perplexity, read September 29, 2026.
- Setup steps: AI crawlers in the docs.
Questions
Frequently asked questions
Short answers, each one checked against the product as built or the docs we link to.
Zone read, analytics read and offline access. It reads request analytics for the site you pick and can't change your Cloudflare settings.
No. Cloudflare already sees every request, so Picked reads the analytics from the outside.
Thirty days, from the moment you connect. After that Picked keeps syncing every hour, so your history grows from there.
Cloudflare classifies verified bots, and Picked shows that classification. Anyone can send `GPTBot` as a user agent, so an unverified hit proves little.
Picked charges nothing extra for crawler analytics. See the pricing page for plans.
From the same Analytics screen. Picked revokes its access with Cloudflare and deletes the hits it stored for that project.
Connect Vercel if it runs there, or add the package to your own server. It works with Next.js, Express and any server that can make an HTTP request.
Find out what ChatGPT and Google AI say about you
Add your domain and the prompts your buyers ask. Unlimited seats for your whole team, and no promises we can't keep.