AI2Bot: Ai2's training crawler
AI2Bot is the crawler of Ai2, the Allen Institute for AI, which collects web content to train its open language models.
Picked is an AI visibility tool for agencies and B2B SaaS teams. It asks ChatGPT, Claude, Gemini, Perplexity and Google's AI answers the prompts your buyers ask, records which brands and pages they name, and writes the article built to become the source they quote.
At a glance
AI2Bot in one table
- Company
- Ai2
- What it's for
- Training: collected to train future models.
- robots.txt token
AI2Bot- Full user agent
Mozilla/5.0 (compatible) AI2Bot (+https://www.allenai.org/crawler)- Follows robots.txt
- Not stated. Ai2 says its user agent can be used to filter or reject its traffic. Its page doesn't describe robots.txt.
- How to verify
- Ai2 publishes no IP list or other way to check, so a visit with this user agent can't be verified.
- Source
- Ai2's documentation, read on October 12, 2026.
robots.txt
Allow AI2Bot
Allowing it lets your future pages into what the model learns, which is how it knows your brand before it searches. Opting out is a choice you can make if your content is your product: search and live-answer bots run under other names, so it doesn't take you out of today's answers.
User-agent: AI2BotAllow: /Needed only if a wider rule blocks it: robots.txt lets every bot in by default. A bot named in its own group ignores the User-agent: * group, so repeat your private paths there as Disallow lines. A block in your CDN or firewall has to be lifted there.
User-agent: AI2BotDisallow: /A rule only changes what the bot reads next. To see whether AI2Bot reads your pages now, and which ones, track AI crawlers on your server or see the full AI crawler list.
Related
Other training bots
Questions
Frequently asked questions
From Ai2's documentation, read on October 12, 2026.
AI2Bot is the crawler of Ai2, the Allen Institute for AI, which collects web content to train its open language models.
Ai2 says its user agent can be used to filter or reject its traffic. Its page doesn't describe robots.txt.
Ai2 publishes no IP list or other way to check, so a visit with this user agent can't be verified.
Allowing it lets your future pages into what the model learns, which is how it knows your brand before it searches. Opting out is a choice you can make if your content is your product: search and live-answer bots run under other names, so it doesn't take you out of today's answers.
Find out what ChatGPT and Google AI say about you
Add your domain and the prompts your buyers ask. Unlimited seats for your whole team, and no promises we can't keep.