Every AI bot · Google
googleother
A name associated with Google whose purpose hasn't been clearly documented.
In robots.txt: User-agent: googleother
The numbers
38.3%
47.1%
14.6%
Block the whole site: 3,224Block some paths: 3,960Name it but allow it: 1,226
Google's other bots
Sites often treat one company's bots differently, depending on what each is for.
| Bot | Purpose | Files naming it | Of those, block it |
|---|---|---|---|
| Google-Extended | Collects pages to train AI | 62,050 | 72.3% |
Who does what
The highest-ranked sites on the top million in each group. Click one to see its whole robots.txt verdict.
Block it
- amazon.com #24
- msn.com #69
- amazonvideo.com #123
- snapchat.com #130
- medium.com #199
Block some paths
- reuters.com #282
- tradingview.com #364
- wsj.com #373
- squarespace.com #544
- ouest-france.fr #1,071
Name it and allow it
- dailymail.co.uk #685
- gumgum.com #761
- adform.net #806
- waze.com #1,316
- akamai.com #1,889
Lists skip sites we don't showcase (adult content).
What this means for you: its purpose isn't documented, so what blocking it changes is unclear. Decide each bot on what it's for, not who runs it.
Counts use one robots.txt per site on this month's Tranco top 1M (600,979 files we could read). Bot list: registry 2026-07-14.1, kept in sync with Dark Visitors and ai.robots.txt.