BotForYou Updated 9 October 2026 · Common Crawl CC-MAIN-2026-39

Platforms

Joomla

5,588 sites on this month's Tranco top 1M whose robots.txt looks like Joomla's, compared with all 453,286 sites Common Crawl saved.

How sure: of the 3,347 Joomla guesses a server header or generator tag could check, 82.7% were right. A platform here is an informed guess, not a fact.

Joomla sites against every site

Block GPTBot by name7.0%
every site10.1%
List a sitemap28.3%
every site66.7%
Name any AI crawler11.7%
every site20.1%
Use Cloudflare's ready-made file3.3%
every site5.9%
Tell every crawler to stay out0.7%
every site2.7%

6.8% of live Joomla sites in our llms.txt sample publish one (36 of 529), against 13.7% of all live sampled sites.

Cloudflare stopped adding its ready-made file on 16 September 2026, so this month's Cloudflare row mixes files from before and after (what happened).

The biggest Joomla sites we found

  1. e-recht24.de #3,450
  2. proxmox.com #3,862
  3. goneo.de #5,719
  4. slobodnadalmacija.hr #7,799
  5. loteriasdehoy.co #10,107

Highest-ranked sites whose Joomla guess a server header or generator tag confirmed, skipping sites we don't showcase. Compare them side by side →