BotForYou Updated 9 October 2026 · Common Crawl CC-MAIN-2026-39

Platforms

Wix

1,218 sites on this month's Tranco top 1M whose robots.txt looks like Wix's, compared with all 453,286 sites Common Crawl saved.

How sure: of the 840 Wix guesses a server header or generator tag could check, 100.0% were right. A platform here is an informed guess, not a fact.

Wix sites against every site

Block GPTBot by name0.8%
every site10.1%
List a sitemap99.2%
every site66.7%
Name any AI crawler98.9%
every site20.1%
Use Cloudflare's ready-made file0.7%
every site5.9%
Tell every crawler to stay out0.0%
every site2.7%

91.8% of live Wix sites in our llms.txt sample publish one (90 of 98), against 13.7% of all live sampled sites.

Cloudflare stopped adding its ready-made file on 16 September 2026, so this month's Cloudflare row mixes files from before and after (what happened).

The biggest Wix sites we found

Highest-ranked sites whose Wix guess a server header or generator tag confirmed, skipping sites we don't showcase. Compare them side by side →