robots.txt & llms.txt across the Tranco top 1M

Domain explorer

Look up a single domain's robots.txt & llms.txt metrics, effective AI policy, inferred tech stack (labelled hypothesis), and crawl history. Read-only; one indexed lookup per query.

Try: openai.com nytimes.com github.com sheetz.com

imedia.cz

Tranco rank
6,061
popularity rank
TLD
cz
imedia.cz
robots.txt records
0
across crawls
llms.txt records
0
across crawls

Live files on imedia.cz

Open the file as it exists on the host right now — may differ from what we measured. We link out rather than mirror (we store derived metrics, not raw bodies).

robots.txt ↗ llms.txt ↗ llms-full.txt ↗ ai.txt ↗

Effective AI / crawl policy (Google posture, §3.3)

CrawlPostureConsec. 5xxReasonAs of
CC-MAIN-2026-25 blocked 0 2xx: robots.txt disallows all crawling (Disallow: /) 2026-06-11T20:27:01+00:00

robots.txt

No robots.txt records for this domain.

llms.txt

Collected by our own polite crawler, not Common Crawl — Common Crawl doesn't capture /llms.txt. See Methodology.

No llms.txt records for this domain.

Inferred tech stack hypothesis

No tech inference for this domain.