robots.txt & llms.txt across the Tranco top 1M

Domain explorer

Look up a single domain's robots.txt & llms.txt metrics, effective AI policy, inferred tech stack (labelled hypothesis), and crawl history. Read-only; one indexed lookup per query.

stirileprotv.ro

Tranco rank
7,780
popularity rank
TLD
ro
stirileprotv.ro
robots.txt records
2
across crawls
llms.txt records
1
across crawls

Live files on stirileprotv.ro

Open the file as it exists on the host right now — may differ from what we measured. We link out rather than mirror (we store derived metrics, not raw bodies).

Effective AI / crawl policy (Google posture, §3.3)

CrawlPostureConsec. 5xxReasonAs of
CC-MAIN-2026-25 open 0 2xx: robots.txt present, no full disallow in effect 2026-06-18T06:25:04-07:00

robots.txt

CrawlStatusBytesGroupsAllowDisallow SitemapsWildcard *Disallow-allAI tokensAI verdicts
CC-MAIN-2026-25 200 453 3 1 4 6 yes no GPTBot, Bytespider gptbot:block, bytespider:partial
CC-MAIN-2026-25 200 407 2 1 3 6 yes no GPTBot gptbot:block

llms.txt

Collected by our own polite crawler, not Common Crawl — Common Crawl doesn't capture /llms.txt. See Methodology.

CrawlStatusVariantConformantSections LinksGenerator
CC-MAIN-2026-25 404

llms.txt data reflects adoption + conformance only, never consumption — publishing a file does not mean any AI reads it.

Inferred tech stack hypothesis

No tech inference for this domain.