robots.txt & llms.txt across the Tranco top 1M

Domain explorer

Look up a single domain's robots.txt & llms.txt metrics, effective AI policy, inferred tech stack (labelled hypothesis), and crawl history. Read-only; one indexed lookup per query.

practicetestgeeks.com

Tranco rank
42,286
popularity rank
TLD
com
practicetestgeeks.com
robots.txt records
2
across crawls
llms.txt records
1
across crawls

Live files on practicetestgeeks.com

Open the file as it exists on the host right now — may differ from what we measured. We link out rather than mirror (we store derived metrics, not raw bodies).

Effective AI / crawl policy (Google posture, §3.3)

CrawlPostureConsec. 5xxReasonAs of
CC-MAIN-2026-25 open 0 2xx: robots.txt present, no full disallow in effect 2026-06-14T03:10:16+00:00

robots.txt

CrawlStatusBytesGroupsAllowDisallow SitemapsWildcard *Disallow-allAI tokensAI verdicts
CC-MAIN-2026-25 200 2,718 37 32 21 2 yes no Applebot, GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, anthropic-ai, PerplexityBot, Google-Extended, YouBot, Amazonbot, FacebookBot, meta-externalagent, cohere-ai, Diffbot, Timpibot, Webzio-Extended, CCBot, Bytespider applebot:allow, gptbot:allow, chatgpt-user:allow, oai-searchbot:allow, claudebot:allow, anthropic-ai:allow, perplexitybot:allow, google-extended:allow, youbot:allow, amazonbot:allow, facebookbot:allow, meta-externalagent:allow, cohere-ai:allow, diffbot:allow, timpibot:allow, webzio-extended:allow, ccbot:block, bytespider:block
CC-MAIN-2026-25 200 2,018 37 32 10 2 yes no Applebot, GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, anthropic-ai, PerplexityBot, Google-Extended, YouBot, Amazonbot, FacebookBot, meta-externalagent, cohere-ai, Diffbot, Timpibot, Webzio-Extended, CCBot, Bytespider

llms.txt

Collected by our own polite crawler, not Common Crawl — Common Crawl doesn't capture /llms.txt. See Methodology.

CrawlStatusVariantConformantSections LinksGenerator
CC-MAIN-2026-25 200 /llms-full.txt yes 1 10524 WordPress

llms.txt data reflects adoption + conformance only, never consumption — publishing a file does not mean any AI reads it.

Inferred tech stack hypothesis

No tech inference for this domain.