Domain explorer

Look up a single domain's robots.txt & llms.txt metrics, effective AI policy, inferred tech stack (labelled hypothesis), and crawl history. Read-only; one indexed lookup per query.

Try: openai.com nytimes.com github.com sheetz.com

Enter a domain above to see its metrics, AI policy, inferred tech, and history.