robots.txt & llms.txt across the Tranco top 1M

Domain explorer

Look up a single domain's robots.txt & llms.txt metrics, effective AI policy, inferred tech stack (labelled hypothesis), and crawl history. Read-only; one indexed lookup per query.

architecture.org

Tranco rank
134,187
popularity rank
TLD
org
architecture.org
robots.txt records
1
across crawls
llms.txt records
0
across crawls

Live files on architecture.org

Open the file as it exists on the host right now — may differ from what we measured. We link out rather than mirror (we store derived metrics, not raw bodies).

Captured samples

Snapshots we captured for the showcase set (may differ from the live file above). Large files are truncated; the true size is noted.

/robots.txt · 179 bytes
# START nuxt-robots (indexable)
User-agent: *
Allow: /

Sitemap: https://www.architecture.org/sitemap.xml
Sitemap: https://www.architecture.org/sitemap_index.xml
# END nuxt-robots

Effective AI / crawl policy (Google posture, §3.3)

CrawlPostureConsec. 5xxReasonAs of
CC-MAIN-2026-25 open 0 2xx: robots.txt present, no full disallow in effect 2026-06-10T23:45:26-07:00

robots.txt

CrawlStatusBytesGroupsAllowDisallow SitemapsWildcard *Disallow-allAI tokensAI verdicts
CC-MAIN-2026-25 200 179 1 1 0 2 yes no

llms.txt

Collected by our own polite crawler, not Common Crawl — Common Crawl doesn't capture /llms.txt. See Methodology.

No llms.txt records for this domain.

Inferred tech stack hypothesis

No tech inference for this domain.