robots.txt & llms.txt across the Tranco top 1M

Domain explorer

Look up a single domain's robots.txt & llms.txt metrics, effective AI policy, inferred tech stack (labelled hypothesis), and crawl history. Read-only; one indexed lookup per query.

fastly.net

Tranco rank
33
popularity rank
TLD
net
fastly.net
robots.txt records
0
across crawls
llms.txt records
1
across crawls

Live files on fastly.net

Open the file as it exists on the host right now — may differ from what we measured. We link out rather than mirror (we store derived metrics, not raw bodies).

Captured samples

Snapshots we captured for the showcase set (may differ from the live file above). Large files are truncated; the true size is noted.

/llms.txt · 15,771 bytes
# Fastly

> Fastly is an edge cloud platform that enables developers to build, secure, and deliver fast, scalable websites and applications. Founded in 2011 and publicly traded (NYSE: FSLY), Fastly operates a fully software-defined global network with 578 Tbps of edge capacity, serving more than 5 trillion requests daily. Fastly is known for its programmable CDN, real-time observability, next-generation WAF, and edge compute capabilities built on WebAssembly. It is a Leader in the Forrester Wave™ for Edge Development Platforms (Q1 2026) and has been named a Gartner Customers' Choice for Web Application and API Protection seven years in a row with a 4.8/5 star rating.

This is the main Fastly website at fastly.com. For technical documentation, see fastly.com/documentation.

## About Fastly

Fastly was founded in March 2011 by Artur Bergman and went public on the NYSE (ticker: FSLY). It is headquartered in San Francisco and serves digital businesses across eCommerce, streaming media, digital publishing, financial services, gaming, and high tech. The current CEO is Kip Compton (since June 2025); CTO is Artur Bergman (founder).

Fastly's core thesis: fewer, more powerful Points of Presence (POPs) outperform large numbers of weaker nodes — because more powerful POPs cache more content and serve it faster. The network is fully software-defined.

Key facts:
- 578 Tbps global edge network capacity (as of March 2026)
- More than 5 trillion daily requests served (as of March 2026)
- <150 ms regional mean purge time with Instant Purge™ (as of December 2025)
- Up to 32% faster time to first byte (TTFB) vs. other CDNs
- ~90% of customers run Next-Gen WAF in blocking mode
- 90K+ app deployments protected
- Leader in Forrester Wave™: Edge Development Platforms, Q1 2026
- Gartner Customers' Choice for WAAP — 7 consecutive years, 4.8/5 stars
- IDC MarketScape Leader: Worldwide Edge Delivery Services 2024
- NYSE: FSLY

Fastly serves three primary audiences:
- **Developers** building fast, personalized, and secure applications at the edge using WebAssembly-powered compute, key-value stores, real-time messaging, and developer SDKs
- **Security teams** protecting web applications, APIs, and clients from DDoS, bots, injections, and client-side attacks via a unified Next-Gen WAF and bot management platform
- **Digital businesses** (media, eCommerce, finance, travel, gaming) seeking to reduce latency, lower infrastructure costs, and scale reliably without traffic spikes or CDN surprises

---

## Network Services

Fastly's delivery network is fully programmable and software-defined, designed for dynamic and event-driven content with real-time configuration changes and predictable pricing.

- [Content Delivery (CDN)](https://www.fastly.com/products/cdn): Accelerates static and dynamic content delivery globally with real-time cache control, Instant Purge™, and programmatic configuration via VCL
- [Live Streaming](https://www.fastly.com/products/live-streaming): Low-latency live media streaming with instant scaling for high-concurrency live events
- [Streaming Video (VoD)](https://www.fastly.com/products/streaming-media/video-on-demand): On-demand video delivery with just-in-time transmuxing to popular streaming formats at any resolution and frame rate
- [Media Shield](https://www.fastly.com/products/streaming-media/media-shield): Optimizes multi-CDN deployments by reducing origin traffic while maintaining high performance
- [On-the-Fly Packager (OTFP)](https://www.fastly.com/products/perform/otfp): Dynamically packages on-demand video in real time, eliminating offline pre-processing and reducing storage costs
- [Image Optimizer](https://www.fastly.com/products/image-optimizer): Rapid image processing, resizing, and format optimization at the edge to cut page load times
- [Load Balancer](https://www.fastly.com/products/load-balancing): Granular, real-time routing control for fast, secure, and scalable request distribution
- [TLS Encryption](https://www.fastly.com/products/tls-encryption): TLS termination at the edge to offload encrypted traffic from origin servers for improved performance
- [Origin Connect](https://www.fastly.com/products/ways-to-connect): Dedicated private network interconnection between your origin and Fastly
- [IP Addresses](https://www.fastly.com/products/ip-addresses): Dedicated IPs and Bring Your Own IP (BYOIP) support for domain-level control
- [HTTP/3 & QUIC](https://www.fastly.com/products/quic-http-3): Support for modern protocols that reduce latency and improve connection reliability
- [Domain Research API](https://www.fastly.com/products/domain-research-api): Instant, accurate domain name discovery and lookup
- [Object Storage](https://www.fastly.com/products/storage): Direct access to large files at the edge with zero egress fees

---

## Security

Fastly's security platform is built into the edge — no appliances, no latency penalty. It protects web apps, APIs, and clients from automated attacks, application-layer threats, and client-side supply chain risks.

- [Next-Gen WAF](https://www.fastly.com/products/web-application-api-protection): Advanced protection for applications, APIs, and microservices from a single unified solution, deployable anywhere (edge, cloud, on-prem). ~90% of customers run it in full blocking mode.
- [Bot Management](https://www.fastly.com/products/bot-management): Eliminates fraud and abuse from automated attacks — credential stuffing, scraping, inventory hoarding — without disrupting legitimate users
- [DDoS Protection](https://www.fastly.com/products/ddos-protection): Automated, always-on mitigation of application-layer DDoS attacks leveraging Fastly's network bandwidth and adaptive techniques; no configuration required
- [API Security](https://www.fastly.com/products/api-security): Full visibility into the API landscape — discovery, schema validation, anomaly detection, and targeted abuse mitigation
- [Client-Side Protection](https://www.fastly.com/products/fastly-client-side-protection): Defends against Magecart-style attacks and unauthorized JavaScript execution with script inventory and management
- [AI Bot Management](https://www.fastly.com/products/fastly-ai-bot-management): Dedicated signals to detect, block, deceive, or allow AI bots scraping website content without consent or credit

---

## Compute

Fastly's serverless edge compute platform runs on WebAssembly for microsecond cold starts, open standards, and deep integration with Fastly's full product suite.

- [Edge Compute](https://www.fastly.com/products/edge-compute): Deploy and run custom code at the edge using WebAssembly; supports Rust, JavaScript, Go, and more
- [Enterprise Serverless](https://www.fastly.com/products/compute-enterprise): The most powerful serverless platform built on open standards, fully integrated with Fastly's network and security stack
- [Key Value Store](https://www.fastly.com/products/kv-store): Ultra-low-latency key-value data store at the edge, with familiar database-style tooling
- [Programmable Cache](https://www.fastly.com/products/cache): Full programmatic access to Fastly's legendary caching infrastructure — go beyond static TTLs
- [Websockets & Fanout](https://www.fastly.com/products/real-time): Real-time messaging and pub/sub at global scale with complete personalization and simple setup
- [AI](https://www.fastly.com/products/ai): Accelerates AI workloads at the edge with semantic caching to improve efficiency and reduce LLM inference costs
- [MCP Server](https://www.fastly.com/products/mcp-server): AI-powered control for Fastly services via the Model Context Protocol
- [Object Storage](https://www.fastly.com/products/storage): Large-file access at the edge with zero egress fees
- [Developer SDKs](https://www.fastly.com/products/sdks): Program Fastly services using the same SDKs the Fastly engineering team uses internally
- [Dev Tools](https://www.fastly.com/products/devtools): Developer tooling built for teams working at the edge, integrated with existing CI/CD workflows

---

## Observability

Fastly provides real-time, 100% data logging and traffic visibility — not sampled, not delayed.

- [Real-time Logging](https://www.fastly.com/products/logging): Stream and analyze logs in real-time to any logging endpoint partner or in-house tool; nearly 100% of logs sent in real time
- [Edge Observer](https://www.fastly.com/products/metrics): Explore live and historical traffic data at the edge level
- [Domain Inspector](https://www.fastly.com/products/metrics/domain-inspector): Domain-level request, byte, and status code tracking for granular business and security insights
- [Origin Inspector](https://www.fastly.com/products/metrics/origin-inspector): Real-time and historical origin-to-edge visibility for performance monitoring and debugging
- [Alerts](https://www.fastly.com/products/alerts): Custom notifications for service-related metrics and anomalies
- [Log Explorer & Insights](https://www.fastly.com/products/logexplorer-and-insights): Interactive log querying and actionable insights directly within the Fastly dashboard

---

## Services

- [Professional Services](https://www.fastly.com/services/professional-services): Expert migration and optimization support for CDN and security deployments
- [Managed CDN](https://www.fastly.com/services/managed-cdn): Fully managed CDN with maximum control and flexibility
- [Managed Security](https://www.fastly.com/services/managed-security-service): Expertly managed web application protection
- [Live Entertainment Services](https://www.fastly.com/services/live-event-services): Live streaming support that scales with audiences for concerts, sports, and major events
- [Support Plans](https://www.fastly.com/services/support-plans): Tiered world-class support from onboarding through production

---

## Solutions by Industry

- [Streaming Media](https://www.fastly.com/solutions/streaming-media): Low-latency live and on-demand streaming at global scale
- [eCommerce](https://www.fastly.com/solutions/ecommerce): Fast, personalized retail experiences with real-time data and DDoS/bot protection
- [Digital Publishing](https://www.fastly.com/solutions/digital-publishing): Real-time content invalidation and delivery for journalism and publishing at scale
- [Financial Services](https://www.fastly.com/solutions/finance): Low-latency API delivery and integrated security for financial apps and data
- [Gaming](https://www.fastly.com/solutions/gaming): Ultra-fast, secure game downloads and live service delivery
- [iGaming](https://www.fastly.com/solutions/igaming): Fast, secure, and uninterrupted gameplay delivery at the edge
- [Travel & Hospitality](https://www.fastly.com/solutions/travel): Personalized digital experiences with edge caching of dynamic content and APIs
- [Online Education](https://www.fastly.com/solutions/online-education): Secure, scalable delivery of learning experiences globally
- [High Tech](https://www.fastly.com/solutions/high-tech): Instantly scalable performance for SaaS and technology platforms
- [Emerging Media](https://www.fastly.com/solutions/emerging-media): High-performance delivery for emerging media brands

---

## Solutions by Need

- [Infrastructure Savings](https://www.fastly.com/solutions/infrastructure-savings): Lower and more predictable cloud spend; reduced egress costs and TCO
- [Multi-cloud Optimization](https://www.fastly.com/solutions/multi-cloud-optimization): Reduce complexity and unify resources across cloud providers
- [Privacy Enablement](https://www.fastly.com/solutions/privacy-enablement): Tools and policies to protect user data and comply with privacy regulations
- [Customer Trust](https://www.fastly.com/solutions/customer-trust): Fastly's initiatives on security, reliability, compliance, and transparency
- [Sustainability Dashboard](https://www.fastly.com/products/sustainability-dashboard): Track electricity use and GHG emissions for your Fastly workloads

---

## Pricing

- [Pricing](https://www.fastly.com/pricing): Usage-based pricing with no surprise overages; free trial available; predictable billing for network, security, and compute products

---

## Developers

- [Developer Hub](https://www.fastly.com/documentation/developers): Documentation, 200+ code examples, and community resources
- [Fastly Academy](https://academy.fastly.com/): Hands-on learning paths for Fastly products
- [Learning Center](https://www.fastly.com/learning): Educational content about internet technology, CDN, edge compute, and security concepts
- [Fast Forward](https://www.fastly.com/fast-forward): Fastly's program for open-source and nonprofit projects — free services to build a more trustworthy internet
- [Community](https://fastly.com/documentation/developers/community): Global developer community forums and discussion

---

## Compare

- [Fastly vs. Akamai](https://www.fastly.com/resources/datasheets/fastly-vs-akamai): Side-by-side capability comparison
- [Fastly vs. Cloudflare](https://www.fastly.com/resources/datasheets/capability-comparison-cloudflare/): Side-by-side capability comparison
- [Fastly vs. Imperva](https://www.fastly.com/resources/datasheets/capability-comparison-security-imperva/): Security-focused comparison
- [Fastly vs. Cloud Providers](https://www.fastly.com/resources/datasheets/fastly-cdn-performance-compared-to-cloud-providers/): CDN performance vs. AWS CloudFront, Google Cloud CDN, and Azure CDN

---

## Partners

- [Cloud Partners](https://www.fastly.com/partners/cloud-partners): AWS, Google Cloud, Microsoft Azure integration partnerships
- [Channel Partners](https://www.fastly.com/channel-partner-program): Reseller and referral partner program
- [Technology & Integration Partners](https://www.fastly.com/partners/technology-partners): Ecosystem of integrations with monitoring, logging, security, and DevOps tools

---

## Other Pages

- [Trust](https://www.fastly.com/trust): Security, compliance, privacy, and reliability commitments
- [Network Map](https://www.fastly.com/network-map): Interactive map of Fastly's global POP locations and network architecture
- [Threat Insights Report](https://www.fastly.com/threat-insights): Attack trends and techniques from Fastly's Security Research Team via the Network Learning Exchange
- [Security Research](https://www.fastly.com/security-research): Original research from Fastly's security team
- [Privacy Policy](https://www.fastly.com/privacy/): Privacy policy
- [Terms of Service](https://www.fastly.com/terms/): Terms of service
- [Acceptable Use](https://www.fastly.com/acceptable-use): Acceptable use policy
- [Investor Relations](https://investors.fastly.com/): Financial reports, SEC filings, and investor information (NYSE: FSLY)

---

## External Resources

- [Documentation](https://www.fastly.com/documentation/): Full technical documentation for all Fastly products and APIs
- [Fastly Control Panel](https://manage.fastly.com/): Manage your Fastly account and services
- [Network Status](https://www.fastlystatus.com/): Real-time Fastly network and service status
- [Support Center](https://support.fastly.com/): Help articles, tickets, and community support
- [Blog](https://www.fastly.com/blog): Product announcements, engineering deep-dives, and internet insights
- [Resource Library](https://www.fastly.com/resources): Datasheets, whitepapers, analyst reports, and case studies
- [Customer Stories](https://www.fastly.com/customers): Case studies from Deliveroo, GIPHY, Gannett, Bell Media, 1stDibs, and more
- [GitHub](https://github.com/fastly): Open-source projects and SDKs from the Fastly engineering team
- [Under Attack?](https://www.fastly.com/under-attack): Emergency DDoS response — call (844) 4FASTLY

Effective AI / crawl policy (Google posture, §3.3)

CrawlPostureConsec. 5xxReasonAs of
CC-MAIN-2026-25 blocked 0 2xx: robots.txt disallows all crawling (Disallow: /) 2026-06-18T16:37:27+00:00

robots.txt

No robots.txt records for this domain.

llms.txt

Collected by our own polite crawler, not Common Crawl — Common Crawl doesn't capture /llms.txt. See Methodology.

CrawlStatusVariantConformantSections LinksGenerator
CC-MAIN-2026-25 200 /llms.txt yes 14 85

llms.txt data reflects adoption + conformance only, never consumption — publishing a file does not mean any AI reads it.

Inferred tech stack hypothesis

No tech inference for this domain.