Skip to content
  1. Home
  2. Guides and documents
  3. The /llms.txt file

The /llms.txt file

The llms.txt proposal: a markdown index that helps AI agents use a website

What it is

Source of the llms.txt proposal by Jeremy Howard, now in a v2 revision. It specifies a markdown file at a site root that points language models to concise, clean versions of the most useful pages, and the repository also carries the documentation site and tooling around the format. Read it before adding llms.txt to a docs or marketing site.

Good for

  • Learn the llms.txt file format
  • Write an llms.txt for a documentation site
  • Decide which pages to expose to AI agents
Worth knowingIt is a proposal, not a ratified standard; AI search engines do not commit to reading the file.

Sources

The summary is ours, written from the README. Spotted an error? See how we work.

More for marketing & SEO

See the topic →
  • The Website Specification

    jdevalk/specification.website

    Platform-agnostic, sourced specification for what a well-built website requires

    GuideGitHub stars: 923
  • Awesome Generative Engine Optimization

    amplifying-ai/awesome-generative-engine-optimization

    Curated reading list on GEO: guides, case studies, tools, research and docs

    GuideGitHub stars: 541
  • The Agency

    msitarzewski/agency-agents

    Persona-style agents by division: marketing, sales, design, engineering

    SubagentsGitHub stars: 168k
  • Marketing Skills

    coreyhaines31/marketingskills

    50+ marketing skills: CRO, copy, SEO, analytics, ads, email, pricing

    SkillGitHub stars: 60k