llms.txt
Best for concise model instructions and curated entry points.
AI-ready site formats
OKF vs llms.txt
OKF and llms.txt solve related but different problems.
llms.txt is a concise entry point for LLMs. OKF is a traversable Markdown knowledge bundle.
What does an OKF concept look like?
--- type: Web Page title: Product Docs description: AI-readable documentation. --- # Summary A concise Markdown concept.
Generate OKF from a website
Paste a sitemap or up to 20 page URLs. The tool creates Markdown concepts, an index, a log, and a validation report.
Validate OKF v0.1 Markdown
Check required frontmatter, the required type field, optional quality signals, and internal links.
Frontmatter preview
type: Web Page title: Example Page description: A page converted into Open Knowledge Format.
How OKF differs from llms.txt
llms.txt gives models a compact reading guide. OKF gives agents a structured, portable bundle of concepts with metadata, links, and citations.
OKF
Best for a traversable knowledge bundle with frontmatter and cross-links.
Together
Use llms.txt to point agents toward your /okf/ directory.
Recommended setup
/llms.txt points agents to /okf/index.md /okf/index.md lists structured knowledge concepts /okf/concepts/*.md stores rich Markdown concepts /sitemap.xml helps crawlers discover public URLs
| Format | Best for | Not good for |
|---|---|---|
| sitemap.xml | URL discovery | Explaining meaning or relationships |
| llms.txt | Model reading guide | Rich knowledge bundles |
| OKF | Structured Markdown concepts | Broad crawler URL discovery |
| Schema.org | Page-level structured data | Portable documentation folders |