Skip to content

feat(docs): update llms.txt to GEO-compliant spec with full docs site index - #49177

Closed
pelikhan with Copilot wants to merge 2 commits into
mainfrom
copilot/geo-optimizer-create-llmstxt-robots-txt
Closed

feat(docs): update llms.txt to GEO-compliant spec with full docs site index#49177
pelikhan with Copilot wants to merge 2 commits into
mainfrom
copilot/geo-optimizer-create-llmstxt-robots-txt

Conversation

Copilot AI commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

GEO audit scored llms category 0/25 across all 20 sampled docs pages. The existing llms.txt.ts only listed raw agent prompt files — not a spec-compliant site index — and lacked prerender = true, risking omission from static builds.

Changes

  • docs/src/pages/llms.txt.ts

    • Added export const prerender = true to guarantee static generation at build time (consistent with llms-full.txt.ts)
    • Replaced agent-prompts-only content with a proper llms.txt spec layout: project title, description block, install/source metadata, then structured sections linking to key docs pages across Getting Started, AI Engines, Guides, Design Patterns, and Reference
    • Retained the existing Agent Prompt Files section at the bottom
  • docs/public/robots.txt — already contains Allow: / for 18+ AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.); no changes required

…e overview

- Add `export const prerender = true` to ensure static generation at build time
- Add project overview section (description, install, source link)
- Add structured sections for Getting Started, AI Engines, Guides, Design Patterns, and Reference with links to key docs pages per the llms.txt spec
- Retain Agent Prompt Files section with raw GitHub instruction file links
- robots.txt in docs/public/ already has comprehensive AI bot Allow rules; no changes needed

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] Create /llms.txt and robots.txt AI-bot rules for docs site feat(docs): update llms.txt to GEO-compliant spec with full docs site index Jul 30, 2026
Copilot AI requested a review from pelikhan July 30, 2026 17:12
@github-actions

Copy link
Copy Markdown
Contributor

Warning

threat detection engine error
The threat detection engine encountered an error and could not complete analysis. This is a tooling failure, not a security finding.

Details

The threat detection engine failed to produce results.

Review the workflow run logs for details.

Great work on the GEO audit improvement! 🌍 This PR updates the llms.txt endpoint to be fully spec-compliant with proper AI crawler support.

What looks good:

  • Added export const prerender = true to ensure static generation at build time
  • Replaced the agent-prompts-only content with a comprehensive [llms.txt spec]((llmstxt.org/redacted) layout that covers the full docs site
  • Well-structured sections (Getting Started, AI Engines, Guides, Design Patterns, Reference) make the docs discoverable for AI systems
  • Clear, focused change to a single file
  • Strong description with context from the driving issue ([geo-optimizer] Create /llms.txt and robots.txt AI-bot rules for docs site #49176)

Note: The PR is currently in draft state. Once you're ready to mark it ready for review, this looks solid and should score much better in the next GEO audit run.

Generated by ✅ Contribution Check · auto · 55.7 AIC · ⊞ 8.7K ·

@github-actions

Copy link
Copy Markdown
Contributor

PR Triage

Category: docs - Risk: low - Score: 38/100

Impact Urgency Quality
15 8 15

Recommended action: batch_review (batch: spec-docs-20260730)

Single-file llms.txt.ts docs update, +60/-3. Marked draft; CI still pending. Low risk, straightforward docs change - group with other spec/docs PRs opened same day (#49174, #49171) for a combined review pass. Undraft when ready and confirm CI passes before merge.

Generated by 🔧 PR Triage Agent · auto · 46.2 AIC · ⌖ 7.96 AIC · ⊞ 7.9K ·

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[geo-optimizer] Create /llms.txt and robots.txt AI-bot rules for docs site

2 participants