Skip to content
This repository was archived by the owner on May 29, 2026. It is now read-only.

feat(docs): wire AI-crawler baseline (preset 3.4.0 + validator + llms.txt)#43

Merged
rubenvdlinde merged 1 commit into
developmentfrom
feat/docs-ai-baseline
May 18, 2026
Merged

feat(docs): wire AI-crawler baseline (preset 3.4.0 + validator + llms.txt)#43
rubenvdlinde merged 1 commit into
developmentfrom
feat/docs-ai-baseline

Conversation

@rubenvdlinde

Copy link
Copy Markdown
Contributor

Summary

Wires the AI-crawler baseline that conduction-website shipped, so AI search bots (GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot, Claude-SearchBot, Google AI Overviews) can index this docs site to contract.

Changes

  • docs/package.json: bump @conduction/docusaurus-preset to ^3.4.0; add postbuild + validate:ai-baseline scripts.
  • docs/scripts/validate-ai-baseline.mjs: generic postbuild validator. Asserts robots.txt names an AI bot, llms.txt is shipped, sitemap exists, and per-page JSON-LD is present. Exits non-zero on failure so CI blocks regressions.
  • docs/static/llms.txt: per-app intro paragraph plus the standard nav skeleton (Tutorials/Features/UseCases/Integrations/Technical/user-guide/api) and contact block.

References

Test plan

  • CI green on this PR (postbuild validator runs during build).
  • After merge + deploy, curl https://app-versions.conduction.nl/llms.txt returns the new file.
  • curl https://app-versions.conduction.nl/robots.txt names at least one AI bot.

@rubenvdlinde rubenvdlinde merged commit 535266e into development May 18, 2026
1 of 10 checks passed
@rubenvdlinde rubenvdlinde deleted the feat/docs-ai-baseline branch May 18, 2026 18:04
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant