feat: generate 100k tokens llms.txt #1042
Closed
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description(required)
summary
implemented a spec-compliant llms.txt generator. This implementation was inspired by vercel/ai's implementation and adapted for our documentation structure.
changes
scripts/generate-llms.mjs
generate:llms
script topackage.json
public/llms.txt
to follow the standard web path specificationnotes
to stay under a ~100k token limit, some docs have to be omitted. it's not clear how this decision should be made. to start, i've omitted the directories
['pt-br', 'guides', 'solid-router', 'solid-meta', 'configuration']
.Related issues & labels