-
Notifications
You must be signed in to change notification settings - Fork 1.5k
GGUF file format specification #302
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
+623
−0
Merged
Changes from 1 commit
Commits
Show all changes
29 commits
Select commit
Hold shift + click to select a range
d2fbcb2
docs: gguf spec first pass
philpax 23eda2e
docs(gguf): update with review comments
philpax b303293
docs(gguf): update with review comments
philpax 2bcd348
docs(gguf): quant version optional for unquant
philpax 576e306
docs(gguf): normalize naming, add whisper
philpax 44af6b8
Merge branch 'master' of https://github.com/ggerganov/ggml into gguf-…
philpax 24260bf
docs(gguf): more review updates
philpax 0133f2e
docs(gguf): add norm eps and added_tokens
philpax e9988f7
docs(gguf): move padding
philpax f4c4d6a
docs(gguf): remove migration tool
philpax 39da254
docs(gguf): make offset base explicit
philpax a6d1cc1
docs(gguf): fix replace oops
philpax 1d134ec
docs(gguf): alignment metadata+tensor name len max
philpax 2a90bbf
docs(gguf): clarification, fixes, tensor names
philpax 3d4507e
docs(gguf): clarify license
philpax 39d6377
docs(gguf): minor tweaks
philpax e36b4ca
docs(gguf): data layout, GQA eq, no ft, LE GGUF
philpax d5cfb55
docs(gguf): fix magic order
philpax aa8d0ba
docs(gguf): match impl
philpax f3e7632
docs(gguf): specify fallback alignment
philpax 2fe03e5
docs(gguf): remove TensorInfo::n_elements
philpax 2b65fba
docs(gguf): filetype, rope base/linear scale
philpax b021b25
docs(gguf): v2 - uint64 all the things
philpax 2da80c1
docs(gguf): tweak extensibility wording
philpax 574b408
docs(gguf): fix spec discrepancies
philpax 4ea9317
Merge branch 'master' into gguf-spec
philpax 78faa7b
docs(gguf): v3 + other fixes
philpax 0da010d
fix(editorconfig): use 2-space tabs for markdown
philpax ad95988
docs(gguf): clarify big-endian
philpax File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
docs(gguf): make offset base explicit
- Loading branch information
commit 39da254bc4ac0490a3c449e3308f338357ef64dd
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.