Skip to content

quantize: update README.md #14905

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Jul 27, 2025
Merged

quantize: update README.md #14905

merged 3 commits into from
Jul 27, 2025
+113 −71

Conversation

EAddario
Copy link
Contributor

This PR updates llama-quantize README doc. It removes old information and adds current capabilities and examples

@EAddario EAddario changed the title Update README.md quantize: update README.md Jul 27, 2025
CISC
CISC approved these changes Jul 27, 2025
View reviewed changes
@EAddario @CISC
Update README.md
7a3fa08 
Co-authored-by: Sigbjørn Skjæret <[email protected]>
@CISC CISC merged commit 7f97599 into ggml-org:master Jul 27, 2025
2 checks passed
@EAddario
Copy link
Contributor Author

Thank you @CISC

@EAddario EAddario deleted the quantize branch July 27, 2025 21:33
@jacekpoplawski
Copy link
Contributor

jacekpoplawski commented Jul 28, 2025 •
edited
Loading

--include-weights use an importance matrix for tensor(s) in the list. Cannot be used with --exclude-weights
--exclude-weights use an importance matrix for tensor(s) in the list. Cannot be used with --include-weights

Isn't it a typo?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@CISC CISC CISC approved these changes

Assignees
No one assigned
Labels
examples
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@EAddario @jacekpoplawski @CISC