Skip to content

Commit

Permalink
Remove static key from quantize cli (#1481)
Browse files Browse the repository at this point in the history
## Describe your changes

`static` quantization is not supported by cli now. Removing `static` key
from template. Otherwise, cli doc will have this option.

## Checklist before requesting a review
- [ ] Add unit tests for this change.
- [ ] Make sure all tests can pass.
- [ ] Update documents if necessary.
- [ ] Lint and apply fixes to your code by running `lintrunner -a`
- [ ] Is this a user-facing change? If yes, give a description of this
change to be included in the release notes.
- [ ] Is this PR including examples changes? If yes, please remember to
update [example
documentation](https://github.com/microsoft/Olive/blob/main/docs/source/examples.md)
in a follow-up PR.

## (Optional) Issue link
  • Loading branch information
xiaoyu-work authored Nov 12, 2024
1 parent ddf98d0 commit 3e44c97
Showing 1 changed file with 6 additions and 6 deletions.
12 changes: 6 additions & 6 deletions olive/cli/quantize.py
Original file line number Diff line number Diff line change
Expand Up @@ -235,12 +235,12 @@ def run(self):
"onnx_model_defaults": {"implementation": "matmul4", "precision": "int4"},
"description": "(OnnxModel) HQQ quantization using onnxruntime.",
},
"static": {
"implementations": ["onnx_static", "inc_static"],
"hf_model_defaults": {"implementation": None, "precision": None},
"onnx_model_defaults": {"implementation": "onnx_static", "precision": "int8"},
"description": "(OnnxModel) Static quantization using onnxruntime.",
},
# "static": {
# "implementations": ["onnx_static", "inc_static"],
# "hf_model_defaults": {"implementation": None, "precision": None},
# "onnx_model_defaults": {"implementation": "onnx_static", "precision": "int8"},
# "description": "(OnnxModel) Static quantization using onnxruntime.",
# },
"dynamic": {
"implementations": ["onnx_dynamic", "inc_dynamic"],
"hf_model_defaults": {"implementation": None, "precision": None},
Expand Down

0 comments on commit 3e44c97

Please sign in to comment.