Skip to content

Extend e2e tests to add asym support for W8A8-Int8 #1344

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
dsikka opened this issue Apr 10, 2025 · 0 comments · May be fixed by #1345
Open

Extend e2e tests to add asym support for W8A8-Int8 #1344

dsikka opened this issue Apr 10, 2025 · 0 comments · May be fixed by #1345
Labels
enhancement New feature or request good first issue A good first issue for users wanting to contribute

Comments

@dsikka
Copy link
Collaborator

dsikka commented Apr 10, 2025

Summary

  • Extend the e2e test to add configs which cover recipes with W8A8-int8 asymmetric activations
  • This would include one case for dynamic activations and one case for static activations
  • The configs should run along with the other existing e2e configs on a nightly cadence, uploaded, and verified in vLLM
@dsikka dsikka added enhancement New feature or request good first issue A good first issue for users wanting to contribute labels Apr 10, 2025
@ved1beta ved1beta linked a pull request Apr 11, 2025 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request good first issue A good first issue for users wanting to contribute
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix #1344 Extend e2e tests to add asym support for W8A8-Int8 ved1beta/llm-compressor
1 participant
@dsikka