Skip to content

Conditional visual token pruning for QWen-VL models. #3084

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

Conditional visual token pruning for QWen-VL models. #3084

wants to merge 2 commits into from
+4,569 −8

Conversation

@yangwang201911
Copy link
Contributor

@yangwang201911 yangwang201911 commented Nov 28, 2025 •
edited
Loading

This is a clean rebase of PR#2714 to simplify the review process.

  • Implement conditional visual token pruning for QWen-VL models.
    -- Paper: CDPruner (arXiv)
    -- Code: GitHub Repository
  • Add configurations to benchmark.py and WWB tools

Tickets: CVS-173220
Related PRs:

@github-actions github-actions bot added category: visual language Visual language pipeline category: continuous batching Continuous batching category: sampling Sampling / Decoding algorithms category: cmake / build Cmake scripts category: Python API Python API for GenAI category: CPP API Changes in GenAI C++ public headers no-match-files category: GGUF GGUF file reader labels Nov 28, 2025
@yangwang201911 yangwang201911 mentioned this pull request Nov 28, 2025
Closed
@yangwang201911
Add conditional visual token pruning (CDPruner) for QWen-VL models
bf3ea74 
- Implement CDPruner interface with FastDPP algorithm
- Add OpenCL acceleration for GPU processing
- Support multi-frame video pruning with chunking
- Add comprehensive performance optimizations
- Integrate with InputsEmbedder pipeline
- Add configuration parameters and error handling
- Include comprehensive testing and documentation
@yangwang201911 yangwang201911 force-pushed the ywang2/vlm-cdpruner-clean branch from 09ad8c9 to bf3ea74 Compare November 28, 2025 07:26
Copilot AI reviewed Nov 28, 2025
View reviewed changes
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot Copilot left review comments

@peterchen-intel peterchen-intel Awaiting requested review from peterchen-intel

@xipingyan xipingyan Awaiting requested review from xipingyan

@l-bat l-bat Awaiting requested review from l-bat

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

category: cmake / build Cmake scripts category: continuous batching Continuous batching category: CPP API Changes in GenAI C++ public headers category: GGUF GGUF file reader category: Python API Python API for GenAI category: sampling Sampling / Decoding algorithms category: visual language Visual language pipeline no-match-files

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@yangwang201911