Skip to content

[Core][Ref] PagedAttention reference implementation #28815

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
PiotrKrzem wants to merge 211 commits into
base: master
Choose a base branch
from
Open

[Core][Ref] PagedAttention reference implementation #28815

PiotrKrzem wants to merge 211 commits into from
+1,958 −46

Conversation

@PiotrKrzem
Copy link
Contributor

@PiotrKrzem PiotrKrzem commented Feb 4, 2025 •
edited
Loading

Details:

  • Add PagedAttention reference implementation
  • Add testing suite

Tickets:

  • 158135

@github-actions github-actions bot added category: Core OpenVINO Core (aka ngraph) category: IE Tests OpenVINO Test: plugins and common category: TEMPLATE OpenVINO Template plugin category: CPP API OpenVINO CPP API bindings labels Feb 4, 2025
@vshampor
Copy link
Contributor

vshampor commented Feb 20, 2025

You should also be adding the cache rotation-related functionality here since it's part of the op and has both CPU and GPU implementations now.

@github-actions github-actions bot added category: CPU OpenVINO CPU plugin category: transformations OpenVINO Runtime library - Transformations category: NPU OpenVINO NPU plugin category: NPUW NPUW plugin labels Feb 27, 2025
@github-actions github-actions bot removed category: CPU OpenVINO CPU plugin category: transformations OpenVINO Runtime library - Transformations category: NPU OpenVINO NPU plugin category: NPUW NPUW plugin labels Feb 28, 2025
@mlukasze mlukasze requested a review from vshampor February 28, 2025 05:56
@PiotrKrzem PiotrKrzem marked this pull request as ready for review February 28, 2025 06:44
@PiotrKrzem PiotrKrzem requested review from a team as code owners February 28, 2025 06:44
@PiotrKrzem PiotrKrzem reopened this Jan 15, 2026
@openvinotoolkit openvinotoolkit deleted a comment from github-actions bot Jan 15, 2026
@openvinotoolkit openvinotoolkit deleted a comment from github-actions bot Jan 15, 2026
@github-actions github-actions bot removed the Stale label Jan 16, 2026
@PiotrKrzem PiotrKrzem requested review from a team as code owners January 20, 2026 01:08
@github-actions github-actions bot added the category: NPU OpenVINO NPU plugin label Jan 20, 2026
@github-actions github-actions bot removed the category: NPU OpenVINO NPU plugin label Jan 28, 2026
@github-actions github-actions bot added the category: IE Tests OpenVINO Test: plugins and common label Feb 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mitruska mitruska mitruska left review comments

@praasz praasz praasz requested changes

@t-jankowski t-jankowski t-jankowski approved these changes

@vshampor vshampor Awaiting requested review from vshampor

@mmikolajcz mmikolajcz Awaiting requested review from mmikolajcz

@zhangYiIntel zhangYiIntel Awaiting requested review from zhangYiIntel

@luo-cheng2021 luo-cheng2021 Awaiting requested review from luo-cheng2021

@CuriousPanCake CuriousPanCake Awaiting requested review from CuriousPanCake

+1 more reviewer

@itikhono itikhono itikhono left review comments

Reviewers whose approvals may not affect merge requirements

Requested changes must be addressed to merge this pull request.

Assignees

@luo-cheng2021 luo-cheng2021

@CuriousPanCake CuriousPanCake

Labels

category: Core OpenVINO Core (aka ngraph) category: CPU OpenVINO CPU plugin category: IE Tests OpenVINO Test: plugins and common category: TEMPLATE OpenVINO Template plugin category: transformations OpenVINO Runtime library - Transformations

Projects

None yet

Milestone

2025.4

Development

Successfully merging this pull request may close these issues.