Skip to content

[DO NOT REVIEW][TMP] attention sink #31858

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 37 commits into
base: master
Choose a base branch
from
Open

[DO NOT REVIEW][TMP] attention sink #31858

wants to merge 37 commits into from
+1,135 −503

Conversation

yeonbok
Copy link
Contributor

@yeonbok yeonbok commented Aug 23, 2025

Details:

  • item1
  • ...

Tickets:

  • ticket-id

yeonbok and others added 30 commits August 22, 2025 17:08
@yeonbok
trial
ef8ed9e
@yeonbok
onednn
6e43b7a
@yeonbok
fix transpose
9c6a87e
@yeonbok
force matmul test to generate same data for each batch
ef1e7cf
@yeonbok
remove debug print
34c5636
@yeonbok
onednn fix
a88fb6c 
tmp
@yeonbok
try to fix igpu...but not working yet
dbf67c7
@yeonbok
Revert "try to fix igpu...but not working yet"
b10949d 
This reverts commit 637bedf.
@yeonbok
cleanup
c6f8141
@yeonbok
Revert "force matmul test to generate same data for each batch"
69fd01f 
This reverts commit 650cc3f.
@yeonbok
minor
4b87ee7
@yeonbok
wip fix test
609125b
@yeonbok
temporal revert of func test
065ea37
@yeonbok
revert unexpected change
51a7777
@yeonbok
Fix lint error
2166fac
@yeonbok
fix lint error
688a200
@yeonbok
Fix case of
08d48cc 
3d weight => Reshape(2d) => Multiply scale
@yeonbok
lint error
ef7d3a1
@yeonbok
Fix 3D FC with reshaped weight from 4D
7c8d18e
@yeonbok
Fix for static shape with legacy shape
cb2de0e 
fix [1, K, N] case
@yeonbok
fix assertion comment
66b6d28
@yeonbok
clang format
4488618
@yeonbok
Apply review comments
68b2b38
@yeonbok
Fixed transform to use pattern matcher to detect compressed weight
b6b2377
@yeonbok
add transform unittest
ac4fec4
@yeonbok
Added func test
da638b2
@yeonbok
Fix unittest failure
5884b66
@mitruska @yeonbok
SDPA S in init
7d0dd90
@mitruska @yeonbok
Type prop test
79c45d0
@CuriousPanCake @yeonbok
first version
2b98ca1
@yeonbok
sdpa with sink
937fb11 
Use sdpa_micro

sdpa micro

refactor
@yeonbok yeonbok requested review from a team as code owners August 23, 2025 03:47
@yeonbok yeonbok requested review from CuriousPanCake and removed request for a team August 23, 2025 03:47
@github-actions github-actions bot added category: Core OpenVINO Core (aka ngraph) category: GPU OpenVINO GPU plugin category: transformations OpenVINO Runtime library - Transformations category: CPP API OpenVINO CPP API bindings labels Aug 23, 2025
@yeonbok yeonbok added do_not_review do_not_merge and removed category: Core OpenVINO Core (aka ngraph) category: GPU OpenVINO GPU plugin category: transformations OpenVINO Runtime library - Transformations category: CPP API OpenVINO CPP API bindings labels Aug 23, 2025
@yeonbok yeonbok changed the title [DO NOT REVIEW] attention sink [DO NOT REVIEW][TMP] attention sink Aug 23, 2025
@github-actions github-actions bot added category: Core OpenVINO Core (aka ngraph) category: GPU OpenVINO GPU plugin category: transformations OpenVINO Runtime library - Transformations category: CPP API OpenVINO CPP API bindings labels Aug 23, 2025
@yeonbok yeonbok requested a review from a team as a code owner August 23, 2025 09:29
@github-actions github-actions bot added the category: dependency_changes Pull requests that update a dependency file label Aug 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@CuriousPanCake CuriousPanCake Awaiting requested review from CuriousPanCake CuriousPanCake is a code owner automatically assigned from openvinotoolkit/openvino-ie-transformations-maintainers

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
category: Core OpenVINO Core (aka ngraph) category: CPP API OpenVINO CPP API bindings category: dependency_changes Pull requests that update a dependency file category: GPU OpenVINO GPU plugin category: transformations OpenVINO Runtime library - Transformations do_not_merge do_not_review
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@yeonbok @mitruska @CuriousPanCake