Skip to content

Serialize weights pointer to xml #31178

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 21 commits into
base: master
Choose a base branch
from

Conversation

XinWangIntel
Copy link
Contributor

@XinWangIntel XinWangIntel commented Jul 2, 2025

enabling serialization of weights directly into XML files

Update serialize pass to accpet a stringstream and serialize pointer of weights (std::shared_ptr * of AlignedBuffer, StringAlignedBuffer, SharedAlignedBuffer) to xml file and use "ptr" "type" as key in xml.

In IR frontEnd will check the "ptr" and "type", then cast ptr the weights buffer and set to node.

@github-actions github-actions bot added category: Core OpenVINO Core (aka ngraph) category: transformations OpenVINO Runtime library - Transformations category: IR FE OpenVINO IR v10 / v11 FrontEnd category: CPP API OpenVINO CPP API bindings category: NPU OpenVINO NPU plugin labels Jul 2, 2025
@XinWangIntel XinWangIntel force-pushed the serialize-with-weights-shared branch 2 times, most recently from 483f70f to 4a4450a Compare July 15, 2025 07:08
@XinWangIntel XinWangIntel changed the title Serialize with weights shared Serialize weights pointer to xml Jul 17, 2025
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
…gnedBuffer

* They are not exposed by OV API, wait for OV to open them

Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>
Signed-off-by: Xin Wang <[email protected]>

Signed-off-by: Xin Wang <[email protected]>
@XinWangIntel XinWangIntel force-pushed the serialize-with-weights-shared branch from 38082e6 to 88f05d4 Compare July 28, 2025 09:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: Core OpenVINO Core (aka ngraph) category: CPP API OpenVINO CPP API bindings category: IR FE OpenVINO IR v10 / v11 FrontEnd category: NPU OpenVINO NPU plugin category: transformations OpenVINO Runtime library - Transformations
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant