add openvino VLM blog post #3071
Open
+208
−0
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
echarlaix
commented
Sep 12, 2025
pcuenca
reviewed
Sep 16, 2025
Co-authored-by: Helena Kloosterman <[email protected]>
Co-authored-by: Pedro Cuenca <[email protected]>
Co-authored-by: Pedro Cuenca <[email protected]>
Co-authored-by: Pedro Cuenca <[email protected]>
echarlaix
commented
Sep 16, 2025
Co-authored-by: Pedro Cuenca <[email protected]>
Co-authored-by: Pedro Cuenca <[email protected]>
Co-authored-by: Pedro Cuenca <[email protected]>
Co-authored-by: Pedro Cuenca <[email protected]>
Co-authored-by: Pedro Cuenca <[email protected]>
Co-authored-by: Pedro Cuenca <[email protected]>
Co-authored-by: Pedro Cuenca <[email protected]>
* Blog updates * updates
|
Thanks a lot for the great review @pcuenca, didn't had time to include everything but will do in a second pass. The blog post is not ready for publication yet but once it is, I'll let you know |
echarlaix
commented
Sep 16, 2025
|
Thanks a lot for your reviews @pcuenca @merveenoyan! The blog post is not ready yet (was set to draft but I should have clarified it in the description). Likely a lot will change in the following days, so don't want you to waste your time on corrections that could very well not be included in the final blog post, will let you know once ready ! |
Co-authored-by: Nikita Savelyev <[email protected]>
echarlaix
commented
Oct 10, 2025
openvino-vlm.md
Outdated
| | openvino-8bit-woq| 0.247 | 0.016 | 0.482 | 63.928 | | ||
|
|
||
|
|
||
| This benchmark shows that small, optimized multimodal models, like [SmolVLM2-256M](https://huggingface.co/HuggingFaceTB/SmolVLM2-256M-Video-Instruct), can run efficiently on Intel CPUs. Weight-only quantization significantly reduces model size, improving efficiency without majorly impacting throughput. |
There was a problem hiding this comment.
cc @ezelanza would you mind updating once the benchmark is validated on your side
Co-authored-by: Nikita Savelyev <[email protected]>
ezelanza
reviewed
Oct 10, 2025
echarlaix
force-pushed
the
openvino-vlm
branch
from
acdc35e to
60aff81
Compare
ezelanza
reviewed
Oct 10, 2025
Co-authored-by: Eze Lanza (Eze) <[email protected]>
ezelanza
reviewed
Oct 10, 2025
Co-authored-by: Eze Lanza (Eze) <[email protected]>
ezelanza
reviewed
Oct 10, 2025
Co-authored-by: Eze Lanza (Eze) <[email protected]>
echarlaix
requested review from
IlyasMoutawwakil,
ezelanza,
merveenoyan and
pcuenca
echarlaix
commented
Oct 13, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
7 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
from https://huggingface.co/datasets/OpenVINO/documentation/blob/main/blog/openvino_vlm/openvino-vlm.md