Skip to content

Pull requests: openvinotoolkit/openvino.genai

New pull request New
34 Open 1,108 Closed
34 Open 1,108 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Text2Image Readme update: decode method usage category: samples GenAI samples category: text to image Text 2 image pipeline
#1237 opened Nov 20, 2024 by likholat Loading…
1
Parallel sampling category: continuous batching Continuous batching category: sampling Sampling / Decoding algorithms no-match-files
#1233 opened Nov 19, 2024 by mzegla • Draft
2
Install deployment and export requirements.txt bug Something isn't working category: cmake / build Cmake scripts category: samples GenAI samples
#1231 opened Nov 19, 2024 by Wovchena Loading… 2024.5.1
@ilya-lavrenov
Add LongBench validation category: continuous batching Continuous batching
#1220 opened Nov 18, 2024 by l-bat • Draft
Add multiple EOS support category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) category: Python API Python API for GenAI category: sampling Sampling / Decoding algorithms
#1219 opened Nov 18, 2024 by Wovchena Loading… 2024.5.1
@ilya-lavrenov
1
Move beam search in case of chat scenario to sampler.cpp category: continuous batching Continuous batching category: LLM LLM pipeline (stateful, static) category: sampling Sampling / Decoding algorithms category: visual language Visual language pipeline
#1215 opened Nov 14, 2024 by sbalandi Loading… 2025.0
@ilya-lavrenov @Wovchena
27
Added chat template to CLI. category: WWB PR changes WWB
#1208 opened Nov 13, 2024 by andreyanufr • Draft
[CPU] Change kvcache default type of PagedAttention to u8 for CPU plugin category: continuous batching Continuous batching category: GHA CI based on Github actions
#1206 opened Nov 13, 2024 by luo-cheng2021 • Draft 2025.0
3
Test master logits category: LLM LLM pipeline (stateful, static) category: samples GenAI samples category: sampling Sampling / Decoding algorithms do_not_merge do_not_review
#1201 opened Nov 12, 2024 by Wovchena • Draft
StaticLLMPipeline: Optimize kvcache copy category: LLM LLM pipeline (stateful, static) category: NPU
#1199 opened Nov 12, 2024 by yviansu Loading…
2
[JS] Add GenAI Node.js bindings category: cmake / build Cmake scripts category: samples GenAI samples category: tokenizers Tokenizer class or submodule update do_not_merge no-match-files
#1193 opened Nov 11, 2024 by vishniakov-nikolai • Draft
3 tasks
ONNX <= 1.17.0
#1183 opened Nov 11, 2024 by ilya-lavrenov Loading… 2025.0
@Wovchena
Added basic git based code checks #663 category: GHA CI based on Github actions
#1181 opened Nov 9, 2024 by rishik-ashili Loading…
2
Fixed passing of generation config params to VLM generate. bug Something isn't working category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) category: Python API Python API for GenAI category: sampling Sampling / Decoding algorithms category: text to image Text 2 image pipeline category: tokenizers Tokenizer class or submodule update category: visual language Visual language pipeline category: whisper Whisper pipeline no-match-files
#1180 opened Nov 8, 2024 by popovaan Loading… 2025.0
@ilya-lavrenov
35
Update Python VLM example in README no-match-files
#1178 opened Nov 8, 2024 by helena-intel Loading…
7
StaticLLMPipeline: Optimize V-tensors layout category: cmake / build Cmake scripts category: LLM LLM pipeline (stateful, static) category: NPU category: sampling Sampling / Decoding algorithms
#1177 opened Nov 8, 2024 by TolyaTalamanov • Queued 2024.5.1
@dmatveev
19
[Speculative decoding] Alignment Speculative decoding vs Continuous batching results with many requests category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding
#1171 opened Nov 7, 2024 by iefode Loading… 2025.0
@ilya-lavrenov
2
Preserve default config for LLM samples category: samples GenAI samples category: sampling Sampling / Decoding algorithms
#1152 opened Nov 6, 2024 by Wovchena Loading…
2
Add GPU FP16 overflow fix category: WWB PR changes WWB do_not_merge
#1120 opened Nov 1, 2024 by AlexKoff88 • Draft
@ilya-lavrenov
4
Verify chatglm3 6b category: GHA CI based on Github actions category: sampling Sampling / Decoding algorithms category: tokenizers Tokenizer class or submodule update
#1119 opened Oct 31, 2024 by Aniruddha521 Loading…
1
20
StaticLLMPipeline: Enable chat test
#1117 opened Oct 31, 2024 by TolyaTalamanov Loading… 2025.0
@Wovchena
6
StaticLLMPipeline: Use set_tensor for kvcache model category: LLM LLM pipeline (stateful, static)
#1106 opened Oct 30, 2024 by TolyaTalamanov • Draft
@dmatveev
4
Corrected performance data when batch size is greater than 1 category: sampling Sampling / Decoding algorithms do_not_merge
#1100 opened Oct 29, 2024 by wgzintel • Draft
@pavel-esir @Wovchena
6
[CB] Speculative decoding benchmarking category: LLM LLM pipeline (stateful, static) category: samples GenAI samples category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding
#1037 opened Oct 21, 2024 by iefode • Draft
Grouped source files in GenAI src folder category: cmake / build Cmake scripts category: continuous batching Continuous batching category: GHA CI based on Github actions category: Python API Python API for GenAI category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding category: text to image Text 2 image pipeline category: visual language Visual language pipeline category: whisper Whisper pipeline
#1016 opened Oct 18, 2024 by ilya-lavrenov Loading…
@Wovchena
6
ProTip! no:milestone will show everything without a milestone.