Skip to content

Pull requests: openvinotoolkit/openvino.genai

New pull request New
31 Open 1,706 Closed
31 Open 1,706 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

NPU LLM: Add prefill hint (dynamic/static) no-match-files
#1867 opened Mar 7, 2025 by dmatveev Loading… 2025.1
@dmatveev
Update tests to check encoded inputs with chat category: LLM LLM pipeline (stateful, static)
#1866 opened Mar 7, 2025 by sbalandi • Draft 2025.1
@ilya-lavrenov @Wovchena
CB constructor from ModelsMap category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) category: visual language Visual language pipeline
#1863 opened Mar 7, 2025 by popovaan Loading… 2025.1
@ilya-lavrenov
Add averaged results dumping to llm_bench output json category: llm_bench Label for tool/llm_bench folder
#1862 opened Mar 7, 2025 by nikita-savelyevv Loading…
@eaidova
[do not merge] Rag components: add TextEmbeddingPipeline, TextRerankPipeline interfaces category: cmake / build Cmake scripts category: GenAI C++ API Changes in GenAI C++ public headers category: samples GenAI samples do_not_merge do_not_review no-match-files
#1861 opened Mar 7, 2025 by as-suvorov • Draft
Prevent changing input image data for VLM bug Something isn't working category: visual language Visual language pipeline
#1856 opened Mar 6, 2025 by sbalandi Loading… 2025.1
@ilya-lavrenov @Wovchena
5
Add remove adapters for LLMpipeline category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) category: LoRA Low rank adapters category: prompt lookup category: speculative decoding Speculative decoding no-match-files
#1852 opened Mar 6, 2025 by wenyi5608 Loading…
@slyalin
15
Add --static_reshape option to llm_bench, to force static reshape + compilation at pipeline creation category: llm_bench Label for tool/llm_bench folder
#1851 opened Mar 6, 2025 by RyanMetcalfeInt8 Loading… 2025.1
@eaidova @sbalandi
2
LLM: release plugin once pipeline is removed and WA for GPU category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) category: tokenizers Tokenizer class or submodule update do_not_merge no-match-files
#1846 opened Mar 5, 2025 by p-durandin Loading…
[Docs] Add supported models & introduction pages no-match-files
#1839 opened Mar 4, 2025 by yatarkan Loading…
4
Use circular buffer of infer requests in VLM components category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) category: Python API Python API for GenAI category: visual language Visual language pipeline no-match-files
#1833 opened Mar 3, 2025 by mzegla Loading… 2025.1
@ilya-lavrenov @Wovchena
19
Fix end-of-file and trailing whitespace issues category: cmake / build Cmake scripts category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: GHA CI based on Github actions category: llm_bench Label for tool/llm_bench folder category: LLM LLM pipeline (stateful, static) category: LoRA Low rank adapters category: prompt lookup category: Python API Python API for GenAI category: samples GenAI samples category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding category: text to image Text 2 image pipeline category: tokenizers Tokenizer class or submodule update category: visual language Visual language pipeline category: whisper Whisper pipeline category: WWB PR changes WWB no-match-files
#1832 opened Mar 3, 2025 by thesakshidiggikar Loading…
1
5
[do not merge] Print genai metrics in llm_bench category: llm_bench Label for tool/llm_bench folder category: whisper Whisper pipeline do_not_merge do_not_review
#1815 opened Feb 27, 2025 by as-suvorov Loading…
Alias CLIPTextModelWithProjection as CLIPTextModel category: GenAI C++ API Changes in GenAI C++ public headers category: text to image Text 2 image pipeline
#1809 opened Feb 26, 2025 by ilya-lavrenov Loading… 2025.1
@likholat
[DO NOT MERGE] Base master state for cache eviction comparisons category: continuous batching Continuous batching do_not_merge do_not_review
#1805 opened Feb 25, 2025 by vshampor Loading…
[GHA] replaced cpp-Phi-1_5 category: GHA CI based on Github actions no-match-files
#1798 opened Feb 24, 2025 by mryzhov Loading… 2025.1
@Wovchena
3
Switch workflows to aks-linux-mediumworker category: GHA CI based on Github actions
#1796 opened Feb 24, 2025 by ababushk Loading…
1
Using genai nodejs bindings compilation for manylinux category: GHA CI based on Github actions
#1779 opened Feb 21, 2025 by Retribution98 • Draft
IMAGE GENERATION: reuse padding to max_length feature in text encoders category: GenAI C++ API Changes in GenAI C++ public headers category: samples GenAI samples category: text to image Text 2 image pipeline category: tokenizers Tokenizer class or submodule update no-match-files
#1774 opened Feb 20, 2025 by ilya-lavrenov • Draft 2025.1
@pavel-esir @Wovchena @likholat
[do not merge]Test key cache by_channel quantization category: continuous batching Continuous batching category: GHA CI based on Github actions do_not_merge do_not_review
#1753 opened Feb 18, 2025 by zhangYiIntel Loading…
[DO NOT MERGE] Threaded streamer: debug win build category: cmake / build Cmake scripts category: GHA CI based on Github actions do_not_merge do_not_review no-match-files
#1743 opened Feb 14, 2025 by as-suvorov Loading…
2
Refactoring tests category: continuous batching Continuous batching category: LLM LLM pipeline (stateful, static) category: sampling Sampling / Decoding algorithms category: tokenizers Tokenizer class or submodule update category: visual language Visual language pipeline no-match-files
#1688 opened Feb 7, 2025 by iefode • Draft
[DO NOT MERGE] Hardcode enable cache eviction without rotation category: continuous batching Continuous batching do_not_merge do_not_review
#1672 opened Feb 4, 2025 by vshampor Loading…
LLM: release plugin once pipeline is removed category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) category: tokenizers Tokenizer class or submodule update no-match-files
#1627 opened Jan 24, 2025 by ilya-lavrenov • Draft 2025.1
@Wovchena @sammysun0711
[WA] Add API to release memory by unload plugin category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) do_not_merge no-match-files
#1600 opened Jan 20, 2025 by sammysun0711 • Draft
@ilya-lavrenov
2
ProTip! What’s not been updated in a month: updated:<2025-02-08.