-
Notifications
You must be signed in to change notification settings - Fork 206
Pull requests: openvinotoolkit/openvino.genai
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
CB: remove GenerationHandle:back
category: continuous batching
Continuous batching
category: GenAI C++ API
Changes in GenAI C++ public headers
category: LLM
LLM pipeline (stateful, static)
category: Python API
Python API for GenAI
category: whisper
Whisper pipeline
[GHA] Samples tests refactoring
category: cmake / build
Cmake scripts
category: GHA
CI based on Github actions
no-match-files
Fix tiny-random-llava-next in VLM Pipeline
bug
Something isn't working
category: visual language
Visual language pipeline
Fix Tokenizer for several added special tokens
bug
Something isn't working
category: tokenizers
Tokenizer class or submodule update
no-match-files
Move chat history updates to general function and fix last generated token logic for streaming cases
category: LLM
LLM pipeline (stateful, static)
category: visual language
Visual language pipeline
no-match-files
Update for LoRA Adapters: Derived adapters and support for FLUX (#1602) (master)
category: continuous batching
Continuous batching
category: GenAI C++ API
Changes in GenAI C++ public headers
category: LLM
LLM pipeline (stateful, static)
category: LoRA
Low rank adapters
category: samples
GenAI samples
category: text to image
Text 2 image pipeline
no-match-files
Whisper pipeline: use parallel streamer
category: Python API
Python API for GenAI
category: whisper
Whisper pipeline
do_not_merge
do_not_review
no-match-files
[LLM] [NPU] StaticLLMPipeline: support weightless caching
category: LLM
LLM pipeline (stateful, static)
category: NPU
LLM: release plugin once pipeline is removed
category: continuous batching
Continuous batching
category: GenAI C++ API
Changes in GenAI C++ public headers
category: LLM
LLM pipeline (stateful, static)
no-match-files
[VLM] Set stop token ids from default generation config in VLM pipeline
category: continuous batching
Continuous batching
category: LLM
LLM pipeline (stateful, static)
category: visual language
Visual language pipeline
no-match-files
[WA] Add API to release memory by unload plugin
category: GenAI C++ API
Changes in GenAI C++ public headers
category: LLM
LLM pipeline (stateful, static)
do_not_merge
no-match-files
#1600
opened Jan 20, 2025 by
sammysun0711
•
Draft
Update to the latest tokenizers with StringPack/Unpack from opset
category: tokenizers
Tokenizer class or submodule update
Pass pad_token_id as model compilation parameters
category: LLM
LLM pipeline (stateful, static)
category: NPU
#1556
opened Jan 15, 2025 by
AsyaPronina
Loading…
Cb by default int8 respect ir
category: continuous batching
Continuous batching
category: LLM
LLM pipeline (stateful, static)
do_not_merge
Debug qwen
category: LLM
LLM pipeline (stateful, static)
category: NPU
category: samples
GenAI samples
do_not_review
#1537
opened Jan 13, 2025 by
AsyaPronina
•
Draft
[Tokenizers] add max_lengh parametrisation to encode
category: GenAI C++ API
Changes in GenAI C++ public headers
category: Python API
Python API for GenAI
category: tokenizers
Tokenizer class or submodule update
enhancement
New feature or request
no-match-files
Add MSVC Support For UTF-8 in Chat Sample
category: samples
GenAI samples
#1483
opened Jan 6, 2025 by
sammysun0711
Loading…
Add a choice of how to end streaming from callback: STOP or CANCEL
category: continuous batching
Continuous batching
category: GenAI C++ API
Changes in GenAI C++ public headers
category: LLM
LLM pipeline (stateful, static)
category: prompt lookup
category: Python API
Python API for GenAI
category: samples
GenAI samples
category: speculative decoding
Speculative decoding
category: visual language
Visual language pipeline
category: whisper
Whisper pipeline
no-match-files
Concurrency in stable-diffusion image generation
category: cmake / build
Cmake scripts
category: GenAI C++ API
Changes in GenAI C++ public headers
category: samples
GenAI samples
category: text to image
Text 2 image pipeline
no-match-files
Add code quality checks to GitHub Actions
category: cmake / build
Cmake scripts
category: continuous batching
Continuous batching
category: GenAI C++ API
Changes in GenAI C++ public headers
category: GHA
CI based on Github actions
category: llm_bench
Label for tool/llm_bench folder
category: LLM
LLM pipeline (stateful, static)
category: LoRA
Low rank adapters
category: prompt lookup
category: Python API
Python API for GenAI
category: samples
GenAI samples
category: sampling
Sampling / Decoding algorithms
category: speculative decoding
Speculative decoding
category: text to image
Text 2 image pipeline
category: tokenizers
Tokenizer class or submodule update
category: visual language
Visual language pipeline
category: whisper
Whisper pipeline
no-match-files
Previous Next
ProTip!
What’s not been updated in a month: updated:<2025-01-01.