Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dec 10 rebase #605

Merged
merged 52 commits into from
Dec 11, 2024
Merged

Dec 10 rebase #605

merged 52 commits into from
Dec 11, 2024

Conversation

kzawora-intel
Copy link

it's that time of the week again

mgoin and others added 30 commits December 6, 2024 08:34
@mgoin
[Core] Support Lark grammars for XGrammar (vllm-project#10870)
8b59631 
Signed-off-by: mgoin <[email protected]>
@samos123
[Doc] add KubeAI to serving integrations (vllm-project#10837)
7406274 
Signed-off-by: Sam Stoelinga <[email protected]>
@youkaichao
[misc] fix typo (vllm-project#10960)
c05cfb6 
Signed-off-by: youkaichao <[email protected]>
@youkaichao
[ci] fix broken tests (vllm-project#10956)
dcdc3fa 
Signed-off-by: youkaichao <[email protected]>
@russellb
[Core] Cleanup startup logging a bit (vllm-project#10961)
69d357b 
Signed-off-by: Russell Bryant <[email protected]>
@jeejeelee
[Bugfix] Fix test-pipeline.yaml (vllm-project#10973)
acf092d 
Signed-off-by: Jee Jee Li <[email protected]>
@DarkLight1337 @ywang96
[3/N] Support and implement merged input processor for LLaVA model (v…
955fa95 
…llm-project#10676)

Signed-off-by: DarkLight1337 <[email protected]>
Co-authored-by: Roger Wang <[email protected]>
@gshtras
[Build] Fix for the Wswitch-bool clang warning (vllm-project#10060)
f13cf9a 
Signed-off-by: Gregory Shtrasberg <[email protected]>
@Isotr0py
[Misc][LoRA] Refactor and clean MergedQKVParallelLinearWithLora imple…
b26b4cd 
…mentation (vllm-project#10958)

Signed-off-by: Isotr0py <[email protected]>
@DarkLight1337
[Model] Composite weight loading for multimodal Qwen2 (vllm-project#1…
bf0e382 
…0944)

Signed-off-by: DarkLight1337 <[email protected]>
@DarkLight1337
[Doc] Explicitly state that InternVL 2.5 is supported (vllm-project#1…
1c768fe 
…0978)

Signed-off-by: DarkLight1337 <[email protected]>
@DarkLight1337
[Model] Update multi-modal processor to support Mantis(LLaVA) model (v…
39e227c 
…llm-project#10711)

Signed-off-by: DarkLight1337 <[email protected]>
@DarkLight1337
[Doc] Explicitly state that PP isn't compatible with speculative deco…
c889d58 
…ding yet (vllm-project#10975)

Signed-off-by: DarkLight1337 <[email protected]>
@xffxff
[BugFix][Kernel]: fix illegal memory access in causal_conv1d when con…
78029b3 
…v_states is None (vllm-project#10928)

Signed-off-by: xffxff <[email protected]>
@youkaichao
[core][executor] simplify instance id (vllm-project#10976)
1b62745 
Signed-off-by: youkaichao <[email protected]>
@youkaichao
[core][misc] remove use_dummy driver for _run_workers (vllm-project#1…
7be15d9 
…0920)

Signed-off-by: youkaichao <[email protected]>
@youkaichao
[torch.compile] allow candidate compile sizes (vllm-project#10984)
fd57d2b 
Signed-off-by: youkaichao <[email protected]>
@ywang96
[V1] Initial support of multimodal models for V1 re-arch (vllm-projec…
a11f326 
…t#10699)

Signed-off-by: Roger Wang <[email protected]>
@youkaichao
[torch.compile][misc] fix comments (vllm-project#10993)
43b05fa 
Signed-off-by: youkaichao <[email protected]>
@youkaichao
[misc] clean up and unify logging (vllm-project#10999)
46004e8 
Signed-off-by: youkaichao <[email protected]>
@ywang96
[Doc][V1] Add V1 support column for multimodal models (vllm-project#1…
af7c4a9 
…0998)

Signed-off-by: Roger Wang <[email protected]>
@youkaichao
[torch.compile] add dynamo time tracking (vllm-project#11005)
d1c2e15 
Signed-off-by: youkaichao <[email protected]>
@ywang96
[V1] Fix Detokenizer loading in AsyncLLM (vllm-project#10997)
c690357 
Signed-off-by: Roger Wang <[email protected]>
@russellb
[Core] Require xgrammar >= 0.1.6 (vllm-project#11021)
e691b26 
Signed-off-by: Russell Bryant <[email protected]>
@wangxiyuan
[Platform] Move async output check to platform (vllm-project#10768)
aea2fc3 
Signed-off-by: wangxiyuan <[email protected]>
@varun-sundar-rabindranath
[V1] Input Batch Relocation (vllm-project#10962)
25b79d9 
Signed-off-by: Varun Sundar Rabindranath <[email protected]>
Co-authored-by: Varun Sundar Rabindranath <[email protected]>
@khluu
[ci/build] Recompile CI dependencies list with Python 3.12 (vllm-proj…
edc4fa3 
…ect#11013)

Signed-off-by: kevin <[email protected]>
@WoosukKwon
[V1] Further reduce CPU overheads in flash-attn (vllm-project#10989)
3b61cb4 
Signed-off-by: Woosuk Kwon <[email protected]>
@jeejeelee
[Misc][LoRA] Abstract PunicaWrapper (vllm-project#10955)
ca87149 
Signed-off-by: Jee Jee Li <[email protected]>
@Isotr0py @DarkLight1337
[Model] merged input processor for Phi-3-Vision models (vllm-project#…
a811dd6 
…10977)

Signed-off-by: Isotr0py <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
xendo and others added 18 commits December 9, 2024 13:53
@xendo
[Neuron] Upgrade neuron to 2.20.2 (vllm-project#11016)
9c6459e 
Signed-off-by: Jerzy Zagorski <[email protected]>
Co-authored-by: Jerzy Zagorski <[email protected]>
@gshtras
[ROCm][bugfix] scpecilative decoding worker class (vllm-project#11035)
b63ba84 
Signed-off-by: Gregory Shtrasberg <[email protected]>
@richardsliu @khluu
Build tpu image in release pipeline (vllm-project#10936)
5ed5d5f 
Signed-off-by: Richard Liu <[email protected]>
Co-authored-by: Kevin H. Luu <[email protected]>
@WoosukKwon
[V1] Do not store None in self.generators (vllm-project#11038)
6faec54 
Signed-off-by: Woosuk Kwon <[email protected]>
@mgoin @tlrmchlsmth
[Docs] Add dedicated tool calling page to docs (vllm-project#10554)
6d52528 
Signed-off-by: mgoin <[email protected]>
Co-authored-by: Tyler Michael Smith <[email protected]>
@Isotr0py
[Model] Add has_weight to RMSNorm and re-enable weights loading track…
d1f6d1c 
…er for Mamba (vllm-project#10739)

Signed-off-by: Isotr0py <[email protected]>
@DarkLight1337
[Bugfix] Fix usage of deprecated decorator (vllm-project#11025)
391d7b2 
Signed-off-by: DarkLight1337 <[email protected]>
@joerunde
[Frontend] Use request id from header (vllm-project#10968)
980ad39 
Signed-off-by: Joe Runde <[email protected]>
@patrickvonplaten
[Pixtral] Improve loading (vllm-project#11040)
bc192a2
@tlrmchlsmth
[V1] Multiprocessing Tensor Parallel Support for v1 (vllm-project#9856)
28b3a1c 
Signed-off-by: Tyler Michael Smith <[email protected]>
@youkaichao
monitor metrics of tokens per step using cudagraph batchsizes (vllm-p…
ebf7780 
…roject#11031)

Signed-off-by: youkaichao <[email protected]>
@sjuxax
[Bugfix] Fix xgrammar failing to read a vocab_size from LlavaConfig o…
e35879c 
…n PixtralHF. (vllm-project#11043)
@dmoliveira
Update README.md (vllm-project#11034)
bfd6104
@GeneDer
[Bugfix] cuda error running llama 3.2 (vllm-project#11047)
82c73fd
@mfournioux
Add example of helm chart for vllm deployment on k8s (vllm-project#9199)
fe2e10c 
Signed-off-by: Maxime Fournioux <[email protected]>
@kzawora-intel
Merge remote-tracking branch 'upstream/main' into HEAD
2126fd2
@kzawora-intel
Merge remote-tracking branch 'origin/habana_main' into private/kzawor…
89266bc 
…a/dec_10_rebase
@michalkuligowski
Update ray_hpu_executor.py
5a166da
@kzawora-intel kzawora-intel mentioned this pull request Dec 10, 2024
Open
23 tasks
SanjuCSudhakaran and others added 2 commits December 11, 2024 08:38
@SanjuCSudhakaran
Add PunicaWrapperHPU to handle LoRA computations
b8fff21
@kzawora-intel
Align LoRA handling in HPU with PunicaWrapper class (#614)
381453c 
This PR adds `PunicaWrapperHPU` class to handle LoRA computations in
HPU. These changes are to align LoRA flow refactoring done in the
upstream branch.
@michalkuligowski michalkuligowski merged commit a9fde5f into habana_main Dec 11, 2024
11 checks passed
@michalkuligowski michalkuligowski deleted the private/kzawora/dec_10_rebase branch December 11, 2024 11:48
@michalkuligowski michalkuligowski mentioned this pull request Dec 11, 2024
Merged
@kzawora-intel kzawora-intel restored the private/kzawora/dec_10_rebase branch December 11, 2024 11:53
kzawora-intel added a commit that referenced this pull request Dec 11, 2024
@kzawora-intel
Revert "Dec 10 rebase" (#618)
55f99ea 
Reverts #605
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@michalkuligowski michalkuligowski michalkuligowski approved these changes

@madamczykhabana madamczykhabana Awaiting requested review from madamczykhabana madamczykhabana is a code owner

@mgawarkiewicz mgawarkiewicz Awaiting requested review from mgawarkiewicz mgawarkiewicz is a code owner

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.