Skip to content

[Bugfix] Adjust inputbatch to be compatible with latest vllm #945

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
May 26, 2025

Conversation

MengqingCao
Copy link
Collaborator

Adjust inputbatch to be compatible with latest vllm, as kvcache group feature has been redo in vllm-project/vllm#18593

Signed-off-by: MengqingCao <[email protected]>
@wangxiyuan
Copy link
Collaborator

quick merge to unblock CI

@wangxiyuan wangxiyuan merged commit a0c3e9b into vllm-project:main May 26, 2025
15 checks passed
wangxiyuan pushed a commit that referenced this pull request May 29, 2025
### What this PR does / why we need it?
Fix deepseek with v1, this error is introdeced by
#945. and this pr fix
the block table of mla

### How was this patch tested?
CI passed with new addedtest.

Signed-off-by: Mengqing Cao <[email protected]>
@MengqingCao MengqingCao deleted the kvgroup branch May 30, 2025 02:54
momo609 pushed a commit to momo609/vllm-ascend that referenced this pull request May 30, 2025
…oject#945)

Adjust inputbatch to be compatible with latest vllm, as kvcache group
feature has been redo in vllm-project/vllm#18593

---------

Signed-off-by: MengqingCao <[email protected]>
Signed-off-by: wangxiaoxin (A) <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants