New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Kernel]Generalize Speculative decode from Cuda #10094

Closed

xuechendi wants to merge 10 commits into vllm-project:main from xuechendi:spec_decode_detach_hw

+228 −34

Closed

[Kernel]Generalize Speculative decode from Cuda #10094

Remove inflight DEVICE_TYPE in selector

DCO / DCO succeeded Nov 21, 2024 in 0s

DCO

All commits are signed off!

View more details on DCO