Skip to content

[ Kernel ] Enable Dynamic Per Token fp8#6547

Merged
robertgshaw2-redhat merged 16 commits intovllm-project:mainfrom neuralmagic:turn-on-fp8-dyn-per-tokenJul 19, 2024

Commits

Commits on Jul 18, 2024

Commits on Jul 19, 2024