[ Kernel ] Enable Dynamic Per Token fp8#6547
Merged
robertgshaw2-neuralmagic merged 16 commits intovllm-project:mainfrom neuralmagic:turn-on-fp8-dyn-per-tokenJul 19, 2024
+68-39
Commits
Commits on Jul 18, 2024
- committed
- committed
- committed
- committed
- committed
Commits on Jul 19, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- authored