[Bugfix] Fix kv_cache_dtype=fp8 without scales for FP8 checkpoints
#87
| Job | Run time |
|---|---|
| 2s | |
| 2s |
kv_cache_dtype=fp8 without scales for FP8 checkpoints
#87
| Job | Run time |
|---|---|
| 2s | |
| 2s |