Skip to content

Ingest FP8 attn scales and use them in ROCm FlashAttention #1036

Ingest FP8 attn scales and use them in ROCm FlashAttention

Ingest FP8 attn scales and use them in ROCm FlashAttention #1036

Annotations

1 warning

mypy (3.9)

succeeded Dec 19, 2024 in 33s