Skip to content

Ingest FP8 attn scales and use them in ROCm FlashAttention #1040

Ingest FP8 attn scales and use them in ROCm FlashAttention

Ingest FP8 attn scales and use them in ROCm FlashAttention #1040

Annotations

1 warning

mypy (3.12)

succeeded Dec 19, 2024 in 35s