Skip to content

Ingest FP8 attn scales and use them in ROCm FlashAttention #1039

Ingest FP8 attn scales and use them in ROCm FlashAttention

Ingest FP8 attn scales and use them in ROCm FlashAttention #1039

Annotations

1 warning

mypy (3.10)

succeeded Dec 19, 2024 in 33s