Skip to content

Ingest FP8 attn scales and use them in ROCm FlashAttention #1038

Ingest FP8 attn scales and use them in ROCm FlashAttention

Ingest FP8 attn scales and use them in ROCm FlashAttention #1038

Annotations

1 warning

mypy (3.9)

succeeded Dec 19, 2024 in 31s