Skip to content

Ingest FP8 attn scales and use them in ROCm FlashAttention #1041

Ingest FP8 attn scales and use them in ROCm FlashAttention

Ingest FP8 attn scales and use them in ROCm FlashAttention #1041

Annotations

1 warning

mypy (3.11)

succeeded Dec 19, 2024 in 30s