OOM when building engine for meta-llama/Llama-3.1-405B-FP8
on 8 x A100 80G
#218
This job was skipped
Loading
meta-llama/Llama-3.1-405B-FP8
on 8 x A100 80G
#218