[WIP] all-gather fp8 for rowwise

[danielvegamyhre]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/2145

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 12 New Failures

As of commit d81ef80 with merge base cdced21 ():

NEW FAILURES - The following jobs have failed:

• Code Analysis with Ruff / build (3.9) (gh)
  torchao/float8/float8_tensor_parallel_rowwise_scales.py:21:5: F401 [*] torchao.float8.float8_scaling_utils.NoopFwToFloat8BwDynamic imported but unused
• PR Label Check / Check PR Labels (gh)
  Process completed with exit code 1.
• Run Float8 Tests / test (H100, linux.aws.h100, --pre torch torchvision torchaudio --index-url https://download.pytor... / linux-job (gh)
  test/float8/test_base.py::TestFloat8Tensor::test_split_cat
• Run Float8 Tests / test (SM-89, linux.g6.4xlarge.experimental.nvidia.gpu, --pre torch --index-url https://download.p... / linux-job (gh)
  test/float8/test_base.py::TestFloat8Tensor::test_split_cat
• Run Regression Tests / test (CPU 2.5.1, linux.4xlarge, torch==2.5.1 --index-url https://download.pytorch.org/whl/cpu, cpu) / linux-job (gh)
  test/float8/test_base.py::TestFloat8Tensor::test_split_cat
• Run Regression Tests / test (CPU 2.6, linux.4xlarge, torch==2.6.0 --index-url https://download.pytorch.org/whl/cpu, cpu) / linux-job (gh)
  test/float8/test_base.py::TestFloat8Tensor::test_split_cat
• Run Regression Tests / test (CPU 2.7, linux.4xlarge, torch==2.7.0 --index-url https://download.pytorch.org/whl/cpu, cpu) / linux-job (gh)
  test/float8/test_base.py::TestFloat8Tensor::test_split_cat
• Run Regression Tests / test (CUDA 2.5.1, linux.g5.12xlarge.nvidia.gpu, torch==2.5.1 --index-url https://download.pytorch... / linux-job (gh)
  test/float8/test_base.py::TestFloat8Tensor::test_split_cat
• Run Regression Tests / test (CUDA 2.6, linux.g5.12xlarge.nvidia.gpu, torch==2.6.0, cuda, 12.6) / linux-job (gh)
  test/float8/test_base.py::TestFloat8Tensor::test_split_cat
• Run Regression Tests / test (CUDA 2.7, linux.g5.12xlarge.nvidia.gpu, torch==2.7.0, cuda, 12.6) / linux-job (gh)
  test/float8/test_base.py::TestFloat8Tensor::test_split_cat
• Run Regression Tests / test-nightly (CPU Nightly, linux.4xlarge, --pre torch --index-url https://download.pytorch.org/wh... / linux-job (gh)
  test/float8/test_base.py::TestFloat8Tensor::test_split_cat
• Run Regression Tests / test-nightly (CUDA Nightly, linux.g5.12xlarge.nvidia.gpu, --pre torch --index-url https://downloa... / linux-job (gh)
  test/float8/test_base.py::TestFloat8Tensor::test_split_cat

This comment was automatically generated by Dr. CI and updates every 15 minutes.