Commits on Sep 18, 2024

1. PR #16938: Add NANOO FP8 support for collaborative communication unit… …

   … tests
   
   Imported from GitHub PR #16938
   
   This PR adds support for NANOO FP8 data format in the collaborative communication unit tests.
   - For the context on OCP FP8 and NANOO FP8, please refer to this comment:
   google/flax#3993 (comment)
   - The unit tests in this PR are similar to GEMM unit test introduced in the following PR to be able to deal with both OCP and NANOO fp8 formats:
   #10488
   Copybara import of the project:
   
   --
   0fc74cc by Wen Chen <[email protected]>:
   
   [AMD] Added NCCL support for fp8e4m3fnuz and fp8e5m2fnuz.
   
   --
   d247af5 by scxfjiang <[email protected]>:
   
   refactor tests for collective comm ops
   
   --
   6f8c418 by scxfjiang <[email protected]>:
   
   rafactor collective comm e2e tests
   
   --
   8ecb6ec by scxfjiang <[email protected]>:
   
   update: replace str
   
   --
   338d3af by scxfjiang <[email protected]>:
   
   get rid of macros
   
   Merging this change closes #16938
   
   FUTURE_COPYBARA_INTEGRATE_REVIEW=#16938 from ROCm:ci_dev_rccl_nanoo_fp8 338d3af
   PiperOrigin-RevId: 675635116

   

   ScXfjiang authored and Google-ML-Automation committed Sep 18, 2024
   Configuration menu

   • View commit details
   • Copy full SHA for 00f8f62
   • Browse repository at this point

   Copy the full SHA

   00f8f62 View commit details

   Browse the repository at this point in the history