Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix QKV dtype in the bwd of FP8+CP #1134

Merged
merged 9 commits into from
Aug 30, 2024
Merged

Fix QKV dtype in the bwd of FP8+CP #1134

merged 9 commits into from
Aug 30, 2024

Commits on Aug 23, 2024

  1. fix qkv_dtype of FP8+CP 

    Signed-off-by: Xiaowei Ren <[email protected]>
    @xrennvidia
    xrennvidia committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    7c926f5 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. Merge branch 'main' into xren/cp_fp8_fix

    @xrennvidia
    xrennvidia committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    80c4af5 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. config cp correction dtype of FP8+CP 

    Signed-off-by: Xiaowei Ren <[email protected]>
    @xrennvidia
    xrennvidia committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    184ad60 View commit details
    Browse the repository at this point in the history

  2. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    e383bbe View commit details
    Browse the repository at this point in the history

  3. code style change 

    Signed-off-by: Xiaowei Ren <[email protected]>
    @xrennvidia
    xrennvidia committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    62e620a View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into xren/cp_fp8_fix

    @xrennvidia
    xrennvidia committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    bda0506 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. always do FP8 CP correction in FP32 

    Signed-off-by: Xiaowei Ren <[email protected]>
    @xrennvidia
    xrennvidia committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    24c626d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into xren/cp_fp8_fix

    @xrennvidia
    xrennvidia committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    5b5d8d7 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. Merge branch 'main' into xren/cp_fp8_fix

    @cyanguwa
    cyanguwa authored Aug 30, 2024
    Configuration menu
    Copy the full SHA
    8e34de1 View commit details
    Browse the repository at this point in the history