Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Do not merge] Overlap AG+GEMM benchmark #3367

Open
wants to merge 12 commits into
base: main
Choose a base branch
from
Open

[Do not merge] Overlap AG+GEMM benchmark #3367

wants to merge 12 commits into from
+252 −0

Commits on Oct 23, 2024

  1. working simple benchmark

    @samnordmann
    samnordmann committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    2c04df9 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. minor

    @samnordmann
    samnordmann committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    af36cf1 View commit details
    Browse the repository at this point in the history

  2. test script

    @samnordmann
    samnordmann committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    68b858a View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2024

  1. minor

    @samnordmann
    samnordmann committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    0c3493b View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2024

  1. add nsight profiling

    @samnordmann
    samnordmann committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    b30b44b View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. nsight and tl/nccl/ sync mode

    @samnordmann
    samnordmann committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    0592a13 View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. add cuStreamWriteValue but linkage error

    @samnordmann
    samnordmann committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    0037b1e View commit details
    Browse the repository at this point in the history

  2. multiple pgs

    @samnordmann
    samnordmann committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    ec71e23 View commit details
    Browse the repository at this point in the history

  3. reenable cuStreamValue32

    @samnordmann
    samnordmann committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    a15fdfc View commit details
    Browse the repository at this point in the history

  4. add tl/cuda and ec/cuda flags in bash test script

    @samnordmann
    samnordmann committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    6682a33 View commit details
    Browse the repository at this point in the history

  5. add option to unfuse loops

    @samnordmann
    samnordmann committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    b01f1f4 View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. add cuda graphs. Only working for NCCL and S1 bc there is a syncStrea… 

    …m in nccl
    @samnordmann
    samnordmann committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    ea7fd37 View commit details
    Browse the repository at this point in the history