Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Enable PP + SP for llama #5868

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open

[Feature] Enable PP + SP for llama #5868

wants to merge 8 commits into from

Commits on Jun 28, 2024

  1. fix cross-PP-stage position id length diff bug

    Edenzzzz committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    e9beff8 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2024

  1. Merge branch 'main' into fix_4d

    @Edenzzzz
    Edenzzzz committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    6bb1fc4 View commit details
    Browse the repository at this point in the history

  2. fix typo

    Edenzzzz committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    2ac4574 View commit details
    Browse the repository at this point in the history

  3. fix typo

    Edenzzzz committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    d300b83 View commit details
    Browse the repository at this point in the history

  4. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    333afb6 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. unified cross entropy func for all shardformer models

    Edenzzzz committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    ec5784e View commit details
    Browse the repository at this point in the history

  2. add comments

    Edenzzzz committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    2866a4e View commit details
    Browse the repository at this point in the history

  3. remove redundant lines

    Edenzzzz committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    3f83b1c View commit details
    Browse the repository at this point in the history