Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Perform gradient clipping on global batch when using gradient accumulation #9

Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open

Perform gradient clipping on global batch when using gradient accumulation #9

wants to merge 6 commits into from

Commits on Feb 13, 2023

  1. refactor learners.py to perform gradient clipping on global batch whe… 

    …n using ShardedStaticAccumulator
    @ashors1
    ashors1 committed Feb 13, 2023
    Configuration menu
    Copy the full SHA
    f6e6618 View commit details
    Browse the repository at this point in the history

  2. add AUTHORS file

    @ashors1
    ashors1 committed Feb 13, 2023
    Configuration menu
    Copy the full SHA
    f57f77a View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2023

  1. remove AUTHORS file

    @ashors1
    ashors1 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    b69771e View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2023

  1. rebase to head

    @ashors1
    ashors1 committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    fd49b3e View commit details
    Browse the repository at this point in the history

  2. fix formatting

    @ashors1
    ashors1 committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    57e567c View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2023

  1. address PR comments

    @ashors1
    ashors1 committed Mar 18, 2023
    Configuration menu
    Copy the full SHA
    2303ad8 View commit details
    Browse the repository at this point in the history