Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Draft] Add autocast to prediction_step for SFTTrainer #2310

Draft
wants to merge 19 commits into
base: main
Choose a base branch
from
Draft

[Draft] Add autocast to prediction_step for SFTTrainer #2310

wants to merge 19 commits into from

Commits on Nov 3, 2024

  1. Add autocast support 

    This adds autocast support in preparation of predict_with_generate flag being added
    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    d6e4d9e View commit details
    Browse the repository at this point in the history

  2. Missing type imports

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    ca2ab9e View commit details
    Browse the repository at this point in the history

  3. Update sft_trainer.py

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    24ba723 View commit details
    Browse the repository at this point in the history

  4. Update sft_trainer.py

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    998902f View commit details
    Browse the repository at this point in the history

  5. Update sft_trainer.py

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    77f820c View commit details
    Browse the repository at this point in the history

  6. Move loss to device

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    622bafd View commit details
    Browse the repository at this point in the history

  7. Update sft_trainer.py

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    53e8d8a View commit details
    Browse the repository at this point in the history

  8. Fix for right num of outputs

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    3c4fc2b View commit details
    Browse the repository at this point in the history

  9. Update sft_trainer.py

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    7744d42 View commit details
    Browse the repository at this point in the history

  10. Remove cl as it was not needed

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    6b0a1a9 View commit details
    Browse the repository at this point in the history

  11. Missing import

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    f3c9909 View commit details
    Browse the repository at this point in the history

  12. Add test

    @pdufour
    pdufour committed Nov 3, 2024
    Configuration menu
    Copy the full SHA
    d3efacb View commit details
    Browse the repository at this point in the history

  13. start test

    @pdufour
    pdufour committed Nov 3, 2024
    Configuration menu
    Copy the full SHA
    4a92eec View commit details
    Browse the repository at this point in the history

  14. remove comment

    @pdufour
    pdufour committed Nov 3, 2024
    Configuration menu
    Copy the full SHA
    9784a1c View commit details
    Browse the repository at this point in the history

  15. Re-add cl

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    77faa0c View commit details
    Browse the repository at this point in the history

  16. remove nograd

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    af52ca8 View commit details
    Browse the repository at this point in the history

  17. Bad indent

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    a066210 View commit details
    Browse the repository at this point in the history

  18. Fix arg

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    f8d5d76 View commit details
    Browse the repository at this point in the history

  19. Update sft_trainer.py

    @pdufour
    pdufour authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    3983356 View commit details
    Browse the repository at this point in the history