Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactored exl2 method to add LoRA, 8bit cache, and other features supported by exllama #729

Merged
merged 26 commits into from
Mar 13, 2024
Merged

Refactored exl2 method to add LoRA, 8bit cache, and other features supported by exllama #729

merged 26 commits into from
Mar 13, 2024

Commits on Mar 6, 2024

  1. Refactored exl2 method to add in more features supported by the exlla… 

    …mav2 library
    @psych0v0yager
    psych0v0yager committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    14d0160 View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2024

  1. Added LoRA support

    @psych0v0yager
    psych0v0yager committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    a46d86a View commit details
    Browse the repository at this point in the history

  2. Added unloading as well

    @psych0v0yager
    psych0v0yager committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    e0544f0 View commit details
    Browse the repository at this point in the history

  3. fixed LoRA import

    @psych0v0yager
    psych0v0yager committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    f533907 View commit details
    Browse the repository at this point in the history

  4. fixed LoRA import

    @psych0v0yager
    psych0v0yager committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    49165f3 View commit details
    Browse the repository at this point in the history

  5. fixed LoRA import

    @psych0v0yager
    psych0v0yager committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    741251d View commit details
    Browse the repository at this point in the history

  6. Made max_seq_len optional again

    @psych0v0yager
    psych0v0yager committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    d5232d8 View commit details
    Browse the repository at this point in the history

  7. Made remaining params optional

    @psych0v0yager
    psych0v0yager committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    5caa973 View commit details
    Browse the repository at this point in the history

  8. Removed optional flag on device. Even before my changes it would cras… 

    …h without inputting a device.
    @psych0v0yager
    psych0v0yager committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    1be4858 View commit details
    Browse the repository at this point in the history

  9. Fixed type check

    @psych0v0yager
    psych0v0yager committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    f75ff1f View commit details
    Browse the repository at this point in the history

  10. Fixed the input error

    @psych0v0yager
    psych0v0yager committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    e33d344 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. 4 bit cache support is now active

    @psych0v0yager
    psych0v0yager committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    be528af View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2024

  1. Refactored exl2 method to add in more features supported by the exlla… 

    …mav2 library
    @psych0v0yager @rlouf
    psych0v0yager authored and rlouf committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    bd984ad View commit details
    Browse the repository at this point in the history

  2. Added LoRA support

    @psych0v0yager @rlouf
    psych0v0yager authored and rlouf committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    aa99511 View commit details
    Browse the repository at this point in the history

  3. Added unloading as well

    @psych0v0yager @rlouf
    psych0v0yager authored and rlouf committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    eb0bbfb View commit details
    Browse the repository at this point in the history

  4. fixed LoRA import

    @psych0v0yager @rlouf
    psych0v0yager authored and rlouf committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    b7bd216 View commit details
    Browse the repository at this point in the history

  5. fixed LoRA import

    @psych0v0yager @rlouf
    psych0v0yager authored and rlouf committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    9b720a3 View commit details
    Browse the repository at this point in the history

  6. fixed LoRA import

    @psych0v0yager @rlouf
    psych0v0yager authored and rlouf committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    f7d5324 View commit details
    Browse the repository at this point in the history

  7. Made max_seq_len optional again

    @psych0v0yager @rlouf
    psych0v0yager authored and rlouf committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    e62a70b View commit details
    Browse the repository at this point in the history

  8. Made remaining params optional

    @psych0v0yager @rlouf
    psych0v0yager authored and rlouf committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    29135ee View commit details
    Browse the repository at this point in the history

  9. Removed optional flag on device. Even before my changes it would cras… 

    …h without inputting a device.
    @psych0v0yager @rlouf
    psych0v0yager authored and rlouf committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    ec38d6e View commit details
    Browse the repository at this point in the history

  10. Fixed type check

    @psych0v0yager @rlouf
    psych0v0yager authored and rlouf committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    8d51cb5 View commit details
    Browse the repository at this point in the history

  11. Fixed the input error

    @psych0v0yager @rlouf
    psych0v0yager authored and rlouf committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    f9b6e44 View commit details
    Browse the repository at this point in the history

  12. 4 bit cache support is now active

    @psych0v0yager @rlouf
    psych0v0yager authored and rlouf committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    2cf15c2 View commit details
    Browse the repository at this point in the history

  13. Made formatting changes

    @psych0v0yager
    psych0v0yager committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    a8ab1e6 View commit details
    Browse the repository at this point in the history

  14. updated branch

    @psych0v0yager
    psych0v0yager committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    7dec179 View commit details
    Browse the repository at this point in the history