Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TRT LLM Integration with LORA #3305

Merged
merged 20 commits into from
Sep 17, 2024
Merged

TRT LLM Integration with LORA #3305

merged 20 commits into from
Sep 17, 2024

Commits on Sep 6, 2024

  1. TRT LLM Integration with LORA

    @agunapal
    agunapal committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    98b654f View commit details
    Browse the repository at this point in the history

  2. TRT LLM Integration with LORA

    @agunapal
    agunapal committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    ce59497 View commit details
    Browse the repository at this point in the history

  3. TRT LLM Integration with LORA

    @agunapal
    agunapal committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    347159f View commit details
    Browse the repository at this point in the history

  4. TRT LLM Integration with LORA

    @agunapal
    agunapal committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    06d5b47 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2024

  1. Added launcher support for trt_llm

    @agunapal
    agunapal committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    0ecc71a View commit details
    Browse the repository at this point in the history

  2. updated README

    @agunapal
    agunapal committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    56d0ccc View commit details
    Browse the repository at this point in the history

  3. updated README

    @agunapal
    agunapal committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    2d6f60d View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Merge branch 'master' into feature/trt_llm_lora

    @mreso
    mreso authored Sep 10, 2024
    Configuration menu
    Copy the full SHA
    e7a0275 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Using the API that supports async generate

    @agunapal
    agunapal committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    f4da9b6 View commit details
    Browse the repository at this point in the history

  2. Review comments

    @agunapal
    agunapal committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    bcc036b View commit details
    Browse the repository at this point in the history

  3. Apply suggestions from code review 

    Co-authored-by: Matthias Reso <[email protected]>
    @agunapal @mreso
    agunapal and mreso authored Sep 13, 2024
    Configuration menu
    Copy the full SHA
    cfc687d View commit details
    Browse the repository at this point in the history

  4. addressed review comments

    @agunapal
    agunapal committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    f36f6a8 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'feature/trt_llm_lora' of https://github.com/pytorch/serve… 

    … into feature/trt_llm_lora
    @agunapal
    agunapal committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    457f451 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2024

  1. Addressed review comments

    @agunapal
    agunapal committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    cc71d93 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into feature/trt_llm_lora

    @agunapal
    agunapal authored Sep 14, 2024
    Configuration menu
    Copy the full SHA
    bbbaf69 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Updated the async logic based on review comments

    @agunapal
    agunapal committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    c986c7b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feature/trt_llm_lora' of https://github.com/pytorch/serve… 

    … into feature/trt_llm_lora
    @agunapal
    agunapal committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    30b92c6 View commit details
    Browse the repository at this point in the history

  3. Made max_batch_size and kv_cache size configurable for the launcher

    @agunapal
    agunapal committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    26a1532 View commit details
    Browse the repository at this point in the history

  4. fixing lint

    @agunapal
    agunapal committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    8260619 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into feature/trt_llm_lora

    @agunapal
    agunapal authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    589130d View commit details
    Browse the repository at this point in the history