Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LiteLLM Minor Fixes & Improvements (11/26/2024) #6913

Open
wants to merge 19 commits into
base: main
Choose a base branch
from
Open

LiteLLM Minor Fixes & Improvements (11/26/2024) #6913

wants to merge 19 commits into from

Commits on Nov 26, 2024

  1. docs(config_settings.md): document all router_settings

    @krrishdholakia
    krrishdholakia committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    f3c7e83 View commit details
    Browse the repository at this point in the history

  2. ci(config.yml): add router_settings doc test to ci/cd

    @krrishdholakia
    krrishdholakia committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    697dee4 View commit details
    Browse the repository at this point in the history

  3. test: debug test on ci/cd

    @krrishdholakia
    krrishdholakia committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    cff7cc9 View commit details
    Browse the repository at this point in the history

  4. test: debug ci/cd test

    @krrishdholakia
    krrishdholakia committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    63416e4 View commit details
    Browse the repository at this point in the history

  5. test: fix test

    @krrishdholakia
    krrishdholakia committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    7947248 View commit details
    Browse the repository at this point in the history

  6. fix(team_endpoints.py): skip invalid team object. don't fail `/team/l… 

    …ist` call

Causes downstream errors if ui just fails to load team list
    @krrishdholakia
    krrishdholakia committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    69955d4 View commit details
    Browse the repository at this point in the history

  7. test(base_llm_unit_tests.py): add 'response_format={"type": "text"}' … 

    …test to base_llm_unit_tests

adds complete coverage for all 'response_format' values to ci/cd
    @krrishdholakia
    krrishdholakia committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    3f48aaa View commit details
    Browse the repository at this point in the history

  8. feat(router.py): support wildcard routes in get_router_model_info() 

    Addresses #6914
    @krrishdholakia
    krrishdholakia committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    7f346ba View commit details
    Browse the repository at this point in the history

  9. build(model_prices_and_context_window.json): add tpm/rpm limits for a… 

    …ll gemini models

Allows for ratelimit tracking for gemini models even with wildcard routing enabled

Addresses #6914
    @krrishdholakia
    krrishdholakia committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    1b99371 View commit details
    Browse the repository at this point in the history

  10. feat(router.py): add tpm/rpm tracking on success/failure to global_ro… 

    …uter

Addresses #6914
    @krrishdholakia
    krrishdholakia committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    734d00b View commit details
    Browse the repository at this point in the history

  11. feat(router.py): support wildcard routes on router.get_model_group_us… 

    …age()
    @krrishdholakia
    krrishdholakia committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    c170b8b View commit details
    Browse the repository at this point in the history

  12. fix(router.py): fix linting error

    @krrishdholakia
    krrishdholakia committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    8a5d18e View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2024

  1. fix(router.py): implement get_remaining_tokens_and_requests 

    Addresses #6914
    @krrishdholakia
    krrishdholakia committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    ec6bbc4 View commit details
    Browse the repository at this point in the history

  2. fix(router.py): fix linting errors

    @krrishdholakia
    krrishdholakia committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    e2596b8 View commit details
    Browse the repository at this point in the history

  3. test: fix test

    @krrishdholakia
    krrishdholakia committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    59a1013 View commit details
    Browse the repository at this point in the history

  4. test: fix tests

    @krrishdholakia
    krrishdholakia committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    df80604 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into litellm_dev_11_26_2024

    @krrishdholakia
    krrishdholakia authored Nov 27, 2024
    Configuration menu
    Copy the full SHA
    f8d414e View commit details
    Browse the repository at this point in the history

  6. docs(config_settings.md): add missing dd env vars to docs

    @krrishdholakia
    krrishdholakia committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    3d98a82 View commit details
    Browse the repository at this point in the history

  7. fix(router.py): check if hidden params is dict

    @krrishdholakia
    krrishdholakia committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    817f2e5 View commit details
    Browse the repository at this point in the history