Skip to content

Modify docs of async_pre_call_hook to accept CallTypesLiteral #16302

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Modify docs of async_pre_call_hook to accept CallTypesLiteral #16302

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
b88e1ee
Modify docs of async_pre_call_hook to accept generic call_type
Dobiasd Nov 6, 2025
07d40d8
Use CallTypesLiteral instead of str
Dobiasd Nov 11, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 2 additions & 9 deletions docs/my-website/docs/proxy/call_hooks.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ This function is called just before a litellm completion call is made, and allow
from litellm.integrations.custom_logger import CustomLogger
import litellm
from litellm.proxy.proxy_server import UserAPIKeyAuth, DualCache
from litellm.types.utils import ModelResponseStream
from litellm.types.utils import CallTypesLiteral, ModelResponseStream
from typing import Any, AsyncGenerator, Optional, Literal

# This file includes the custom callbacks for LiteLLM Proxy
Expand All @@ -34,14 +34,7 @@ class MyCustomHandler(CustomLogger): # https://docs.litellm.ai/docs/observabilit

#### CALL HOOKS - proxy only ####

async def async_pre_call_hook(self, user_api_key_dict: UserAPIKeyAuth, cache: DualCache, data: dict, call_type: Literal[
"completion",
"text_completion",
"embeddings",
"image_generation",
"moderation",
"audio_transcription",
]):
async def async_pre_call_hook(self, user_api_key_dict: UserAPIKeyAuth, cache: DualCache, data: dict, call_type: CallTypesLiteral):
data["model"] = "my-new-model"
return data

Expand Down
Loading