Skip to content

Metadata/Sessions/Tags does not show up when using Open AI Agents SDK with LiteLLM #1876

@tnduyh5

Description

@tnduyh5

Please read this first

Describe the bug

I have been using the Open AI Agents SDK (litellm version) for integrating agents into my app.
Now while any chat completion+ it's cost+tokens (via the agents) does show up in the litellm UI, I am not able to add any extra_body to the request which will help me control Metadata or Sessions or Tags.
I have tried passing it in the Run Config in the Model Settings Extra Body Param by referring to https://docs.litellm.ai/docs/proxy/cost_tracking#client-side-spend-tag and https://docs.litellm.ai/docs/proxy/ui_logs_sessions.
But nothing shows up on the Litellm UI dashboard.

Note: Now I am not sure if this an issue from open ai's sdk or if litellm currently does not support adding metadata (and others) to the oai agents sdk or if I am passing in params incorrectly.

I'm tried a lot of params but still not work:

            # Use standard LitellmModel with metadata configured via ModelSettings
            agent_config["model"] = LitellmModel(
                model=f'litellm_proxy/{self.litellm_proxy_model}',
                api_key=self.litellm_master_key,
                base_url=self.litellm_proxy_url
            )

            # Configure base ModelSettings with static metadata
            # Request-specific metadata (conversation_id, user_id) will be added at runtime
            base_metadata = {
                "service": "pfa-ai-services",
                "environment": os.getenv("ENV", "development"),
                "agent_name": name,
                "model_type": self.litellm_proxy_model,
                "trace_user_id": "user-id-123",
                "generation_id": "gen-id-456",
                "trace_id": "trace-id-789"
            }

            agent_config["model_settings"] = ModelSettings(
                parallel_tool_calls=True,
                max_tokens=8000,
                metadata=base_metadata,
                extra_args={
                    "metadata": {
                        "trace_user_id": "user-id-123",
                        "generation_id": "gen-id-456",
                        "trace_id": "trace-id-789"
                    }
                extra_body=
                    "metadata": {
                        "trace_user_id": "user-id-123",
                        "generation_id": "gen-id-456",
                        "trace_id": "trace-id-789"
                    }
            )

Debug information

  • Agents SDK version: 0.2.11
  • Python version: 3.11

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions