You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Proxy admins can now control MCP tool access by team or key. This makes it easy to grant different teams selective access to tools from the same MCP server.
79
+
80
+
For example, you can now give your Engineering team access to `list_repositories`, `create_issue`, and `search_code` tools, while Sales only gets `search_code` and `close_issue` tools.
81
+
82
+
This makes it easier for Proxy Admins to govern MCP Tool Access.
This release cuts p99 latency by 70% on LiteLLM AI Gateway, making it even better for low-latency use cases.
73
95
74
96
These gains come from two key enhancements:
75
97
76
98
**Reliable Sessions**
77
99
78
-
`shared_session`is now consistently used across all calls, resolving JSON errors, enabling connection pooling, and actively managing session lifecycles—detecting stale connections, retrying expired sessions, and preventing 'Session is closed' errors.
100
+
Added support for shared sessions with aiohttp. The shared_session parameter is now consistently used across all calls, enabling connection pooling.
79
101
80
102
**Faster Routing**
81
103
@@ -112,23 +134,6 @@ View the complete configuration: [gist.github.com/AlexsanderHamir/config.yaml](
112
134
View the complete load testing script: [gist.github.com/AlexsanderHamir/no_cache_hits.py](https://gist.github.com/AlexsanderHamir/42c33d7a4dc7a57f56a78b560dee3a42)
113
135
114
136
---
115
-
### MCP Gateway - Control Tool Access by Team, Key
Proxy admins can now control MCP tool access by team or key. This makes it easy to grant different teams selective access to tools from the same MCP server.
125
-
126
-
For example, you can now give your Engineering team access to `list_repositories`, `create_issue`, and `search_code` tools, while Sales only gets `search_code` and `close_issue` tools.
127
-
128
-
This makes it easier for Proxy Admins to govern MCP Tool Access.
0 commit comments