v1.1.5
Changelog
New Features:
- Audio Responses: Agents can now deliver audio responses (both with streaming and non-streaming).
-
The audio is in the
agent.run_response.response_audio
. -
This only works with
OpenAIChat
with thegpt-4o-audio-preview
model. See their docs for more on how it works. For examplefrom agno.agent import Agent from agno.models.openai import OpenAIChat from agno.utils.audio import write_audio_to_file agent = Agent( model=OpenAIChat( id="gpt-4o-audio-preview", modalities=["text", "audio"], # Both text and audio responses are provided. audio={"voice": "alloy", "format": "wav"}, ), ) agent.print_response( "Tell me a 5 second story" ) if agent.run_response.response_audio is not None: write_audio_to_file( audio=agent.run_response.response_audio.base64_audio, filename=str(filename) )
-
See the audio_conversation_agent cookbook to test it out on the Agent Playground.
-
- Image understanding support for Together.ai and XAi: You can now give images to agents using models from XAi and Together.ai.
- Webex Tool: Added a tool for sending messages on Webex.
- Upstash Vector DB: Added support for Upstash.
Improvements:
- Automated Tests: Added integration tests for all models. Most of these will be run on each pull request, with a suite of integration tests run before a new release is published.
- Grounding and Search with Gemini: Grounding and Search can be used to improve the accuracy and recency of responses from the Gemini models.
Bug Fixes:
- Structured output updates: Fixed various cases where native structured output was not used on models
- Ollama tool parsing: Fixed cases for Ollama with tools with optional parameters
- Gemini Memory Summariser: Fixed cases where Gemini models were used as the memory summariser.
- Gemini Auto Tool Calling: Enabled automatic tool calling when tools are provided, aligning behavior with other models.
- FixedSizeChunking issue with overlap: Fixed issue where chunking would fail if overlap was set.
- Claude Tools with Multiple Types: Fixed an issue where Claude tools would break when handling a union of types in parameters.
- JSON Response Parsing: Fixed cases where JSON model responses returned quoted strings within dictionary values.
What's Changed
- Add pinecone compatible version warning by @pritipsingh in #2154
- Fix issue with telemetry being overwritten by @dirkbrnd in #2170
- Update how memory summarizer works by @dirkbrnd in #2167
- Add deepseek and qwen demo cookbook by @dirkbrnd in #2168
- fix-chunk-function-in-fixed-chunking by @manishsarvaha12 in #2121
- Update agno assist by @ashpreetbedi in #2191
- Fix/telemetry by @ysolanky in #2192
- Fix JSON schema error when using tools with anyOf instead of type by @kepler in #2196
- Raise model provider errors by @dirkbrnd in #2181
- Fix how tools are parsed for Ollama by @dirkbrnd in #2182
- Add tests for models by @manthanguptaa in #2180
- Add auto tool calling for Gemini by @dirkbrnd in #2187
- Add tests for azure by @manthanguptaa in #2199
- Fix structured outputs on various models by @dirkbrnd in #2109
- Fix how quotes are parsed in json by @dirkbrnd in #2189
- Audio output from models (i.e. voice mode) by @dirkbrnd in #1598
- feat/gemini-grounding by @ysolanky in #2169
- Enable automated tests by @dirkbrnd in #2135
- Adding multimodal cookbooks for xai and together by @manthanguptaa in #2212
- support boto session for AWS by @liorheber in #2205
- Read/Write files in UTF-8 by @matrix0415 in #2203
- Web Reader - Do not ignore http error by @RhysC in #2178
- [VectorDB] upstash vectordb integration by @enesgules in #2076
- Ft: Webex Integration Tool by @zszazi in #1906
- playground-memory-fix-ag-2740 by @ysolanky in #2216
- Update error response format in playground to use detail key instead … by @anuragts in #2215
- Release 1.1.5 by @dirkbrnd in #2202
New Contributors
- @manishsarvaha12 made their first contribution in #2121
- @kepler made their first contribution in #2196
- @liorheber made their first contribution in #2205
- @matrix0415 made their first contribution in #2203
- @RhysC made their first contribution in #2178
- @enesgules made their first contribution in #2076
- @zszazi made their first contribution in #1906
Full Changelog: v1.1.4...v1.1.5