v0.2.0
What's New
-
Environment Configuration (PR #15 by @SiddhantSadangi):
- Set
workers
through environment variables - Improved default settings
- Set
-
Tool Calling Support (PR #21 by @Blaizzy):
- Added functionality for tool calling
- Supports parallel tool calling mode
- Models
- Llama 3.1
- Arcee Agent
- Firefunction
- xLAM
- C4AI-Command-R-Plus
- Modes
- Standard (Without Streaming)
- Parallel Tool Calling
-
Refactor Vision Language Models stream_generate (PR #21 by @Blaizzy).
New Contributors
- @SiddhantSadangi made their first contribution in https://github.com/Blaizzy/fastmlx/pull/15
Full Changelog: Blaizzy/fastmlx@v0.1.0...v0.2.0