Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add CentML Provider #128

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

anurlybayev
Copy link

@anurlybayev anurlybayev commented Dec 3, 2024

Add CentML Provider Support

Description

Added support for CentML, to expand aisuite's provider options.

Changes Made

  • Added CentML provider implementation in providers/centml_provider.py
  • Added necessary environment variables for CentML API authentication

Testing

  • Tested provider initialization
  • Tested chat completion functionality
  • All existing tests pass

Environment Variables Added

CENTML_API_KEY=

Related Documentation

  • Added CentML to the list of supported providers in README.md

Checklist

  • Code follows project style guidelines
  • Updated documentation
  • Pre-commit hooks pass

@anurlybayev
Copy link
Author

@ksolo can you please review?

@anurlybayev anurlybayev force-pushed the anurlybayev/add-centml-provider branch from 1078e33 to 8ebd4d6 Compare January 4, 2025 23:48
@anurlybayev
Copy link
Author

@ksolo @rohitprasad15 I rebased my branch from main. Can you please review?

@rohitprasad15
Copy link
Collaborator

Thanks for the PR. Please re-test after the addition of pydantic checks in the codebase.
If possible, please add tool calling support as well.
If the model uses OpenAI message format, then you can use Mistral or Together as an example on how to use an existing base class to do message conversion.
Please tag me after changes are done.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants