-
Notifications
You must be signed in to change notification settings - Fork 485
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Anthropic integration #375
Comments
Correct me if I'm wrong - for what I know, the anthropic/claude API does not have an API for outputting token probabilities yet |
That's correct, but we try to add other providers so people can compare their output to guided generation in outlines. I often need to do this. |
Anthropic is now available via AWS Bedrock: https://aws.amazon.com/bedrock/ I think it would be great to add support for Bedrock alltogether! |
why was this idea of support for Bedrock dropped? |
The team has very limited resources |
What if I volunteered to do this? |
Yes, with Bedrock, what is returned from the API request varies from one model to the next. |
No description provided.
The text was updated successfully, but these errors were encountered: