Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Show how OIDC ModelAuthProvider can be used with Azure OpenAI #733

Conversation

sberyozkin
Copy link
Contributor

@sberyozkin sberyozkin commented Jul 8, 2024

Replaces #634.

This PR aims to show how to use multiple model providers (Vertex AI Gemini, Azure OpenAI) and how they can access models using OIDC access tokens authorized by users authenticated to Quarkus with either Google or Microsoft Entra ID.

I've confirmed the updated demo still works for Vertex AI Gemini but unfortunately I did not have time yet and a bit vague about how to setup my Azure tenant correctly, the earlier tries with #634 did not succeed. I'll look into it a bit later and might ask the community for some help, and once it is confirmed, by myself or someone else independently, the PR should be ready to go...

@sberyozkin sberyozkin force-pushed the azure_openai_oidc_auth_provider branch from a519fc1 to b2ba889 Compare July 8, 2024 15:28
@sberyozkin
Copy link
Contributor Author

I'll try to get back to it after PTO and resolve conflicts as well

@geoand
Copy link
Collaborator

geoand commented Jul 25, 2024

🙏🏼

@geoand
Copy link
Collaborator

geoand commented Jul 31, 2024

This will need to be rebased when it's picked up again

@sberyozkin sberyozkin force-pushed the azure_openai_oidc_auth_provider branch 3 times, most recently from 85fb1f4 to 0e604a1 Compare November 3, 2024 18:40
@sberyozkin
Copy link
Contributor Author

@geoand I've made it working for Azure OpenAI and the user authentication token, it will be quite nice once a few things are cleaned up and we can show both Gemini and Azure Open AI without configuring shared API keys, I had to do some workaround though related to ModelProvider resolution, I'll open another issue to discuss

@sberyozkin
Copy link
Contributor Author

Something did not workout with the rebase, somehow I picked up the pgvector related code here, but I'll recreate a PR later, not a problem

@geoand
Copy link
Collaborator

geoand commented Nov 4, 2024

Thanks @sberyozkin

@sberyozkin
Copy link
Contributor Author

Closing it, will open a new one soon

@sberyozkin sberyozkin closed this Nov 6, 2024
@sberyozkin sberyozkin deleted the azure_openai_oidc_auth_provider branch November 6, 2024 16:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants