Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

question: do you support the ability to use two open ai API providers? #222

Open
GamingDaveUk opened this issue Jan 7, 2025 · 4 comments
Labels
question Further information is requested

Comments

@GamingDaveUk
Copy link

Currently using plush for comfyui to do llm work. But I hit a snag. I have two services that use open ai API (arliai and featherless) but can only assign one API key. The dev is looking into a solution but I am curiouser if your nodes already have a solution to this (and curious about any differences between plush and this)

@GamingDaveUk
Copy link
Author

I started watching the videos and got as far as the third one where they showed the supported services, that video needs a major update as the services it shows are very small and do not include open ai compatable as a supported type.... However it IS.

I installed it just to have a look at the nodes more a curiosity thing and found you can indeed use openai compatable....whats more you can specify which environmental key to use. so to answer my own question....it looks* possible to use two open ai compatable services in the same workflow.
*I say "looks" as i havent had time to test two at once.

image
it took some sussing out as its not as intuitive as plush but this worked. Now i just need to figure out how to get it to use a large string as context, further refine the instructions, see if i can use whisper as audio transcribing etc.... but it looks interesting so far

@kyleroche
Copy link
Member

You should be fine using two different open ai compatible APIs (even w/in the same flow). Just use different ENV variables for the respective keys and set your URL and Models independently. Let us know if you have any trouble. Looking forward to seeing what you build !

@kyleroche
Copy link
Member

The key could be the same in your case also.

@shhlife
Copy link
Collaborator

shhlife commented Jan 8, 2025

Kyle is right - it should work just fine. Please give it a try and let us know if it doesn't work!

@shhlife shhlife added the question Further information is requested label Jan 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants