-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
OpenAI timeout when using Llama models #59
Comments
From the Google Group announcement from yesterday:
|
Alright, thanks for the quick response! |
It seems TogetherAI upstream API is having issues. Can some participants try if it's also extremely slow for them too, on their personal keys? If this is the root cause, there is really nothing we can do about this, except decrease \beta. We'll do an announcement shortly. |
I confirm that Together API is also unresponsive using paid tier keys. |
We released an announcement. Please rereport any errors that are not covered by the announcement, thanks! |
Looks like their API is up again |
Looks like Together's API is having some issues again. We'll monitor the situation and act if the problem does not get solved soon. |
Looks like the API is up again, closing but keeping pinned. |
lol together ... of course 2h before the end :) |
It seems to be up again? |
Yep, only was down like 20-30min or so, luckily got up again :) |
The API is under heavy load right now. I'm trying to work on some Llama models.
However, it seems the API is doing some OpenAI requests in the background? At least I'm getting a 60 second OpenAI timeout error message.
Could you look into this and potentially remove OpenAI requests from Llama chats? This might free up some capacity.
The text was updated successfully, but these errors were encountered: