Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Failed Groq API #901

Open
irosyadi opened this issue Aug 5, 2024 · 4 comments
Open

[BUG] Failed Groq API #901

irosyadi opened this issue Aug 5, 2024 · 4 comments
Assignees
Labels
bug Something isn't working

Comments

@irosyadi
Copy link

irosyadi commented Aug 5, 2024

Describe the bug / 描述问题

Groq API cannot respond to the prompt input.

To Reproduce / 复现步骤

  1. Enter Groq API key.
    2.Choose any Groq model: Llama3 8B, Llama3 70B, or Mixtral 8x7B.
  2. Input prompt.

Expected behavior / 期望行为

If selected, any Groq models should respond to the prompt input.

Screenshots / 截图

image

Devtools Info / 开发者工具信息

LangChainBot.js:56
POST https://api.groq.com/openai/v1/chat/completions 400 (Bad Request)
Bot.js:204 Error send prompt to Llama 3 70b@Groq API:
Error: 400 {"error":{"message":"'temperature' : value must be a number","type":"invalid_request_error"}}
at C.generate (error.mjs:36:20)
at Fe.makeStatusError (core.mjs:256:25)
at Fe.makeRequest (core.mjs:299:30)
at async t._fn (index.js:50:4)

OS and version / 操作系统版本

Windows 10

ChatALL version / ChatALL 版本

v1.82.107

Network / 网络

No

Additional context / 其它相关信息

No response

@irosyadi irosyadi added the bug Something isn't working label Aug 5, 2024
@PeterDaveHello PeterDaveHello self-assigned this Sep 27, 2024
@PeterDaveHello
Copy link
Collaborator

Tested it on my end, but didn't encounter the issue. Just sharing my findings.

image

@PeterDaveHello
Copy link
Collaborator

@irosyadi based on the error message, would you please help check if Groq API's temperature config is a number or not?

image

@irosyadi
Copy link
Author

irosyadi commented Oct 2, 2024

Yes, I believe this is the source of the problem. Solved.

@PeterDaveHello
Copy link
Collaborator

Thanks, I'll see if that's something happening for every new user or clean installation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants