Is it possible to use groq API

[aborruso]

Hi,
I have tried to set groq api key

OPENAI_API_KEY = "gsk_CIhrph70PrymmsZU1xxxxxxxxx"
OPENAI_BASE_URL = "https://api.groq.com/openai/v1"

But I have

raise self._make_status_error_from_response(err.response) from None
openai.AuthenticationError: Error code: 401 - {'error': {'message': 'Incorrect API key provided: gsk_CIhr********************************************RHuz. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}}

Am I setting it in a wrong way?

Thank you very much

[ErikBjare]

I just added proper groq support in 4299cd0, but no new release yet so you'll have to install from source for now.

Use it with:

gptme -m groq/llama-3.1-70b-versatile hello

It's possible it didn't work for you as expected due to you using v0.20.0 which did not include the changes 30e3f01 which are referenced in the docs.

I just released v0.21.0 to solve this.

[aborruso]

Hi,
thank you very much.

I have set in my config GROQ_API_KEY = "gsk_CIhrpxxxxxxoXQLVufJ07jBXPEIRHuz".

I want it as default. If I run simply gptme I have

No API key set for OpenAI, Anthropic, or OpenRouter.
You can get one at:
 - OpenAI: https://platform.openai.com/account/api-keys
 - Anthropic: https://console.anthropic.com/settings/keys
 - OpenRouter: https://openrouter.ai/settings/keys

Your OpenAI, Anthropic, or OpenRouter API key:

How to set groq as default?

Thank you

[aborruso]

If I run

gptme -m groq/llama-3.1-70b-versatile hello

I have

If then I ask a name for a cat

I have

File "/home/aborruso/.local/pipx/venvs/gptme/lib/python3.11/site-packages/openai/_base_client.py", line 1058, in _request
    raise self._make_status_error_from_response(err.response) from None
openai.BadRequestError: Error code: 400 - {'error': {'message': "'messages.2' : for 'role:assistant' the following must be satisfied[('messages.2.content' : value must be a string)]", 'type': 'invalid_request_error'}}

Thank you