Function Calling Support from LM Studio(OpenAI-like) REST API Server

[RishiSoftEngg]

I am currently using the mistral-nemo-instruct-2407 LLM modal locally via LM Studio REST API Server. And, mistral nemo have the capability of calling function but i am not able to find any documentation regarding the function calling in lmstudio.js docs and Rest API Server. This is curl request I am using currently

curl http://localhost:1240/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "mistral-nemo-instruct-2407",
    "messages": [
      { "role": "system", "content": "Always answer in rhymes. Today is Thursday" },
      { "role": "user", "content": "What day is it today?" }
    ],
    "temperature": 0.7,
    "max_tokens": -1,
    "stream": false
}'

[yagil]

Hey @RishiSoftEngg function calling is available in beta starting LM Studio 0.3.6, you can get it from https://lmstudio.ai/download

We made it available via the OpenAI compatibility API. Not yet though lmstudio-js. Docs here

[yagil]

Same as #75