Error message interacting with the Azure OpenAI API

[jmartinezb3]

What happened?

Yesterday, I was configuring the Azure OpenAI endpoint in LibreChat. Initially, everything was going well, but today I am encountering the errors shown in the attached screenshots.

I have restarted and updated the LibreChat images as mentioned in the documentation, but I have not been successful in getting it to work again.

I tested the deployed models in the Azure Playground, and they work correctly, so it seems to be an issue with the client. I also tried using another client, and it works as expected.

The strange thing is that it works until the third interaction, but after that, it shows error messages.

Output of the docker images command:

REPOSITORY                                  TAG       IMAGE ID       CREATED         SIZE
ghcr.io/danny-avila/librechat-dev           latest    b39b350dca9e   6 hours ago     865MB
getmeili/meilisearch                        v1.12.3   9547aac4aabc   3 weeks ago     141MB
ghcr.io/danny-avila/librechat-rag-api-dev   latest    9a0541a57bb1   7 weeks ago     7.65GB
mongo                                       latest    6fe2220a3a52   2 months ago    881MB
ankane/pgvector                             latest    f2c967e41f72   16 months ago   440MB

My librechat.yaml configuration:

version: 1.2.1
 
cache: true
 
interface:
  # Privacy policy settings
  privacyPolicy:
    externalUrl: 'https://librechat.ai/privacy-policy'
    openNewTab: true
 
  # Terms of service
  termsOfService:
    externalUrl: 'https://librechat.ai/tos'
    openNewTab: true
 
registration:
  socialLogins: ["discord", "facebook", "github", "google", "openid"]
 
endpoints:
  azureOpenAI:
    # Endpoint-level configuration
    titleModel: "gpt-4o-mini"
    plugins: true
    assistants: false
    groups:
    # Group-level configuration
    - group: "azure-chat"
      apiKey: "${EASTUS2_API_KEY}"
      instanceName: "${INSTANCE_NAME}"
      version: "2025-01-01-preview"
      # Model-level configuration
      models:
        gpt-4o:
          deploymentName: gpt-4o_2024-11-20
        gpt-4o-mini:
          deploymentName: gpt-4o-mini_2024-07-18
        o1:
          deploymentName: o1_2024-12-17
        o1-mini:
          deploymentName: o1-mini_2024-09-12
        o3-mini:
          deploymentName: o3-mini_2025-01-31

Steps to Reproduce

1.- Pick Azure OpenAI Endpoint
2.- Start an interaction

What browsers are you seeing the problem on?

Microsoft Edge

Relevant log output

Screenshots

LibreChat interface:

Browser consolo log output:

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

Please check the logs in ./logs directory at project root, in particular the error logs.

Likely something not configured correctly:

It could also be something on Azure side.

Documentation for reference:

https://www.librechat.ai/docs/configuration/azure

[jmartinezb3]

Hello,

Here is my error-2025-02-07.log file

{"cause":{},"level":"error"}
{"level":"error","message":"[OpenAIClient.chatCompletion] Unhandled error type Cannot read properties of undefined (reading 'content')","stack":"TypeError: Cannot read properties of undefined (reading 'content')\n    at SplitStreamHandler.handle (/app/api/node_modules/@librechat/agents/dist/cjs/splitStream.cjs:134:50)\n    at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:1376:30)\n    at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:583:15)\n    at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:652:24)\n    at async AskController (/app/api/server/controllers/AskController.js:105:20)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"level":"error","message":"[handleAbortError] AI response error; aborting request: Cannot read properties of undefined (reading 'content')","stack":"TypeError: Cannot read properties of undefined (reading 'content')\n    at SplitStreamHandler.handle (/app/api/node_modules/@librechat/agents/dist/cjs/splitStream.cjs:134:50)\n    at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:1376:30)\n    at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:583:15)\n    at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:652:24)\n    at async AskController (/app/api/server/controllers/AskController.js:105:20)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"code":"ERR_HTTP_HEADERS_SENT","level":"error","message":"[handleAbortError] error while trying to abort message Cannot set headers after they are sent to the client","stack":"Error [ERR_HTTP_HEADERS_SENT]: Cannot set headers after they are sent to the client\n    at ServerResponse.setHeader (node:_http_outgoing:655:11)\n    at ServerResponse.header (/app/node_modules/express/lib/response.js:794:10)\n    at ServerResponse.send (/app/node_modules/express/lib/response.js:174:12)\n    at ServerResponse.json (/app/node_modules/express/lib/response.js:278:15)\n    at ServerResponse.send (/app/node_modules/express/lib/response.js:162:21)\n    at abortMessage (/app/api/server/middleware/abortMiddleware.js:30:28)\n    at handleAbortError (/app/api/server/middleware/abortMiddleware.js:214:20)\n    at AskController (/app/api/server/controllers/AskController.js:152:5)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"cause":{},"level":"error"}
{"level":"error","message":"[OpenAIClient.chatCompletion] Unhandled error type Cannot read properties of undefined (reading 'content')","stack":"TypeError: Cannot read properties of undefined (reading 'content')\n    at SplitStreamHandler.handle (/app/api/node_modules/@librechat/agents/dist/cjs/splitStream.cjs:134:50)\n    at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:1376:30)\n    at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:583:15)\n    at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:652:24)\n    at async AskController (/app/api/server/controllers/AskController.js:105:20)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"level":"error","message":"[handleAbortError] AI response error; aborting request: Cannot read properties of undefined (reading 'content')","stack":"TypeError: Cannot read properties of undefined (reading 'content')\n    at SplitStreamHandler.handle (/app/api/node_modules/@librechat/agents/dist/cjs/splitStream.cjs:134:50)\n    at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:1376:30)\n    at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:583:15)\n    at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:652:24)\n    at async AskController (/app/api/server/controllers/AskController.js:105:20)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"code":"ERR_HTTP_HEADERS_SENT","level":"error","message":"[handleAbortError] error while trying to abort message Cannot set headers after they are sent to the client","stack":"Error [ERR_HTTP_HEADERS_SENT]: Cannot set headers after they are sent to the client\n    at ServerResponse.setHeader (node:_http_outgoing:655:11)\n    at ServerResponse.header (/app/node_modules/express/lib/response.js:794:10)\n    at ServerResponse.send (/app/node_modules/express/lib/response.js:174:12)\n    at ServerResponse.json (/app/node_modules/express/lib/response.js:278:15)\n    at ServerResponse.send (/app/node_modules/express/lib/response.js:162:21)\n    at abortMessage (/app/api/server/middleware/abortMiddleware.js:30:28)\n    at handleAbortError (/app/api/server/middleware/abortMiddleware.js:214:20)\n    at AskController (/app/api/server/controllers/AskController.js:152:5)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"cause":{},"level":"error"}
{"level":"error","message":"[OpenAIClient.chatCompletion] Unhandled error type Cannot read properties of undefined (reading 'content')","stack":"TypeError: Cannot read properties of undefined (reading 'content')\n    at SplitStreamHandler.handle (/app/api/node_modules/@librechat/agents/dist/cjs/splitStream.cjs:134:50)\n    at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:1376:30)\n    at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:583:15)\n    at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:652:24)\n    at async AskController (/app/api/server/controllers/AskController.js:105:20)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"level":"error","message":"[handleAbortError] AI response error; aborting request: Cannot read properties of undefined (reading 'content')","stack":"TypeError: Cannot read properties of undefined (reading 'content')\n    at SplitStreamHandler.handle (/app/api/node_modules/@librechat/agents/dist/cjs/splitStream.cjs:134:50)\n    at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:1376:30)\n    at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:583:15)\n    at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:652:24)\n    at async AskController (/app/api/server/controllers/AskController.js:105:20)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"code":"ERR_HTTP_HEADERS_SENT","level":"error","message":"[handleAbortError] error while trying to abort message Cannot set headers after they are sent to the client","stack":"Error [ERR_HTTP_HEADERS_SENT]: Cannot set headers after they are sent to the client\n    at ServerResponse.setHeader (node:_http_outgoing:655:11)\n    at ServerResponse.header (/app/node_modules/express/lib/response.js:794:10)\n    at ServerResponse.send (/app/node_modules/express/lib/response.js:174:12)\n    at ServerResponse.json (/app/node_modules/express/lib/response.js:278:15)\n    at ServerResponse.send (/app/node_modules/express/lib/response.js:162:21)\n    at abortMessage (/app/api/server/middleware/abortMiddleware.js:30:28)\n    at handleAbortError (/app/api/server/middleware/abortMiddleware.js:214:20)\n    at AskController (/app/api/server/controllers/AskController.js:152:5)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"cause":{},"level":"error"}
{"level":"error","message":"[OpenAIClient.chatCompletion] Unhandled error type Cannot read properties of undefined (reading 'content')","stack":"TypeError: Cannot read properties of undefined (reading 'content')\n    at SplitStreamHandler.handle (/app/api/node_modules/@librechat/agents/dist/cjs/splitStream.cjs:134:50)\n    at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:1376:30)\n    at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:583:15)\n    at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:652:24)\n    at async AskController (/app/api/server/controllers/AskController.js:105:20)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"level":"error","message":"[handleAbortError] AI response error; aborting request: Cannot read properties of undefined (reading 'content')","stack":"TypeError: Cannot read properties of undefined (reading 'content')\n    at SplitStreamHandler.handle (/app/api/node_modules/@librechat/agents/dist/cjs/splitStream.cjs:134:50)\n    at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:1376:30)\n    at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:583:15)\n    at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:652:24)\n    at async AskController (/app/api/server/controllers/AskController.js:105:20)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"code":"ERR_HTTP_HEADERS_SENT","level":"error","message":"[handleAbortError] error while trying to abort message Cannot set headers after they are sent to the client","stack":"Error [ERR_HTTP_HEADERS_SENT]: Cannot set headers after they are sent to the client\n    at ServerResponse.setHeader (node:_http_outgoing:655:11)\n    at ServerResponse.header (/app/node_modules/express/lib/response.js:794:10)\n    at ServerResponse.send (/app/node_modules/express/lib/response.js:174:12)\n    at ServerResponse.json (/app/node_modules/express/lib/response.js:278:15)\n    at ServerResponse.send (/app/node_modules/express/lib/response.js:162:21)\n    at abortMessage (/app/api/server/middleware/abortMiddleware.js:30:28)\n    at handleAbortError (/app/api/server/middleware/abortMiddleware.js:214:20)\n    at AskController (/app/api/server/controllers/AskController.js:152:5)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"cause":{},"level":"error"}
{"level":"error","message":"[OpenAIClient.chatCompletion] Unhandled error type Cannot read properties of undefined (reading 'content')","stack":"TypeError: Cannot read properties of undefined (reading 'content')\n    at SplitStreamHandler.handle (/app/api/node_modules/@librechat/agents/dist/cjs/splitStream.cjs:134:50)\n    at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:1376:30)\n    at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:583:15)\n    at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:652:24)\n    at async AskController (/app/api/server/controllers/AskController.js:105:20)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"level":"error","message":"[handleAbortError] AI response error; aborting request: Cannot read properties of undefined (reading 'content')","stack":"TypeError: Cannot read properties of undefined (reading 'content')\n    at SplitStreamHandler.handle (/app/api/node_modules/@librechat/agents/dist/cjs/splitStream.cjs:134:50)\n    at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:1376:30)\n    at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:583:15)\n    at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:652:24)\n    at async AskController (/app/api/server/controllers/AskController.js:105:20)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"code":"ERR_HTTP_HEADERS_SENT","level":"error","message":"[handleAbortError] error while trying to abort message Cannot set headers after they are sent to the client","stack":"Error [ERR_HTTP_HEADERS_SENT]: Cannot set headers after they are sent to the client\n    at ServerResponse.setHeader (node:_http_outgoing:655:11)\n    at ServerResponse.header (/app/node_modules/express/lib/response.js:794:10)\n    at ServerResponse.send (/app/node_modules/express/lib/response.js:174:12)\n    at ServerResponse.json (/app/node_modules/express/lib/response.js:278:15)\n    at ServerResponse.send (/app/node_modules/express/lib/response.js:162:21)\n    at abortMessage (/app/api/server/middleware/abortMiddleware.js:30:28)\n    at handleAbortError (/app/api/server/middleware/abortMiddleware.js:214:20)\n    at AskController (/app/api/server/controllers/AskController.js:152:5)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"cause":{},"level":"error"}
{"level":"error","message":"[OpenAIClient.chatCompletion] Unhandled error type Cannot read properties of undefined (reading 'content')","stack":"TypeError: Cannot read properties of undefined (reading 'content')\n    at SplitStreamHandler.handle (/app/api/node_modules/@librechat/agents/dist/cjs/splitStream.cjs:134:50)\n    at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:1376:30)\n    at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:583:15)\n    at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:652:24)\n    at async AskController (/app/api/server/controllers/AskController.js:105:20)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"level":"error","message":"[handleAbortError] AI response error; aborting request: Cannot read properties of undefined (reading 'content')","stack":"TypeError: Cannot read properties of undefined (reading 'content')\n    at SplitStreamHandler.handle (/app/api/node_modules/@librechat/agents/dist/cjs/splitStream.cjs:134:50)\n    at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:1376:30)\n    at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:583:15)\n    at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:652:24)\n    at async AskController (/app/api/server/controllers/AskController.js:105:20)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"code":"ERR_HTTP_HEADERS_SENT","level":"error","message":"[handleAbortError] error while trying to abort message Cannot set headers after they are sent to the client","stack":"Error [ERR_HTTP_HEADERS_SENT]: Cannot set headers after they are sent to the client\n    at ServerResponse.setHeader (node:_http_outgoing:655:11)\n    at ServerResponse.header (/app/node_modules/express/lib/response.js:794:10)\n    at ServerResponse.send (/app/node_modules/express/lib/response.js:174:12)\n    at ServerResponse.json (/app/node_modules/express/lib/response.js:278:15)\n    at ServerResponse.send (/app/node_modules/express/lib/response.js:162:21)\n    at abortMessage (/app/api/server/middleware/abortMiddleware.js:30:28)\n    at handleAbortError (/app/api/server/middleware/abortMiddleware.js:214:20)\n    at AskController (/app/api/server/controllers/AskController.js:152:5)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"data":{"detail":"404: One or more IDs not found"},"headers":{"content-length":"43","content-type":"application/json","date":"Fri, 07 Feb 2025 00:57:36 GMT","server":"uvicorn"},"level":"error","message":"Error deleting vectors The request was made and the server responded with a status code that falls out of the range of 2xx: Request failed with status code 500. Error response data:\n","status":500}
{"level":"error","message":"Error deleting file Request failed with status code 500","stack":"Error: Request failed with status code 500\n    at deleteVectors (/app/api/server/services/Files/VectorDB/crud.js:40:11)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async Promise.allSettled (index 0)\n    at async processDeleteRequest (/app/api/server/services/Files/process.js:223:3)\n    at async /app/api/server/routes/files/files.js:95:5"}
{"data":{"detail":"404: One or more IDs not found"},"headers":{"content-length":"43","content-type":"application/json","date":"Fri, 07 Feb 2025 00:57:58 GMT","server":"uvicorn"},"level":"error","message":"Error deleting vectors The request was made and the server responded with a status code that falls out of the range of 2xx: Request failed with status code 500. Error response data:\n","status":500}
{"level":"error","message":"Error deleting file Request failed with status code 500","stack":"Error: Request failed with status code 500\n    at deleteVectors (/app/api/server/services/Files/VectorDB/crud.js:40:11)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async Promise.allSettled (index 0)\n    at async processDeleteRequest (/app/api/server/services/Files/process.js:223:3)\n    at async deleteUserFiles (/app/api/server/controllers/UserController.js:54:5)\n    at async deleteUserController (/app/api/server/controllers/UserController.js:125:5)"}
{"cause":{},"level":"error"}
{"level":"error","message":"[OpenAIClient.chatCompletion] Unhandled error type Cannot read properties of undefined (reading 'content')","stack":"TypeError: Cannot read properties of undefined (reading 'content')\n    at SplitStreamHandler.handle (/app/api/node_modules/@librechat/agents/dist/cjs/splitStream.cjs:134:50)\n    at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:1376:30)\n    at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:583:15)\n    at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:652:24)\n    at async AskController (/app/api/server/controllers/AskController.js:105:20)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"level":"error","message":"[handleAbortError] AI response error; aborting request: Cannot read properties of undefined (reading 'content')","stack":"TypeError: Cannot read properties of undefined (reading 'content')\n    at SplitStreamHandler.handle (/app/api/node_modules/@librechat/agents/dist/cjs/splitStream.cjs:134:50)\n    at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:1376:30)\n    at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:583:15)\n    at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:652:24)\n    at async AskController (/app/api/server/controllers/AskController.js:105:20)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}
{"code":"ERR_HTTP_HEADERS_SENT","level":"error","message":"[handleAbortError] error while trying to abort message Cannot set headers after they are sent to the client","stack":"Error [ERR_HTTP_HEADERS_SENT]: Cannot set headers after they are sent to the client\n    at ServerResponse.setHeader (node:_http_outgoing:655:11)\n    at ServerResponse.header (/app/node_modules/express/lib/response.js:794:10)\n    at ServerResponse.send (/app/node_modules/express/lib/response.js:174:12)\n    at ServerResponse.json (/app/node_modules/express/lib/response.js:278:15)\n    at ServerResponse.send (/app/node_modules/express/lib/response.js:162:21)\n    at abortMessage (/app/api/server/middleware/abortMiddleware.js:30:28)\n    at handleAbortError (/app/api/server/middleware/abortMiddleware.js:214:20)\n    at AskController (/app/api/server/controllers/AskController.js:152:5)\n    at async /app/api/server/routes/ask/openAI.js:24:5"}

Hope you can help me

[jmartinezb3]

Some error messages for debug file:

2025-02-07T00:22:07.855Z debug: Making request to https://myresource.openai.azure.com/openai/deployments/gpt-4o_2024-11-20/chat/completions?api-version=2025-01-01-preview
2025-02-07T00:22:07.861Z debug: [saveConvo] api/app/clients/BaseClient.js - saveMessageToDatabase #saveConvo
2025-02-07T00:22:08.133Z warn: [OpenAIClient.chatCompletion][stream] Unhandled error type
2025-02-07T00:22:08.135Z error
2025-02-07T00:22:08.439Z error: [OpenAIClient.chatCompletion] Unhandled error type Cannot read properties of undefined (reading 'content')
2025-02-07T00:22:08.440Z error: [handleAbortError] AI response error; aborting request: Cannot read properties of undefined (reading 'content')
2025-02-07T00:22:08.441Z error: [handleAbortError] error while trying to abort message Cannot set headers after they are sent to the client
2025-02-07T00:22:12.126Z debug: [AskController] Request closed
2025-02-07T00:22:35.078Z debug: [indexSync] Clearing sync timeouts before exiting...
2025-02-07T00:23:09.701Z info: [Optional] Redis not initialized. Note: Redis support is experimental.
2025-02-07T00:23:12.695Z info: Connected to MongoDB
2025-02-07T00:23:13.055Z debug: [indexSync] There are 8 messages and 4 indexed
2025-02-07T00:23:13.056Z debug: [indexSync] There are 3 convos and 3 indexed
2025-02-07T00:23:13.056Z debug: [indexSync] Messages out of sync, indexing
2025-02-07T00:23:13.105Z info: Custom config file loaded:
2025-02-07T00:23:13.106Z info: {

@danny-avila

[jmartinezb3]

Error resolved; I believe there is a conflict when having multiple sessions open with the same user. Since I was testing, I didn't notice this. However, it's a good discovery to keep in mind for a future update.

@danny-avila Thanks for all your hard work :)