ConnectionRefusedError

[yangc]

Hello,

I was trying your https://github.com/langchain-ai/langgraph/blob/main/examples/rag/langgraph_rag_agent_llama3_local.ipynb via google colab, after plugging my own langchain api key, everything was fine until I executed print(retrieval_grader.invoke({"question": question, "document": doc_txt})), and got the following error:

ConnectionRefusedError Traceback (most recent call last)
/usr/local/lib/python3.10/dist-packages/urllib3/connection.py in _new_conn(self)
202 try:
--> 203 sock = connection.create_connection(
204 (self._dns_host, self.port),

28 frames
ConnectionRefusedError: [Errno 111] Connection refused

The above exception was the direct cause of the following exception:

NewConnectionError Traceback (most recent call last)
NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fccddf274c0>: Failed to establish a new connection: [Errno 111] Connection refused

The above exception was the direct cause of the following exception:

MaxRetryError Traceback (most recent call last)
MaxRetryError: HTTPConnectionPool(host='localhost', port=11434): Max retries exceeded with url: /api/chat (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fccddf274c0>: Failed to establish a new connection: [Errno 111] Connection refused'))

During handling of the above exception, another exception occurred:

ConnectionError Traceback (most recent call last)
/usr/local/lib/python3.10/dist-packages/requests/adapters.py in send(self, request, stream, timeout, verify, cert, proxies)
517 raise SSLError(e, request=request)
518
--> 519 raise ConnectionError(e, request=request)
520
521 except ClosedPoolError as e:

ConnectionError: HTTPConnectionPool(host='localhost', port=11434): Max retries exceeded with url: /api/chat (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fccddf274c0>: Failed to establish a new connection: [Errno 111] Connection refused'))

Could you help clarify how to resolve this?

Thanks,
Yang

[yangc]

Hello,

Could you share your thoughts on this issue? I would really value your insights!

Yang

[hinthornw]

It looks like you are trying to connect to a localhost server that is misconfigured or that you haven't set up creds for

[yangc]

I was using https://github.com/langchain-ai/langgraph/blob/main/examples/rag/langgraph_rag_agent_llama3_local.ipynb almost as is except for plugging in my own langchain api key. Which creds needs to be set up here?

Thanks,
Yang

[hinthornw]

Is your ollama server running?

[yangc]

Yes, you are right. Once the ollama server is running, the problem is solved. Thanks!

[SampsonM]

I'm having the same issue but my local ollama server IS running.

This looks like the only error I'm getting, the formatting is rough!

"event":"Exception in ASGI application\n","logger":"uvicorn.error","level":"error","api_variant":"licensed","desktop":"0.0.12","api_revision":"09b9990","timestamp":"2024-08-14T12:54:21.969058Z","exception":"  + Exception Group Traceback (most recent call last):\n  |   File \"/usr/local/lib/python3.11/site-packages/starlette/_utils.py\", line 83, in collapse_excgroups\n  |     yield\n  |   File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py\", line 190, in __call__\n  |     async with anyio.create_task_group() as task_group:\n  |   File \"/usr/local/lib/python3.11/site-packages/anyio/_backends/_asyncio.py\", line 680, in __aexit__\n  |     raise BaseExceptionGroup(\n  | ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)\n  +-+---------------- 1 ----------------\n    | Traceback (most recent call last):\n    |   File \"/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py\", line 401, in run_asgi\n    |     result = await app(  # type: ignore[func-returns-value]\n    |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n    |   File \"/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py\", line 70, in __call__\n    |     return await self.app(scope, receive, send)\n    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/applications.py\", line 123, in __call__\n    |     await self.middleware_stack(scope, receive, send)\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py\", line 186, in __call__\n    |     raise exc\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py\", line 164, in __call__\n    |     await self.app(scope, receive, _send)\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py\", line 93, in __call__\n    |     await self.simple_response(scope, receive, send, request_headers=headers)\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py\", line 148, in simple_response\n    |     await self.app(scope, receive, send)\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py\", line 189, in __call__\n    |     with collapse_excgroups():\n    |   File \"/usr/local/lib/python3.11/contextlib.py\", line 158, in __exit__\n    |     self.gen.throw(typ, value, traceback)\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/_utils.py\", line 89, in collapse_excgroups\n    |     raise exc\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py\", line 191, in __call__\n    |     response = await self.dispatch_func(request, call_next)\n    |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n    |   File \"/usr/local/lib/python3.11/site-packages/langgraph_license/middleware.py\", line 25, in dispatch\n    |     response = await call_next(request)\n    |                ^^^^^^^^^^^^^^^^^^^^^^^^\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py\", line 165, in call_next\n    |     raise app_exc\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py\", line 151, in coro\n    |     await self.app(scope, receive_or_disconnect, send_no_error)\n    |   File \"/api/langgraph_api/shared/http_logger.py\", line 38, in __call__\n    |   File \"/api/langgraph_api/shared/http_logger.py\", line 32, in __call__\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py\", line 65, in __call__\n    |     await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py\", line 64, in wrapped_app\n    |     raise exc\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py\", line 53, in wrapped_app\n    |     await app(scope, receive, sender)\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/routing.py\", line 754, in __call__\n    |     await self.middleware_stack(scope, receive, send)\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/routing.py\", line 774, in app\n    |     await route.handle(scope, receive, send)\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/routing.py\", line 483, in handle\n    |     await self.app(scope, receive, send)\n    |   File \"/api/langgraph_api/auth/middleware.py\", line 36, in __call__\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/authentication.py\", line 49, in __call__\n    |     await self.app(scope, receive, send)\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/routing.py\", line 754, in __call__\n    |     await self.middleware_stack(scope, receive, send)\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/routing.py\", line 774, in app\n    |     await route.handle(scope, receive, send)\n    |   File \"/api/langgraph_api/shared/route.py\", line 120, in handle\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/routing.py\", line 295, in handle\n    |     await self.app(scope, receive, send)\n    |   File \"/api/langgraph_api/shared/route.py\", line 37, in app\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py\", line 64, in wrapped_app\n    |     raise exc\n    |   File \"/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py\", line 53, in wrapped_app\n    |     await app(scope, receive, sender)\n    |   File \"/api/langgraph_api/shared/route.py\", line 32, in app\n    |   File \"/usr/local/lib/python3.11/site-packages/langgraph_storage/retry.py\", line 20, in wrapper\n    |     return await func(*args, **kwargs)\n    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n    |   File \"/api/langgraph_api/api/threads.py\", line 100, in update_thread_state\n    |   File \"/usr/local/lib/python3.11/site-packages/langgraph_storage/ops.py\", line 411, in post\n    |     return await graph.aupdate_state(\n    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^\n    |   File \"/usr/local/lib/python3.11/site-packages/langgraph/pregel/__init__.py\", line 710, in aupdate_state\n    |     await task.proc.ainvoke(\n    |   File \"/usr/local/lib/python3.11/site-packages/langchain_core/runnables/base.py\", line 2920, in ainvoke\n    |     input = await asyncio.create_task(part(), context=context)  # type: ignore\n    |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n    |   File \"/usr/local/lib/python3.11/site-packages/langgraph/utils.py\", line 124, in ainvoke\n    |     ret = await asyncio.create_task(\n    |           ^^^^^^^^^^^^^^^^^^^^^^^^^^\n    |   File \"/usr/local/lib/python3.11/site-packages/langgraph/graph/graph.py\", line 107, in _aroute\n    |     return self._finish(writer, input, result)\n    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n    |   File \"/usr/local/lib/python3.11/site-packages/langgraph/graph/graph.py\", line 115, in _finish\n    |     destinations = [r if isinstance(r, Send) else self.ends[r] for r in result]\n    |                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n    |   File \"/usr/local/lib/python3.11/site-packages/langgraph/graph/graph.py\", line 115, in <listcomp>\n    |     destinations = [r if isinstance(r, Send) else self.ends[r] for r in result]\n    |                                                   ~~~~~~~~~^^^\n    | KeyError: ''\n    +------------------------------------\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n  File \"/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py\", line 401, in run_asgi\n    result = await app(  # type: ignore[func-returns-value]\n             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py\", line 70, in __call__\n    return await self.app(scope, receive, send)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/starlette/applications.py\", line 123, in __call__\n    await self.middleware_stack(scope, receive, send)\n  File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py\", line 186, in __call__\n    raise exc\n  File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py\", line 164, in __call__\n    await self.app(scope, receive, _send)\n  File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py\", line 93, in __call__\n    await self.simple_response(scope, receive, send, request_headers=headers)\n  File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py\", line 148, in simple_response\n    await self.app(scope, receive, send)\n  File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py\", line 189, in __call__\n    with collapse_excgroups():\n  File \"/usr/local/lib/python3.11/contextlib.py\", line 158, in __exit__\n    self.gen.throw(typ, value, traceback)\n  File \"/usr/local/lib/python3.11/site-packages/starlette/_utils.py\", line 89, in collapse_excgroups\n    raise exc\n  File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py\", line 191, in __call__\n    response = await self.dispatch_func(request, call_next)\n               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/langgraph_license/middleware.py\", line 25, in dispatch\n    response = await call_next(request)\n               ^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py\", line 165, in call_next\n    raise app_exc\n  File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py\", line 151, in coro\n    await self.app(scope, receive_or_disconnect, send_no_error)\n  File \"/api/langgraph_api/shared/http_logger.py\", line 38, in __call__\n  File \"/api/langgraph_api/shared/http_logger.py\", line 32, in __call__\n  File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py\", line 65, in __call__\n    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)\n  File \"/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py\", line 64, in wrapped_app\n    raise exc\n  File \"/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py\", line 53, in wrapped_app\n    await app(scope, receive, sender)\n  File \"/usr/local/lib/python3.11/site-packages/starlette/routing.py\", line 754, in __call__\n    await self.middleware_stack(scope, receive, send)\n  File \"/usr/local/lib/python3.11/site-packages/starlette/routing.py\", line 774, in app\n    await route.handle(scope, receive, send)\n  File \"/usr/local/lib/python3.11/site-packages/starlette/routing.py\", line 483, in handle\n    await self.app(scope, receive, send)\n  File \"/api/langgraph_api/auth/middleware.py\", line 36, in __call__\n  File \"/usr/local/lib/python3.11/site-packages/starlette/middleware/authentication.py\", line 49, in __call__\n    await self.app(scope, receive, send)\n  File \"/usr/local/lib/python3.11/site-packages/starlette/routing.py\", line 754, in __call__\n    await self.middleware_stack(scope, receive, send)\n  File \"/usr/local/lib/python3.11/site-packages/starlette/routing.py\", line 774, in app\n    await route.handle(scope, receive, send)\n  File \"/api/langgraph_api/shared/route.py\", line 120, in handle\n  File \"/usr/local/lib/python3.11/site-packages/starlette/routing.py\", line 295, in handle\n    await self.app(scope, receive, send)\n  File \"/api/langgraph_api/shared/route.py\", line 37, in app\n  File \"/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py\", line 64, in wrapped_app\n    raise exc\n  File \"/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py\", line 53, in wrapped_app\n    await app(scope, receive, sender)\n  File \"/api/langgraph_api/shared/route.py\", line 32, in app\n  File \"/usr/local/lib/python3.11/site-packages/langgraph_storage/retry.py\", line 20, in wrapper\n    return await func(*args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/api/langgraph_api/api/threads.py\", line 100, in update_thread_state\n  File \"/usr/local/lib/python3.11/site-packages/langgraph_storage/ops.py\", line 411, in post\n    return await graph.aupdate_state(\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/langgraph/pregel/__init__.py\", line 710, in aupdate_state\n    await task.proc.ainvoke(\n  File \"/usr/local/lib/python3.11/site-packages/langchain_core/runnables/base.py\", line 2920, in ainvoke\n    input = await asyncio.create_task(part(), context=context)  # type: ignore\n            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/langgraph/utils.py\", line 124, in ainvoke\n    ret = await asyncio.create_task(\n          ^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/langgraph/graph/graph.py\", line 107, in _aroute\n    return self._finish(writer, input, result)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/langgraph/graph/graph.py\", line 115, in _finish\n    destinations = [r if isinstance(r, Send) else self.ends[r] for r in result]\n                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/langgraph/graph/graph.py\", line 115, in <listcomp>\n    destinations = [r if isinstance(r, Send) else self.ends[r] for r in result]\n                                                  ~~~~~~~~~^^^\nKeyError: ''","lineno":406,"func_name":"run_asgi","filename":"httptools_impl.py"}

[Abdellahbado]

For anyone encountering this error in the future:

I faced the same issue even though Ollama was running correctly. The problem was that LangGraph was running inside a container, which meant it couldn't access Ollama without additional configuration. Here's how I resolved it:

Update ChatOllama Configuration:
Set the base_url to http://host.docker.internal:11434 in your ChatOllama setup.

Modify docker-compose.yml:
Add a docker-compose.yml file with the following configuration to allow the container to access the host network:

version: '3'
services:
langgraph-api:
image: langfuse/langgraph-studio
extra_hosts:
- "host.docker.internal:host-gateway"
ports:
- "3000:3000"