From 182cdaa47c2c9b7d3dbc309e80b34816878803f5 Mon Sep 17 00:00:00 2001 From: youkaichao Date: Wed, 26 Jun 2024 14:57:12 -0700 Subject: [PATCH] [doc] update usage of env var to avoid conflict (#5873) --- docs/source/serving/env_vars.rst | 3 +++ 1 file changed, 3 insertions(+) diff --git a/docs/source/serving/env_vars.rst b/docs/source/serving/env_vars.rst index 0ce1374a3967b..c665b60b471a6 100644 --- a/docs/source/serving/env_vars.rst +++ b/docs/source/serving/env_vars.rst @@ -3,6 +3,9 @@ Environment Variables vLLM uses the following environment variables to configure the system: +.. warning:: + Please note that ``VLLM_PORT`` and ``VLLM_HOST_IP`` set the port and ip for vLLM's **internal usage**. It is not the port and ip for the API server. If you use ``--host $VLLM_HOST_IP`` and ``--port $VLLM_PORT`` to start the API server, it will not work. + .. literalinclude:: ../../../vllm/envs.py :language: python :start-after: begin-env-vars-definition