Skip to content

unable to connect to triton server #1823

Discussion options

You must be logged in to vote

@srisudha-alt You shouldn't have to build the release container since you have already pulled it down. You should only have to fetch the models from Git LFS. So the steps for 24.06 should be:

Set up Triton container

Perform these steps on host:

  1. Install Git LFS
  2. Clone Morpheus, checkout branch-24.06 and fetch models from Git LFS:
git clone -b branch-24.06 https://github.com/nv-morpheus/Morpheus.git
cd Morpheus
git lfs install
./scripts/fetch_data.py fetch all
  1. Start Triton and load nvsmi model.
docker run --rm -ti --gpus=all -p8000:8000 -p8001:8001 -p8002:8002 -v $PWD/models:/models nvcr.io/nvidia/tritonserver:23.06-py3 tritonserver --model-repository=/models/triton-model-repo --exit-on…

Replies: 4 comments 3 replies

Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
3 replies
@srisudha-alt
Comment options

@efajardo-nv
Comment options

Answer selected by srisudha-alt
@srisudha-alt
Comment options

Comment options

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
2 participants