Skip to content

Commit

Permalink
fix host script
Browse files Browse the repository at this point in the history
  • Loading branch information
mmoskal committed Feb 23, 2024
1 parent ae9c35d commit f997ad9
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scripts/host.sh
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ if [ "$INNER" = "model" ] ; then
PREF="cd $FOLDER && CUDA_VISIBLE_DEVICES=$CUDA_VISIBLE_DEVICES"
ARGS="--port $FWD_PORT --shm-prefix /aici-${MODEL}-"
if [ "$CPP" -eq 1 ] ; then
docker_cmd "$PREF /workspaces/aici/rllm/rllm-llamacpp/cpp-server.sh --loop --cuda $MODEL $ARGS"
docker_cmd "$PREF /workspaces/aici/rllm/rllm-llamacpp/server.sh --loop --cuda $MODEL $ARGS"
else
docker_cmd "$PREF /workspaces/aici/rllm/rllm-cuda/server.sh --loop $MODEL $ARGS"
fi
Expand Down

0 comments on commit f997ad9

Please sign in to comment.