File tree 1 file changed +2
-1
lines changed 1 file changed +2
-1
lines changed Original file line number Diff line number Diff line change @@ -17,7 +17,8 @@ It is [microsoft/Phi-3.5-mini-instruct](https://huggingface.co/microsoft/Phi-3.5
17
17
** Required:** Docker Engine installed
18
18
19
19
``` bash
20
- docker run -d --device /dev/dri --group-add=$( stat -c " %g" /dev/dri/render* ) --rm -p 8000:8000 -v $( pwd) /models:/models:rw openvino/model_server:latest-gpu --source_model OpenVINO/Phi-3.5-mini-instruct-int4-ov --model_repository_path models --rest_port 8000 --target_device GPU --cache_size 2
20
+ mkdir models
21
+ docker run --user $( id -u) :$( id -g) -d --device /dev/dri --group-add=$( stat -c " %g" /dev/dri/render* ) --rm -p 8000:8000 -v $( pwd) /models:/models:rw openvino/model_server:latest-gpu --source_model OpenVINO/Phi-3.5-mini-instruct-int4-ov --model_repository_path models --rest_port 8000 --target_device GPU --cache_size 2
21
22
```
22
23
:::
23
24
You can’t perform that action at this time.
0 commit comments