Engdocs 2499 #22296
Engdocs 2499 #22296
Conversation
github-actions
bot
added
the
area/desktop
✅ Deploy Preview for docsdocker ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
| Example: | ||
|
|
||
| ```console | ||
| $ docker model pull ignaciolopezluna020/llama3.2:1b |
There was a problem hiding this comment.
I think we want to replace this with "ai/".
I perfectly understand why this is not done yet (we are publishing the models now in the "ai" namespace) but for the final release, we want to use the final namespace.
CC @aevesdocker
|
|
||
| ```text | ||
| Downloaded: 626.05 MB | ||
| Model ignaciolopezluna020/llama3.2:1b pulled successfully |
There was a problem hiding this comment.
Same as above: I think we want to replace this with "ai/".
| #### One-time prompt | ||
|
|
||
| ```console | ||
| $ docker model run ignaciolopezluna020/llama3.2:1b "Hi" |
There was a problem hiding this comment.
Same as above: I think we want to replace this with "ai/".
| #### Interactive chat | ||
|
|
||
| ```console | ||
| docker model run ignaciolopezluna020/llama3.2:1b |
There was a problem hiding this comment.
Same as above: I think we want to replace this with "ai/".
| 1. Pull the required model from Docker Hub so it's ready for use in your app. | ||
|
|
||
| ```console | ||
| $ docker model pull ignaciolopezluna020/llama3.2:1b |
There was a problem hiding this comment.
Same as above: I think we want to replace this with "ai/".
| curl http://model-runner.docker.internal/engines/llama.cpp/v1/chat/completions \ | ||
| -H "Content-Type: application/json" \ | ||
| -d '{ | ||
| "model": "ignaciolopezluna020/llama3.2:1b", |
There was a problem hiding this comment.
Same as above: I think we want to replace this with "ai/".
| localhost/exp/vDD4.40/engines/llama.cpp/v1/chat/completions \ | ||
| -H "Content-Type: application/json" \ | ||
| -d '{ | ||
| "model": "ignaciolopezluna020/llama3.2:1b", |
There was a problem hiding this comment.
Same as above: I think we want to replace this with "ai/".
| curl http://localhost:8080/engines/llama.cpp/v1/chat/completions \ | ||
| -H "Content-Type: application/json" \ | ||
| -d '{ | ||
| "model": "ignaciolopezluna020/llama3.2:1b", |
There was a problem hiding this comment.
Same as above: I think we want to replace this with "ai/".
| Docker Model Runner: | ||
| availability: Beta | ||
| requires: Docker Desktop 4.40 and later | ||
| for: Docker Desktop for Mac with Apple Silicon |
There was a problem hiding this comment.
should we add another line for the summary bar? or the ability to populate the "Admin" symbol only if a keyword is there? it looks a little wonky in the summary bar with the Admin shield icon
There was a problem hiding this comment.
also, I can help with this if you'd like me to add this!
There was a problem hiding this comment.
If you have the bandwidth @sarahsanders-docker, that'd be so helpful, thank you
There was a problem hiding this comment.
yep I can spin this up quick!
aevesdocker
force-pushed
the
ENGDOCS-2499
branch
from
fd21824 to
b8cca14
Compare
4 participants
Description
Related issues or tickets
Reviews