multiple requests #811
Unanswered
jannikstdl
asked this question in
Q&A
multiple requests
#811
Replies: 1 comment
-
|
That's what I was thinking too, considering ggml models are not thread-safe |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Can LocalAI handle multiple requests at the same time?
Beta Was this translation helpful? Give feedback.
All reactions