Skip to content

Issues: pytorch/serve

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

382 Open 1,273 Closed
382 Open 1,273 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

How can a user specify an envelope?
#3391 opened Feb 14, 2025 by yurkoff-mv
Reference to Nvidia MPS in README.md references a non-existent file
#3389 opened Feb 13, 2025 by cipherself
1
please add java api cli to generate model archiver mar file or tell the generate logic
#3386 opened Feb 9, 2025 by mullerhai
ROCm support missing from Dockerfile module: rocm
#3380 opened Jan 7, 2025 by jakki-amd
1
Clarify interactions between TorchServe and KServe
#3378 opened Dec 26, 2024 by kimminw00
1
Torchserve-kfs docker images for other python version (3.10+)
#3374 opened Dec 12, 2024 by cjidboon94
3
vLLM ZeroDivisionError
#3373 opened Dec 10, 2024 by mfahadyousaf
Quickstart vLLM examples do not work as expected
#3365 opened Nov 18, 2024 by prashant-warrier-echelonvi
Unable to build frontend after following the documentation
#3364 opened Nov 11, 2024 by mihaidusmanu
Trying to find a doc explaining how the scaling works (min_worker to max_worker)
#3362 opened Nov 9, 2024 by lschaupp
Issue when sending parallel requests
#3361 opened Nov 8, 2024 by lschaupp
1
weights_only default flip for torch.load
#3360 opened Nov 7, 2024 by mikaylagawarecki
Low Throughput and High Latency with TorchServe Deployment on AWS
#3359 opened Nov 6, 2024 by dummyuser-123
Model & Instance scaling
#3358 opened Nov 5, 2024 by markcNewell
413 Request Entity Too Large
#3357 opened Nov 5, 2024 by pengxin233
1
Allow to provide custom model_service_worker.py
#3353 opened Oct 23, 2024 by racinmat
Make TorchServe usable without torch installed
#3350 opened Oct 21, 2024 by racinmat
1
Error in MetricCollector when starting pytorch/torchserve:0.12.0-gpu container
#3349 opened Oct 19, 2024 by Hspix
Getting started guide client samples broken ?
#3348 opened Oct 15, 2024 by nikste
1
Add Detectron2 Support to TorchServe Object Detection Examples
#3344 opened Oct 9, 2024 by Mudassar-MLE
@Mudassar-MLE
3
Clarification on minWorkers and maxWorkers parameters
#3339 opened Oct 3, 2024 by krzwaraksa
throughput increase non-linearly with number of workers
#3338 opened Oct 3, 2024 by vandesa003
2
Kserve management api for registering new models question Further information is requested
#3325 opened Sep 20, 2024 by matej14086
@agunapal
"TorchServe Fails to Reload Models from S3 After k8s Pod Restart"
#3324 opened Sep 20, 2024 by koscevicb
1
CI: missing security check for security issues in the codebase
#3311 opened Sep 12, 2024 by ChengyuZhu6
1
1
ProTip! Find all open issues with in progress development work with linked:pr.