-
Notifications
You must be signed in to change notification settings - Fork 11
Issues: FasterDecoding/REST
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
If I want to change REST code to support multi-batch inference, what needs to be changed?
#16
opened May 20, 2024 by
yangbohust
ValueError: draft_choices was not cut enough / draft_len should not exceed 65
#13
opened May 8, 2024 by
yangbohust
ProTip!
What’s not been updated in a month: updated:<2024-11-19.