Skip to content

Pull requests: triton-inference-server/triton_distributed

New pull request New
31 Open 200 Closed
31 Open 200 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

ci: build wheel from root directory
#274 opened Feb 25, 2025 by nv-anants Loading…
20 tasks
fix: Make the CI codespell be a warning not a fatal error bug Something isn't working
#272 opened Feb 25, 2025 by grahamking Loading…
@grahamking
refactor: endpoint -> function
#270 opened Feb 25, 2025 by ryanolson Loading…
1 of 20 tasks
10
feat: zmq starter
#266 opened Feb 25, 2025 by ryanolson Loading…
20 tasks
refactor: using async_openai::types::CreateChatCompletionRequest by flattening with serde enhancement New feature or request
#261 opened Feb 25, 2025 by paulhendricks • Draft
5 of 20 tasks
@paulhendricks
3
feat: Add HTTP completions endpoint to kv router example
#258 opened Feb 25, 2025 by sshchoi Loading…
2 of 20 tasks
@sshchoi
16
feat: add "nova" to the bento config
#256 opened Feb 24, 2025 by hhzhang16 Loading…
3 of 20 tasks
Add single node benchmarks for vLLM Rust engine.
#253 opened Feb 24, 2025 by piotrm-nvidia Loading…
14
feat: add python binding for rust llm modules
#252 opened Feb 24, 2025 by biswapanda Loading…
7 of 24 tasks
2
[DO NOT MERGE] vllm nixl documentation Improvements or additions to documentation
#245 opened Feb 22, 2025 by ptarasiewiczNV • Draft
20 tasks
2
ci: initial public ci for PRs
#241 opened Feb 22, 2025 by saturley-hall Loading…
1 of 20 tasks
27
feat: pull-based prefill queue
#228 opened Feb 21, 2025 by tedzhouhk Loading…
3 of 20 tasks
14
ci: read push options in ci trigger
#220 opened Feb 20, 2025 by nv-anants • Draft
20 tasks
feat: planner
#210 opened Feb 19, 2025 by ryanolson • Draft
3 of 20 tasks
feat: naive heuristic disagg router
#209 opened Feb 19, 2025 by tedzhouhk • Draft
3 of 20 tasks
feat: add two scripts to start disagg workers on a single node/multiple nodes
#200 opened Feb 18, 2025 by tedzhouhk • Draft
4 of 20 tasks
[feat, refactor] Weighted random endpoint selection; refactor request sending
#194 opened Feb 16, 2025 by jthomson04 • Draft
perf: [PoC] multi process Triton distributed runtime
#191 opened Feb 14, 2025 by kthui • Draft
20 tasks
@kthui
refactor: Proposal to refactor protocols using async-openai
#190 opened Feb 14, 2025 by paulhendricks • Draft
3 of 20 tasks
1
refactor: Remove secondary runtime and lease enhancement New feature or request
#185 opened Feb 14, 2025 by grahamking Loading…
1
1
feat: LLM API example integration enhancement New feature or request
#182 opened Feb 14, 2025 by tanmayv25 Loading…
5 of 20 tasks
@rmccorm4
7
[DRAFT] feat(disaggregation): add nova-init scripts for VLLM disaggregation
#180 opened Feb 14, 2025 by ishandhanani • Draft
20 tasks
build(deps): bump transformers from 4.45.2 to 4.48.3 dependencies Pull requests that update a dependency file
#168 opened Feb 12, 2025 by dependabot bot Loading…
1
chore: moving to llm example folder
#163 opened Feb 11, 2025 by nnshah1 • Draft
20 tasks
nnshah1 objects 2 testing new UX
#162 opened Feb 11, 2025 by nnshah1 • Draft
20 tasks
ProTip! What’s not been updated in a month: updated:<2025-01-26.