Skip to content

Pull requests: basetenlabs/truss-examples

New pull request New
55 Open 326 Closed
55 Open 326 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: support deepseek v2.5 1210 with sglang
#391 opened Dec 18, 2024 by zhyncs Loading…
1
text-embeddings-inference updated example trussless
#386 opened Dec 6, 2024 by michaelfeil Loading…
@vshulman
22
Added Qwen 2.5 7B Instruct
#368 opened Oct 18, 2024 by dsarfati Loading…
1
added llama 3.2 vision 11b instruct
#356 opened Sep 25, 2024 by dsingal0 Loading…
1
Cancel pipeline. Doesn't work for request canlleations yet
#354 opened Sep 24, 2024 by marius-baseten • Draft
1
Updating faster whisper v2 to use batching
#353 opened Sep 20, 2024 by htrivedi99 Loading…
reproduce oom
#339 opened Aug 20, 2024 by tianshuc0731 • Draft
add max tokens to llama 3.1 example
#337 opened Aug 19, 2024 by philipkiely-baseten Loading…
1
added segment anything 2
#333 opened Aug 4, 2024 by dsingal0 Loading…
Update README.md for direct bridge ultravox
#329 opened Jul 23, 2024 by vshulman Loading…
Adding vllm speculative decoding example
#317 opened Jul 1, 2024 by htrivedi99 Loading…
5
Update GPU count on README.md
#314 opened Jun 26, 2024 by vshulman Loading…
[Droid] Integrate Florence-2-Large Model
#309 opened Jun 20, 2024 by factory-droid bot Loading…
5
Constrained decoding
#302 opened May 27, 2024 by kchatr Loading…
adding higher context llama 3 TRT engine
#293 opened May 13, 2024 by vshulman • Draft
Llama 3 ChatQA 1.5 in 8B and 70B
#292 opened May 7, 2024 by philipkiely-baseten Loading…
@amiruci @htrivedi99
updating mistral vllm implementation to 0.2 + adding support for hf token
#286 opened May 2, 2024 by vshulman Loading…
[Droid] DBRX Truss Implementation
#283 opened May 1, 2024 by factory-droid bot Loading…
4
Add truss example for Qwen1.5-110B with vllm & streaming support
#282 opened May 1, 2024 by ImmarKarim Loading…
13
DistilBERT
#269 opened Apr 18, 2024 by bolasim Loading…
[Droid] Add Truss Example for Databricks DBRX-Instruct Model
#264 opened Apr 17, 2024 by factory-droid bot Loading…
2
[Droid] Add DBRX-Instruct Truss Example
#263 opened Apr 17, 2024 by factory-droid bot Loading…
1
Update mistral-chat to v02 to enable larger context window
#255 opened Apr 5, 2024 by vshulman Loading…
[Droid] Update Natural SQL 7B Model and Dependencies
#254 opened Apr 3, 2024 by factory-droid bot Loading…
1
Abuqader/solar
#249 opened Mar 30, 2024 by aspctu • Draft
ProTip! Adding no:label will show everything without a label.