Skip to content

qserve is slower then awq int4 for llama2-7b on H100 #304

qserve is slower then awq int4 for llama2-7b on H100

qserve is slower then awq int4 for llama2-7b on H100 #304

Triggered via issue January 4, 2025 13:23
@KKwanheeKKwanhee
commented on #2509 be17881
Status Skipped
Total duration 4s
Artifacts

blossom-ci.yml

on: issue_comment
Authorization
0s
Authorization
Upload log
0s
Upload log
Vulnerability scan
0s
Vulnerability scan
Start ci job
0s
Start ci job
Fit to window
Zoom out
Zoom in