Compatibility with vLLM with tensor_parallel_size argument (#805)
#234
| Job | Run time |
|---|---|
| 1m 12s | |
| 1m 12s |
vLLM with tensor_parallel_size argument (#805)
#234
| Job | Run time |
|---|---|
| 1m 12s | |
| 1m 12s |