Swapped StatelessExecutor
to use llama_decode
!
#759
Job | Run time |
---|---|
2m 12s | |
3m 24s | |
3m 56s | |
9m 32s |
StatelessExecutor
to use llama_decode
!
#759
Job | Run time |
---|---|
2m 12s | |
3m 24s | |
3m 56s | |
9m 32s |