Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
bugfix: Fix MLA decode error having v_scale without return_lse (#650)
``` [rank0]: File "/home/simonmo/.conda/envs/vllm/lib/python3.10/site-packages/flashinfer/decode.py", line 1408, in run [rank0]: out[0] *= v_scale [rank0]: TypeError: 'tuple' object does not support item assignment ``` This is saying `out[0]` does not allow mutation.
- Loading branch information