Skip to content

Commit

Permalink
Fix the type of paged_kv_cache in append (#597)
Browse files Browse the repository at this point in the history
The type is adjusted to be consistent with the prefill/decode wrappers.
  • Loading branch information
nandor authored Nov 8, 2024
1 parent 3467617 commit f5621d3
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion python/flashinfer/page.py
Original file line number Diff line number Diff line change
Expand Up @@ -197,7 +197,7 @@ def append_paged_kv_cache(
append_value: torch.Tensor,
batch_indices: torch.Tensor,
positions: torch.Tensor,
paged_kv_cache: torch.Tensor,
paged_kv_cache: Union[torch.Tensor, Tuple[torch.Tensor, torch.Tensor]],
kv_indices: torch.Tensor,
kv_indptr: torch.Tensor,
kv_last_page_len: torch.Tensor,
Expand Down

0 comments on commit f5621d3

Please sign in to comment.