Prefix Cache Aware Scheduling #5
Annotations
7 errors
|
|
|
Mypy:
vllm/core/block/naive_block.py#L463
Argument 1 of "set_content_hash" is incompatible with supertype "Block"; supertype defines the argument type as "Optional[int]" [override]
|
|
Mypy:
vllm/core/block/block_table.py#L300
Unexpected keyword argument "block_hashes" for "allocate_immutable_blocks" of "DeviceAwareBlockAllocator" [call-arg]
|
|
Mypy:
vllm/core/block/prefix_caching_block.py#L186
Argument 3 of "allocate_immutable_blocks" is incompatible with supertype "BlockAllocator"; supertype defines the argument type as "Optional[List[Optional[int]]]" [override]
|
|
Mypy:
vllm/core/block/prefix_caching_block.py#L701
Unexpected keyword argument "key" for "bisect_left" [call-arg]
|
|
Mypy:
vllm/core/block/cpu_gpu_block_allocator.py#L370
Signature of "append_token_ids" incompatible with supertype "Block" [override]
|
|
Mypy
Process completed with exit code 1.
|
Loading