[Core] Enhance memory profiling in determine_num_available_blocks with error handling and fallback#9996

Open

Ahmed14z wants to merge 8 commits intovllm-project:mainfrom Ahmed14z:fix-9232

+33-23

Commits on Nov 4, 2024

[Core] Enhance memory profiling in determine_num_available_blocks (vllm-project#9232 )
Ahmed14z
committed
[Core] Refactor memory profiling based on review feedback
Ahmed14z
committed
Revert "[Core] Enhance memory profiling in determine_num_available_blocks (vllm-project#9232 )"
Ahmed14z
committed
[Lint] Refactor logging to remove f-string usage for compliance
Ahmed14z
committed
[Lint] Adjust logging to use % formatting for compliance
Ahmed14z
committed
[Core] Revert previous implementation and update worker to check for GPU blocks override
Ahmed14z
committed
[Core] Revert previous implementation and update worker to check for GPU blocks override
Ahmed14z
committed
[Lint] Adjust logging to be less than 80
Ahmed14z
committed