[Bugfix][Core] Use torch.cuda.memory_stats() to profile peak memory usage#9352

Merged

tlrmchlsmth merged 11 commits intovllm-project:mainfrom joerunde:measure-peak-memory

Oct 18, 2024

+122-17

Commits on Oct 14, 2024