Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Print out the amount of GPU memory used at the end of each time step #322

Merged
merged 2 commits into from
Sep 7, 2023

Conversation

bcaddy
Copy link
Collaborator

@bcaddy bcaddy commented Aug 25, 2023

Summary

When CPU_TIME is enabled Cholla now prints out how much GPU memory is allocated at the end of each time step. To do this I added new functions, Reduce_size_t_Max an Print_GPU_Memory_Usage, to determine the maximum amount of memory used on any GPU and print that information out. The motivation was to determine how many cells we can fit on a given GPU with a given Cholla configuration easily. Early tests show that on Frontier we can fit about 457^3 cells per GPU in an MHD only build.

@bcaddy bcaddy force-pushed the dev-memoryHighWater branch from 4a22667 to 80b3d19 Compare August 25, 2023 20:53
@evaneschneider
Copy link
Collaborator

Looks good!

@evaneschneider evaneschneider merged commit 7233ad9 into cholla-hydro:dev Sep 7, 2023
@bcaddy bcaddy deleted the dev-memoryHighWater branch September 11, 2023 16:04
@bcaddy bcaddy linked an issue Oct 27, 2023 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

What should we do about device memory checking?
2 participants