map_dataset.setup() keeps crashing #118
Description
Describe the bug
I am trying to run the extreme events file present in src/climate_learn/data/processing/era5_extreme.py, but the map_dataset.setup() function keeps crashing. It is using more than 12 GB RAM and crashes after that.
Please suggest a solution.
Thank you in advance!
Environment
- OS: Ubuntu
- Environment: conda
I even tried it on colab pro.