Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bugfix in distributed GPU tests and Distributed set! #3880

Open
wants to merge 43 commits into
base: main
Choose a base branch
from
Open

Bugfix in distributed GPU tests and Distributed set! #3880

wants to merge 43 commits into from
+90 −47

Commits on Oct 29, 2024

  1. fix pipeline

    @simone-silvestri
    simone-silvestri committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    5227a13 View commit details
    Browse the repository at this point in the history

  2. mpi test and gpu test

    @simone-silvestri
    simone-silvestri committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    1225061 View commit details
    Browse the repository at this point in the history

  3. do we need to precompile it inside?

    @simone-silvestri
    simone-silvestri committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    1652c6b View commit details
    Browse the repository at this point in the history

  4. precompile inside the node

    @simone-silvestri
    simone-silvestri committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    9323203 View commit details
    Browse the repository at this point in the history

  5. try previous climacommon version

    @simone-silvestri
    simone-silvestri committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    37b17ff View commit details
    Browse the repository at this point in the history

  6. go even more back

    @simone-silvestri
    simone-silvestri committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    2ac8cde View commit details
    Browse the repository at this point in the history

  7. use the ClimaOcean implementation

    @simone-silvestri
    simone-silvestri committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    0eb2720 View commit details
    Browse the repository at this point in the history

  8. using the ClimaOcean implementation

    @simone-silvestri
    simone-silvestri committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    50d0ec3 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. see if this test passes

    @simone-silvestri
    simone-silvestri committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    6e183bd View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. Merge branch 'main' into ss/fix-gpu-tests

    @simone-silvestri
    simone-silvestri authored Oct 31, 2024
    Configuration menu
    Copy the full SHA
    bd84d38 View commit details
    Browse the repository at this point in the history

  2. maybe precompiling before...

    @simone-silvestri
    simone-silvestri committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    c56b15b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'ss/fix-gpu-tests' of github.com:CliMA/Oceananigans.jl i… 

    …nto ss/fix-gpu-tests
    @simone-silvestri
    simone-silvestri committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    371a45b View commit details
    Browse the repository at this point in the history

  4. double O0

    @simone-silvestri
    simone-silvestri committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    e30973f View commit details
    Browse the repository at this point in the history

  5. back to previous clima_common

    @simone-silvestri
    simone-silvestri committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    e4cb16e View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. another quick test

    @simone-silvestri
    simone-silvestri committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    0c1f01c View commit details
    Browse the repository at this point in the history

  2. change environment

    @simone-silvestri
    simone-silvestri committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    bec1cd1 View commit details
    Browse the repository at this point in the history

  3. correct the utils

    @simone-silvestri
    simone-silvestri committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    75546af View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into ss/fix-gpu-tests

    @simone-silvestri
    simone-silvestri authored Nov 1, 2024
    Configuration menu
    Copy the full SHA
    5f49ec0 View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. this should load mpitrampoline

    @simone-silvestri
    simone-silvestri committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    9b334af View commit details
    Browse the repository at this point in the history

  2. Fix formatting

    @glwagner
    glwagner committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    f8c6401 View commit details
    Browse the repository at this point in the history

  3. Go back to latest climacommon

    @glwagner
    glwagner committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    1dc42bb View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. try adding Manifest

    @simone-silvestri
    simone-silvestri committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    5a870e7 View commit details
    Browse the repository at this point in the history

  2. Manifest from julia 1.10

    @simone-silvestri
    simone-silvestri committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    9e63f56 View commit details
    Browse the repository at this point in the history

  3. we probably need to initialize on a GPU

    @simone-silvestri
    simone-silvestri authored Nov 5, 2024
    Configuration menu
    Copy the full SHA
    59548f8 View commit details
    Browse the repository at this point in the history

  4. these options should not create problems

    @simone-silvestri
    simone-silvestri authored Nov 5, 2024
    Configuration menu
    Copy the full SHA
    642cfd9 View commit details
    Browse the repository at this point in the history

  5. let's see if this differs

    @simone-silvestri
    simone-silvestri committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    4cee49a View commit details
    Browse the repository at this point in the history

  6. just version infos

    @simone-silvestri
    simone-silvestri committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    a46b25d View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2024

  1. fiddling with O0

    @simone-silvestri
    simone-silvestri committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    4dffbe5 View commit details
    Browse the repository at this point in the history

  2. why are we using 8 threads?

    @simone-silvestri
    simone-silvestri committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    9c3c6cd View commit details
    Browse the repository at this point in the history

  3. memory requirements are not this huge

    @simone-silvestri
    simone-silvestri committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    3b28ecb View commit details
    Browse the repository at this point in the history

  4. speed up the precompilation a bit, to revert later

    @simone-silvestri
    simone-silvestri committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    7126c7c View commit details
    Browse the repository at this point in the history

  5. might this be the culprit?

    @simone-silvestri
    simone-silvestri committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    733ab2b View commit details
    Browse the repository at this point in the history

  6. revert to 8 tasks to precompile

    @simone-silvestri
    simone-silvestri committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    2dbf1a0 View commit details
    Browse the repository at this point in the history

  7. final version?

    @simone-silvestri
    simone-silvestri committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    a4b129a View commit details
    Browse the repository at this point in the history

  8. return to previous state of affairs

    @simone-silvestri
    simone-silvestri committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    29f7d69 View commit details
    Browse the repository at this point in the history

  9. reinclude enzyme

    @simone-silvestri
    simone-silvestri committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    b174313 View commit details
    Browse the repository at this point in the history

  10. set cuda runtime version

    @simone-silvestri
    simone-silvestri committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    0283e6a View commit details
    Browse the repository at this point in the history

  11. will this help in finding cuda?

    @simone-silvestri
    simone-silvestri committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    b4c1f2a View commit details
    Browse the repository at this point in the history

  12. make sure we don't run OOM

    @simone-silvestri
    simone-silvestri committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    bc53a97 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. bugfix in set!

    @simone-silvestri
    simone-silvestri committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    811bfdb View commit details
    Browse the repository at this point in the history

  2. try precompile inside runtests

    @simone-silvestri
    simone-silvestri committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    cd86a6a View commit details
    Browse the repository at this point in the history

  3. revert back

    @simone-silvestri
    simone-silvestri committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    4039299 View commit details
    Browse the repository at this point in the history

  4. recompile everywhere

    @simone-silvestri
    simone-silvestri committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    2c6ad90 View commit details
    Browse the repository at this point in the history