Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

m-to-n restart (new) #1057

Merged
merged 69 commits into from
Aug 28, 2024
Merged

m-to-n restart (new) #1057

merged 69 commits into from
Aug 28, 2024

Commits on Sep 7, 2023

  1. Add contextmanager import

    @MTCam
    MTCam committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    6426aae View commit details
    Browse the repository at this point in the history

  2. Add mesh partitioning utilities

    @MTCam
    MTCam committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    98a9511 View commit details
    Browse the repository at this point in the history

  3. Add majosm node-local mesh partitioning funcs

    @MTCam
    MTCam committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    1583d72 View commit details
    Browse the repository at this point in the history

  4. Dispense with pkl5 comm wrapper which doesnt play nice with splitted … 

    …comm.
    @MTCam
    MTCam committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    550d485 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2023

  1. Update mirgecom/simutil.py 

    Co-authored-by: Matt Smith <[email protected]>
    @MTCam @majosm
    MTCam and majosm authored Sep 8, 2023
    Configuration menu
    Copy the full SHA
    f09077f View commit details
    Browse the repository at this point in the history

  2. rearrange comming in mesh dist

    @MTCam
    MTCam committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    15a0eb9 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2023

  1. Batch the reads

    @MTCam
    MTCam committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    4f1eba2 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/slow-gmsh-dist' into nlp-debug-p… 

    …kl-dist
    @MTCam
    MTCam committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    b293d16 View commit details
    Browse the repository at this point in the history

  3. Add pkl dist method

    @MTCam
    MTCam committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    1fe0401 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/slow-gmsh-dist' into nlp-debug-p… 

    …kl-dist
    @MTCam
    MTCam committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    23a2a60 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. Add mesh dist to pkl util

    @MTCam
    MTCam committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    46faa2d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into node-local-partitioning

    @MTCam
    MTCam committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    9047ae2 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'nlp-debug-pkl-dist' into node-local-partitioning

    @MTCam
    MTCam committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    863d45f View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2023

  1. Add meshdist util

    @MTCam
    MTCam committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    f004abf View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2023

  1. Import at top, use better filenames, loop over actual items in parted… 

    … meshes.
    @MTCam
    MTCam committed Sep 16, 2023
    Configuration menu
    Copy the full SHA
    3721326 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2023

  1. Add some utils to support m-to-n restart.

    @MTCam
    MTCam committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    f9babfd View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2023

  1. Add some utils to support m-to-n restart

    @MTCam
    MTCam committed Sep 25, 2023
    Configuration menu
    Copy the full SHA
    c815fb7 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. Add stand-alone redist util.

    @MTCam
    MTCam committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    2b662d6 View commit details
    Browse the repository at this point in the history

  2. Beef up comments

    @MTCam
    MTCam committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    a7ab1b2 View commit details
    Browse the repository at this point in the history

  3. Check that the restart path is a directory.

    @MTCam
    MTCam committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    c0f06e6 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'node-local-partitioning' into m-to-n-restart

    @MTCam
    MTCam committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    d1bb8a3 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2023

  1. Move redist to restart module.

    @MTCam
    MTCam committed Oct 1, 2023
    Configuration menu
    Copy the full SHA
    9bb89ff View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2023

  1. Move redist to restart module, correct glob path.

    @MTCam
    MTCam committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    a286c08 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/m-to-n-restart' into save-my-cha… 

    …nges
    @MTCam
    MTCam committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    1cd912e View commit details
    Browse the repository at this point in the history

  3. Use array context for picklin, zeros_like, debugging diagnostics

    @MTCam
    MTCam committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    08622dd View commit details
    Browse the repository at this point in the history

  4. Get mesh on reader_rank 0, and share some timings with the user.

    @MTCam
    MTCam committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    cdded96 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2023

  1. add options to specify target decomp map

    @MTCam
    MTCam committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    9a2d8a7 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2023

  1. Refactor for access to multivol partition datastructure

    @MTCam
    MTCam committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    5bf5d58 View commit details
    Browse the repository at this point in the history

  2. Fix bug in refactored

    @MTCam
    MTCam committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    a5fba6b View commit details
    Browse the repository at this point in the history

  3. Back out changes to redist, for now.

    @MTCam
    MTCam committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    b4328bb View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2023

  1. Add overlap mapping utility for multi-volume datasets.

    @MTCam
    MTCam committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    2445a03 View commit details
    Browse the repository at this point in the history

  2. Util for overlap compute of inverted decomps, convenience

    @MTCam
    MTCam committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    51f5305 View commit details
    Browse the repository at this point in the history

  3. Add some tests of multivol overlap mapping.

    @MTCam
    MTCam committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    d995e65 View commit details
    Browse the repository at this point in the history

  4. Path checking on restart files, broken redist util

    @MTCam
    MTCam committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    23e9fe7 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2023

  1. Add m-to-n api for multi-volume datasets.

    @MTCam
    MTCam committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    3ad363a View commit details
    Browse the repository at this point in the history

  2. Sharpen doc slightly

    @MTCam
    MTCam committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    3f4cef5 View commit details
    Browse the repository at this point in the history

  3. Sharpen some docs

    @MTCam
    MTCam committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    6473120 View commit details
    Browse the repository at this point in the history

  4. Extend redist to multi-volume datasets.

    @MTCam
    MTCam committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    fd6225a View commit details
    Browse the repository at this point in the history

  5. Unnewify function name

    @MTCam
    MTCam committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    c35c86d View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2023

  1. Cleanup after refac

    @MTCam
    MTCam committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    878412a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into node-local-partitioning

    @MTCam
    MTCam committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    a0d7372 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'node-local-partitioning' into mrgup

    @MTCam
    MTCam committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    4b2e565 View commit details
    Browse the repository at this point in the history

  4. Deep changes to remove complexity, requires input mappings now.

    @MTCam
    MTCam committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    82609e9 View commit details
    Browse the repository at this point in the history

  5. Deep refactor to simplify overlap mapping, processing.

    @MTCam
    MTCam committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    89ea9ab View commit details
    Browse the repository at this point in the history

  6. Deep refactor to simplify overlap mapping, processing.

    @MTCam
    MTCam committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    43b2990 View commit details
    Browse the repository at this point in the history

  7. More extensive testing to catch errors encountered in prediction case.

    @MTCam
    MTCam committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    0ceb081 View commit details
    Browse the repository at this point in the history

  8. Add a bunch of debugging/diagnostics for restart data structures and … 

    …decomps
    @MTCam
    MTCam committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    98c114f View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2023

  1. Add more diagnostics, handle ndarrays in zero util

    @MTCam
    MTCam committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    74c0edb View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into m-to-n-restart

    @MTCam
    MTCam committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    170411a View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2023

  1. fix meshdist for dimensionality

    @anderson2981
    anderson2981 committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    2e638d3 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2023

  1. Add some timings, fix issue with parallel redist.

    @MTCam
    MTCam committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    09339c6 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'update-m2n' into m-to-n-restart

    @MTCam
    MTCam committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    f80afc0 View commit details
    Browse the repository at this point in the history

  3. Fix dim parse bug in meshdist.

    @MTCam
    MTCam committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    99b4003 View commit details
    Browse the repository at this point in the history

  4. Add mapdecomp util.

    @MTCam
    MTCam committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    69a6f84 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. Merge remote-tracking branch 'origin/m-to-n-restart' into m-to-n-restart

    @MTCam
    MTCam committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    b5c8d30 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2023

  1. Merge main

    @MTCam
    MTCam committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    a4eed52 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. Merge m-to-n with main

    @MTCam
    MTCam committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    21a9681 View commit details
    Browse the repository at this point in the history

  2. Allow bigger partition discrepancies, include missing import

    @MTCam
    MTCam committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    dd8f535 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. set imbalance tolerance from the outside

    @anderson2981
    anderson2981 committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    ef13518 View commit details
    Browse the repository at this point in the history

  2. Update to remove mpi_distribute

    @MTCam
    MTCam committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    9059d18 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/m-to-n-restart-update' into m-to… 

    …-n-restart-update
    @MTCam
    MTCam committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    7fa272b View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Fix up some linting errors

    @MTCam
    MTCam committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    beca614 View commit details
    Browse the repository at this point in the history

  2. Fix up some docstring issues in simutil

    @MTCam
    MTCam committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    8b6da6e View commit details
    Browse the repository at this point in the history

  3. Fix up some doc warnings.

    @MTCam
    MTCam committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    f4a347a View commit details
    Browse the repository at this point in the history

  4. Add some docs for m-to-n-restart

    @MTCam
    MTCam committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    3721301 View commit details
    Browse the repository at this point in the history

  5. Fix bug in imbalance tol option

    @MTCam
    MTCam committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    b712376 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into m-to-n-restart-update

    @MTCam
    MTCam committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    ada6257 View commit details
    Browse the repository at this point in the history

  7. Update mirgecom/logging_quantities.py per MD review 

    Co-authored-by: Matthias Diener <[email protected]>
    @MTCam @matthiasdiener
    MTCam and matthiasdiener authored Aug 28, 2024
    Configuration menu
    Copy the full SHA
    6084eb1 View commit details
    Browse the repository at this point in the history

  8. Deflake8

    @MTCam
    MTCam committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    12785f4 View commit details
    Browse the repository at this point in the history