Code

m-to-n restart (new)#1057

Code

Merged

MTCam merged 69 commits intomainillinois-ceesd/mirgecom:mainfrom m-to-n-restart-updateillinois-ceesd/mirgecom:m-to-n-restart-updateCopy head branch name to clipboardAug 28, 2024

+2,542-106

Commits

Commits on Sep 7, 2023

• Add contextmanager import

  MTCam

  committed
  6426aae

• Add mesh partitioning utilities

  MTCam

  committed
  98a9511

• Add majosm node-local mesh partitioning funcs

  MTCam

  committed
  1583d72

• Dispense with pkl5 comm wrapper which doesnt play nice with splitted comm.

  MTCam

  committed
  550d485

Commits on Sep 8, 2023

• Update mirgecom/simutil.py

  Show description for f09077f
  

  MTCam

  and

  majosm

  authored
  f09077f

• rearrange comming in mesh dist

  MTCam

  committed
  15a0eb9

Commits on Sep 13, 2023

• Batch the reads

  MTCam

  committed
  4f1eba2

• Merge remote-tracking branch 'origin/slow-gmsh-dist' into nlp-debug-pkl-dist

  MTCam

  committed
  b293d16

• Add pkl dist method

  MTCam

  committed
  1fe0401

• Merge remote-tracking branch 'origin/slow-gmsh-dist' into nlp-debug-pkl-dist

  MTCam

  committed
  23a2a60

Commits on Sep 14, 2023

• Add mesh dist to pkl util

  MTCam

  committed
  46faa2d

• Merge branch 'main' into node-local-partitioning

  MTCam

  committed
  9047ae2

• Merge branch 'nlp-debug-pkl-dist' into node-local-partitioning

  MTCam

  committed
  863d45f

Commits on Sep 15, 2023

• Add meshdist util

  MTCam

  committed
  f004abf

Commits on Sep 16, 2023

• Import at top, use better filenames, loop over actual items in parted meshes.

  MTCam

  committed
  3721326

Commits on Sep 22, 2023

• Add some utils to support m-to-n restart.

  MTCam

  committed
  f9babfd

Commits on Sep 25, 2023

• Add some utils to support m-to-n restart

  MTCam

  committed
  c815fb7

Commits on Sep 29, 2023

• Add stand-alone redist util.

  MTCam

  committed
  2b662d6

• Beef up comments

  MTCam

  committed
  a7ab1b2

• Check that the restart path is a directory.

  MTCam

  committed
  c0f06e6

• Merge branch 'node-local-partitioning' into m-to-n-restart

  MTCam

  committed
  d1bb8a3

Commits on Oct 1, 2023

• Move redist to restart module.

  MTCam

  committed
  9bb89ff

Commits on Oct 4, 2023

• Move redist to restart module, correct glob path.

  MTCam

  committed
  a286c08

• Merge remote-tracking branch 'origin/m-to-n-restart' into save-my-changes

  MTCam

  committed
  1cd912e

• Use array context for picklin, zeros_like, debugging diagnostics

  MTCam

  committed
  08622dd

• Get mesh on reader_rank 0, and share some timings with the user.

  MTCam

  committed
  cdded96

Commits on Oct 5, 2023

• add options to specify target decomp map

  MTCam

  committed
  9a2d8a7

Commits on Oct 6, 2023

• Refactor for access to multivol partition datastructure

  MTCam

  committed
  5bf5d58

• Fix bug in refactored

  MTCam

  committed
  a5fba6b

• Back out changes to redist, for now.

  MTCam

  committed
  b4328bb

Commits on Oct 9, 2023

• Add overlap mapping utility for multi-volume datasets.

  MTCam

  committed
  2445a03

• Util for overlap compute of inverted decomps, convenience

  MTCam

  committed
  51f5305

• Add some tests of multivol overlap mapping.

  MTCam

  committed
  d995e65

• Path checking on restart files, broken redist util

  MTCam

  committed
  23e9fe7

Commits on Oct 10, 2023

• Add m-to-n api for multi-volume datasets.

  MTCam

  committed
  3ad363a

• Sharpen doc slightly

  MTCam

  committed
  3f4cef5

• Sharpen some docs

  MTCam

  committed
  6473120

• Extend redist to multi-volume datasets.

  MTCam

  committed
  fd6225a

• Unnewify function name

  MTCam

  committed
  c35c86d

Commits on Oct 11, 2023

• Cleanup after refac

  MTCam

  committed
  878412a

• Merge branch 'main' into node-local-partitioning

  MTCam

  committed
  a0d7372

• Merge branch 'node-local-partitioning' into mrgup

  MTCam

  committed
  4b2e565

• Deep changes to remove complexity, requires input mappings now.

  MTCam

  committed
  82609e9

• Deep refactor to simplify overlap mapping, processing.

  MTCam

  committed
  89ea9ab

• Deep refactor to simplify overlap mapping, processing.

  MTCam

  committed
  43b2990

• More extensive testing to catch errors encountered in prediction case.

  MTCam

  committed
  0ceb081

• Add a bunch of debugging/diagnostics for restart data structures and decomps

  MTCam

  committed
  98c114f

Commits on Oct 12, 2023

• Add more diagnostics, handle ndarrays in zero util

  MTCam

  committed
  74c0edb

• Merge branch 'main' into m-to-n-restart

  MTCam

  committed
  170411a

Commits on Oct 14, 2023

• fix meshdist for dimensionality

  anderson2981

  committed
  2e638d3

Commits on Oct 16, 2023

• Add some timings, fix issue with parallel redist.

  MTCam

  committed
  09339c6

• Merge branch 'update-m2n' into m-to-n-restart

  MTCam

  committed
  f80afc0

• Fix dim parse bug in meshdist.

  MTCam

  committed
  99b4003

• Add mapdecomp util.

  MTCam

  committed
  69a6f84

Commits on Oct 18, 2023

• Merge remote-tracking branch 'origin/m-to-n-restart' into m-to-n-restart

  MTCam

  committed
  b5c8d30

Commits on Nov 14, 2023

• Merge main

  MTCam

  committed
  a4eed52

Commits on Aug 22, 2024

• Merge m-to-n with main

  MTCam

  committed
  21a9681

• Allow bigger partition discrepancies, include missing import

  MTCam

  committed
  dd8f535

Commits on Aug 27, 2024

• set imbalance tolerance from the outside

  anderson2981

  committed
  ef13518

• Update to remove mpi_distribute

  MTCam

  committed
  9059d18

• Merge remote-tracking branch 'origin/m-to-n-restart-update' into m-to-n-restart-update

  MTCam

  committed
  7fa272b

Commits on Aug 28, 2024

• Fix up some linting errors

  MTCam

  committed
  beca614

• Fix up some docstring issues in simutil

  MTCam

  committed
  8b6da6e

• Fix up some doc warnings.

  MTCam

  committed
  f4a347a

• Add some docs for m-to-n-restart

  MTCam

  committed
  3721301

• Fix bug in imbalance tol option

  MTCam

  committed
  b712376

• Merge branch 'main' into m-to-n-restart-update

  MTCam

  committed
  ada6257

• Update mirgecom/logging_quantities.py per MD review

  Show description for 6084eb1
  

  MTCam

  and

  matthiasdiener

  authored
  6084eb1

• Deflake8

  MTCam

  committed
  12785f4