Code

App Runner B-Fabric integration#126

Code

Draft

leoschwarz wants to merge 203 commits intomainfgcz/bfabricPy:mainfrom refactor-submitterfgcz/bfabricPy:refactor-submitterCopy head branch name to clipboard

+776-27

Commits

Commits on Jan 28, 2025

• initial code

  leoschwarz

  committed
  13ce417

  Copy full SHA for 13ce417

• rename

  leoschwarz

  committed
  a2cd886

  Copy full SHA for a2cd886

• add some implementation for the submitters_spec.py

  leoschwarz

  committed
  e4c6fac

  Copy full SHA for e4c6fac

• create submitter module

  leoschwarz

  committed
  6d2f997

  Copy full SHA for 6d2f997

• be a bit more pydantic

  leoschwarz

  committed
  30778ee

  Copy full SHA for 30778ee

• also ensure the user params get validated

  leoschwarz

  committed
  6a0328c

  Copy full SHA for 6a0328c

• more explicit names

  leoschwarz

  committed
  86c407a

  Copy full SHA for 86c407a

• specify the slurm root

  leoschwarz

  committed
  9057229

  Copy full SHA for 9057229

• implement the submitter

  leoschwarz

  committed
  7bd6b38

  Copy full SHA for 7bd6b38

• use StringConstraints

  leoschwarz

  committed
  a10f3b0

  Copy full SHA for a10f3b0

• add input classes for the submitter

  leoschwarz

  committed
  b70c952

  Copy full SHA for b70c952

• add some very early draft on the submitter design

  leoschwarz

  committed
  d536125

  Copy full SHA for d536125

• implement app_runner wrapper creator

  leoschwarz

  committed
  8613af2

  Copy full SHA for 8613af2

• integrate initial entrypoint

  leoschwarz

  committed
  f4bd898

  Copy full SHA for f4bd898

• initial executable definition

  leoschwarz

  committed
  3347b08

  Copy full SHA for 3347b08

• directly set masterexecutableid

  leoschwarz

  committed
  a8de5ef

  Copy full SHA for a8de5ef

• necessary flags

  leoschwarz

  committed
  b5df77e

  Copy full SHA for b5df77e

• update

  leoschwarz

  committed
  54e6865

  Copy full SHA for 54e6865

• update

  leoschwarz

  committed
  7cfe16f

  Copy full SHA for 7cfe16f

• argparse

  leoschwarz

  committed
  bd9500a

  Copy full SHA for bd9500a

• use the executable

  leoschwarz

  committed
  7a885b4

  Copy full SHA for 7a885b4

• define default

  leoschwarz

  committed
  75b4bcc

  Copy full SHA for 75b4bcc

• don't pass parameters

  leoschwarz

  committed
  21a4e4f

  Copy full SHA for 21a4e4f

• pass workunitid

  leoschwarz

  committed
  352e0cd

  Copy full SHA for 352e0cd

• give it a name

  leoschwarz

  committed
  25dfa2b

  Copy full SHA for 25dfa2b

• add a new line

  leoschwarz

  committed
  d07767d

  Copy full SHA for d07767d

• add definition

  leoschwarz

  committed
  029681d

  Copy full SHA for 029681d

• add skeleton submitter

  leoschwarz

  committed
  5f47cd0

  Copy full SHA for 5f47cd0

• start implementing

  leoschwarz

  committed
  206ae62

  Copy full SHA for 206ae62

• already resolve the app version in wrapper creator

  leoschwarz

  committed
  286f5b1

  Copy full SHA for 286f5b1

• submitter

  leoschwarz

  committed
  13e1d51

  Copy full SHA for 13e1d51

• adapt

  leoschwarz

  committed
  df9e9a4

  Copy full SHA for df9e9a4

• combine together

  leoschwarz

  committed
  a02731d

  Copy full SHA for a02731d

• debug

  leoschwarz

  committed
  bbcc75f

  Copy full SHA for bbcc75f

• set status available when finished

  leoschwarz

  committed
  5145cf0

  Copy full SHA for 5145cf0

• pass the yaml

  leoschwarz

  committed
  f01556e

  Copy full SHA for f01556e

• filter locally

  leoschwarz

  committed
  ce25cd1

  Copy full SHA for ce25cd1

• fix

  leoschwarz

  committed
  d9d1d0b

  Copy full SHA for d9d1d0b

• fix

  leoschwarz

  committed
  e64e8c1

  Copy full SHA for e64e8c1

• fix

  leoschwarz

  committed
  975b2d1

  Copy full SHA for 975b2d1

• fix

  leoschwarz

  committed
  9a4ec11

  Copy full SHA for 9a4ec11

• implement more

  leoschwarz

  committed
  4277f1b

  Copy full SHA for 4277f1b

• adjust

  leoschwarz

  committed
  192f8cc

  Copy full SHA for 192f8cc

• refactor

  leoschwarz

  committed
  1cfda5e

  Copy full SHA for 1cfda5e

• fix

  leoschwarz

  committed
  71a1275

  Copy full SHA for 71a1275

• make the script executable

  leoschwarz

  committed
  70aabcd

  Copy full SHA for 70aabcd

• consistent

  leoschwarz

  committed
  30129ab

  Copy full SHA for 30129ab

• app runner version

  leoschwarz

  committed
  c7d059e

  Copy full SHA for c7d059e

• log the result

  leoschwarz

  committed
  37b9804

  Copy full SHA for 37b9804

• drop

  leoschwarz

  committed
  4d6c5b2

  Copy full SHA for 4d6c5b2

• remove todo

  leoschwarz

  committed
  7c08be9

  Copy full SHA for 7c08be9

• update yamlfmt

  leoschwarz

  committed
  3f27b89

  Copy full SHA for 3f27b89

• format

  leoschwarz

  committed
  6627def

  Copy full SHA for 6627def

• submitter parameter parsing

  leoschwarz

  committed
  3300607

  Copy full SHA for 3300607

• submitter parameter parsing

  leoschwarz

  committed
  a384d0e

  Copy full SHA for a384d0e

• add placeholder

  leoschwarz

  committed
  eb778fe

  Copy full SHA for eb778fe

• add todo

  leoschwarz

  committed
  5503f8d

  Copy full SHA for 5503f8d

• store

  leoschwarz

  committed
  502a413

  Copy full SHA for 502a413

• refactor

  leoschwarz

  committed
  1b5fa87

  Copy full SHA for 1b5fa87

• working directory

  leoschwarz

  committed
  c8b00e5

  Copy full SHA for c8b00e5

• allow interpolating workunit information

  leoschwarz

  committed
  3c384fc

  Copy full SHA for 3c384fc

• remove todo

  leoschwarz

  committed
  3e20359

  Copy full SHA for 3e20359

• refactor config handling

  leoschwarz

  committed
  1bc3576

  Copy full SHA for 1bc3576

• adapt

  leoschwarz

  committed
  23b7b42

  Copy full SHA for 23b7b42

• fix

  leoschwarz

  committed
  0e8ec43

  Copy full SHA for 0e8ec43

• log the variables

  leoschwarz

  committed
  f1bf893

  Copy full SHA for f1bf893

• fix

  leoschwarz

  committed
  d23f7ea

  Copy full SHA for d23f7ea

• fix?

  leoschwarz

  committed
  80821b3

  Copy full SHA for 80821b3

• fix

  leoschwarz

  committed
  2791647

  Copy full SHA for 2791647

• fix

  leoschwarz

  committed
  6889458

  Copy full SHA for 6889458

• fix

  leoschwarz

  committed
  6bc40cf

  Copy full SHA for 6bc40cf

• make app name safe

  leoschwarz

  committed
  7ac94c2

  Copy full SHA for 7ac94c2

• make app name safe

  leoschwarz

  committed
  f8f4f8c

  Copy full SHA for f8f4f8c

• activate the command

  leoschwarz

  committed
  b1c7656

  Copy full SHA for b1c7656

• remove todo

  leoschwarz

  committed
  5aa3887

  Copy full SHA for 5aa3887

• remove todo

  leoschwarz

  committed
  779bae0

  Copy full SHA for 779bae0

• refactor

  leoschwarz

  committed
  a09d16d

  Copy full SHA for a09d16d

• use slurm arguments directly

  leoschwarz

  committed
  52c609f

  Copy full SHA for 52c609f

• migrate

  leoschwarz

  committed
  551f325

  Copy full SHA for 551f325

• remove the todo

  leoschwarz

  committed
  406646d

  Copy full SHA for 406646d

• fix

  leoschwarz

  committed
  372e5d5

  Copy full SHA for 372e5d5

• set status to done

  leoschwarz

  committed
  5607ad8

  Copy full SHA for 5607ad8

• try creating the workunit externaljob

  leoschwarz

  committed
  a5646ac

  Copy full SHA for a5646ac

• Revert "try creating the workunit externaljob"

  Show description for 9c69002
  leoschwarz

  committed
  9c69002

  Copy full SHA for 9c69002

• correctly use annotated

  leoschwarz

  committed
  a8008da

  Copy full SHA for a8008da

• pass shell=True

  leoschwarz

  committed
  4a6b7c6

  Copy full SHA for 4a6b7c6

• Revert "pass shell=True"

  Show description for 1316ba8
  leoschwarz

  committed
  1316ba8

  Copy full SHA for 1316ba8

• better template

  leoschwarz

  committed
  e6184cb

  Copy full SHA for e6184cb

• fix rename

  leoschwarz

  committed
  9fa5f37

  Copy full SHA for 9fa5f37

• print the config

  leoschwarz

  committed
  a9ae51c

  Copy full SHA for a9ae51c

• fix a problematic typo

  leoschwarz

  committed
  436e862

  Copy full SHA for 436e862

• diagnostic info

  leoschwarz

  committed
  231f7ea

  Copy full SHA for 231f7ea

• force version field

  leoschwarz

  committed
  d428b3a

  Copy full SHA for d428b3a

Commits on Feb 7, 2025

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  3041f76

  Copy full SHA for 3041f76

• fix import

  leoschwarz

  committed
  064bbe8

  Copy full SHA for 064bbe8

• adapt tests

  leoschwarz

  committed
  df9acd7

  Copy full SHA for df9acd7

• adapt more imports

  leoschwarz

  committed
  ba11224

  Copy full SHA for ba11224

Commits on Feb 10, 2025

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  59c524c

  Copy full SHA for 59c524c

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  1e3a3cf

  Copy full SHA for 1e3a3cf

• update app_runner command generation

  leoschwarz

  committed
  59bb4ea

  Copy full SHA for 59bb4ea

• clean the script a bit

  leoschwarz

  committed
  9307621

  Copy full SHA for 9307621

• remove todos

  leoschwarz

  committed
  1e5a317

  Copy full SHA for 1e5a317

• only set workunit to None when explicit

  leoschwarz

  committed
  a0708b1

  Copy full SHA for a0708b1

• interpolate the submitter template

  leoschwarz

  committed
  82648de

  Copy full SHA for 82648de

• adapt test

  leoschwarz

  committed
  684807c

  Copy full SHA for 684807c

• simplify

  leoschwarz

  committed
  a5e52a5

  Copy full SHA for a5e52a5

• correct type

  leoschwarz

  committed
  7f76b2b

  Copy full SHA for 7f76b2b

• doc

  leoschwarz

  committed
  b17e629

  Copy full SHA for b17e629

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  56ece36

  Copy full SHA for 56ece36

• fix imports

  leoschwarz

  committed
  ce86200

  Copy full SHA for ce86200

• diagnostics

  leoschwarz

  committed
  890d9a3

  Copy full SHA for 890d9a3

• fix

  leoschwarz

  committed
  49c1466

  Copy full SHA for 49c1466

• log the file being parsed

  leoschwarz

  committed
  539eb71

  Copy full SHA for 539eb71

• add a field for configuring log viewer url

  leoschwarz

  committed
  e8a60eb

  Copy full SHA for e8a60eb

• correct dependency

  leoschwarz

  committed
  c9e75f4

  Copy full SHA for c9e75f4

• fix

  leoschwarz

  committed
  5e31452

  Copy full SHA for 5e31452

• ensure python

  leoschwarz

  committed
  e97941e

  Copy full SHA for e97941e

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  c70469b

  Copy full SHA for c70469b

• integrate force_storage option

  leoschwarz

  committed
  0fe595f

  Copy full SHA for 0fe595f

• integrate force_storage further

  leoschwarz

  committed
  b620a5c

  Copy full SHA for b620a5c

• try add timestamps

  leoschwarz

  committed
  17de037

  Copy full SHA for 17de037

• try again

  leoschwarz

  committed
  1f88621

  Copy full SHA for 1f88621

• fail on error

  leoschwarz

  committed
  6811f9f

  Copy full SHA for 6811f9f

• debugging

  leoschwarz

  committed
  54065c8

  Copy full SHA for 54065c8

• fix

  leoschwarz

  committed
  97fdfce

  Copy full SHA for 97fdfce

• forward errors

  leoschwarz

  committed
  9a89b3e

  Copy full SHA for 9a89b3e

• remove

  leoschwarz

  committed
  6917c04

  Copy full SHA for 6917c04

• try again

  leoschwarz

  committed
  7cb30f0

  Copy full SHA for 7cb30f0

• multiline

  leoschwarz

  committed
  77008ae

  Copy full SHA for 77008ae

• try again

  leoschwarz

  committed
  8f4fe50

  Copy full SHA for 8f4fe50

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  3ed689c

  Copy full SHA for 3ed689c

• syntax

  leoschwarz

  committed
  a49b648

  Copy full SHA for a49b648

• escaping

  leoschwarz

  committed
  ccdf367

  Copy full SHA for ccdf367

• pretty

  leoschwarz

  committed
  77d6156

  Copy full SHA for 77d6156

• add the link to logs if appropriate

  leoschwarz

  committed
  0922623

  Copy full SHA for 0922623

• actually call add_links

  leoschwarz

  committed
  121fa49

  Copy full SHA for 121fa49

Commits on Feb 11, 2025

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  127ed68

  Copy full SHA for 127ed68

• add links

  leoschwarz

  committed
  8b72e8c

  Copy full SHA for 8b72e8c

• diagnose

  leoschwarz

  committed
  f1b38c3

  Copy full SHA for f1b38c3

• correct type

  leoschwarz

  committed
  cb579c3

  Copy full SHA for cb579c3

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  05988c6

  Copy full SHA for 05988c6

• consistent

  leoschwarz

  committed
  9f51a07

  Copy full SHA for 9f51a07

• default

  leoschwarz

  committed
  c27ef69

  Copy full SHA for c27ef69

• add tests

  leoschwarz

  committed
  6a99c71

  Copy full SHA for 6a99c71

Commits on Feb 12, 2025

• implement support for time limit

  leoschwarz

  committed
  c1efe32

  Copy full SHA for c1efe32

• missing conversion

  leoschwarz

  committed
  d4f933f

  Copy full SHA for d4f933f

• python compat

  leoschwarz

  committed
  f994ddc

  Copy full SHA for f994ddc

Commits on Feb 13, 2025

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  57cf788

  Copy full SHA for 57cf788

• ensure dir exists

  leoschwarz

  committed
  d77d532

  Copy full SHA for d77d532

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  c2094ee

  Copy full SHA for c2094ee

• use importlib

  leoschwarz

  committed
  c73ac52

  Copy full SHA for c73ac52

• use importlib

  leoschwarz

  committed
  1db21db

  Copy full SHA for 1db21db

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  48b68a8

  Copy full SHA for 48b68a8

• correctly specify resource files

  leoschwarz

  committed
  8bf67af

  Copy full SHA for 8bf67af

• correctly specify resource files

  leoschwarz

  committed
  1be65cd

  Copy full SHA for 1be65cd

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  99bf79a

  Copy full SHA for 99bf79a

• read the correct file

  leoschwarz

  committed
  31055ca

  Copy full SHA for 31055ca

• read the correct file

  leoschwarz

  committed
  8e27f27

  Copy full SHA for 8e27f27

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  2647b90

  Copy full SHA for 2647b90

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  ec03eb6

  Copy full SHA for ec03eb6

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  f1fac37

  Copy full SHA for f1fac37

• use the app_version.yml file now

  leoschwarz

  committed
  0670d95

  Copy full SHA for 0670d95

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  a82a0d5

  Copy full SHA for a82a0d5

Commits on Feb 17, 2025

• add file_token

  leoschwarz

  committed
  1d09b47

  Copy full SHA for 1d09b47

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  af20f65

  Copy full SHA for af20f65

• Merge branch 'main' into refactor-submitter (manual fixes)

  leoschwarz

  committed
  93595df

  Copy full SHA for 93595df

Commits on Feb 18, 2025

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  24cd97b

  Copy full SHA for 24cd97b

• fix problem

  leoschwarz

  committed
  53450d7

  Copy full SHA for 53450d7

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  b42bbd4

  Copy full SHA for b42bbd4

• force python 3.13

  leoschwarz

  committed
  2c20a6f

  Copy full SHA for 2c20a6f

Commits on Feb 19, 2025

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  ccc2275

  Copy full SHA for ccc2275

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  81c62e0

  Copy full SHA for 81c62e0

Commits on Feb 24, 2025

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  aa528b2

  Copy full SHA for aa528b2

Commits on Feb 28, 2025

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  eb3835a

  Copy full SHA for eb3835a

• create resource instead of link

  leoschwarz

  committed
  01ab962

  Copy full SHA for 01ab962

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  ee9bec8

  Copy full SHA for ee9bec8

• missing workunit_id

  leoschwarz

  committed
  8974a9b

  Copy full SHA for 8974a9b

• improve state logic

  leoschwarz

  committed
  154175a

  Copy full SHA for 154175a

• Handle problematic characters in Workunit.store_output_folder

  leoschwarz

  committed
  dad2d02

  Copy full SHA for dad2d02

• try again

  leoschwarz

  committed
  531b198

  Copy full SHA for 531b198

• Merge branch 'main' into refactor-submitter

  leoschwarz

  committed
  ecd6e36

  Copy full SHA for ecd6e36

• it's still good enough to use half of it

  leoschwarz

  committed
  779caf3

  Copy full SHA for 779caf3

• fix

  leoschwarz

  committed
  0e16fa8

  Copy full SHA for 0e16fa8

• start preparing for new impl

  leoschwarz

  committed
  d8f71de

  Copy full SHA for d8f71de

• setup slurm_submitter package

  leoschwarz

  committed
  9910f58

  Copy full SHA for 9910f58

• better template

  leoschwarz

  committed
  1841dfe

  Copy full SHA for 1841dfe

• basically merge the two components

  leoschwarz

  committed
  5e2c2b1

  Copy full SHA for 5e2c2b1

• deactivate

  leoschwarz

  committed
  8720fc7

  Copy full SHA for 8720fc7

• fix imports

  leoschwarz

  committed
  c514bff

  Copy full SHA for c514bff

• clean

  leoschwarz

  committed
  551f5f8

  Copy full SHA for 551f5f8

• cleaning

  leoschwarz

  committed
  6b75950

  Copy full SHA for 6b75950

• integrate

  leoschwarz

  committed
  78de0d2

  Copy full SHA for 78de0d2

• wrong arg

  leoschwarz

  committed
  cf49f2f

  Copy full SHA for cf49f2f

• fix

  leoschwarz

  committed
  466bc95

  Copy full SHA for 466bc95

• fix

  leoschwarz

  committed
  a31e95e

  Copy full SHA for a31e95e

• path

  leoschwarz

  committed
  74ec001

  Copy full SHA for 74ec001

• path

  leoschwarz

  committed
  b484541

  Copy full SHA for b484541

• typo

  leoschwarz

  committed
  b0a550d

  Copy full SHA for b0a550d

• fix param

  leoschwarz

  committed
  0e70db2

  Copy full SHA for 0e70db2

• move

  leoschwarz

  committed
  38be212

  Copy full SHA for 38be212

• refactor

  leoschwarz

  committed
  8dd0ef3

  Copy full SHA for 8dd0ef3

• configurable name

  leoschwarz

  committed
  d14585b

  Copy full SHA for d14585b

Commits on Mar 4, 2025

• fix

  leoschwarz

  committed
  ff5d40a

  Copy full SHA for ff5d40a