Code

CI/CD Workflow update#176

Code

Merged

andreaslundell merged 113 commits intomastercoin-or/SHOT:masterfrom feature/ci-cd-improvementscoin-or/SHOT:feature/ci-cd-improvementsCopy head branch name to clipboardMay 2, 2024

+709-86

Commits

Commits on Mar 9, 2023

• refactor(ci): Refactor the workflow to use self-hosted runners and upload the build files as artifacts.

  maxemiliang

  committed
  832824d

  Copy full SHA for 832824d

• fix(ci): Auto accept the dependency installation

  maxemiliang

  committed
  d004c65

  Copy full SHA for d004c65

• fix(ci): Update cache version and install pkgconfig package

  maxemiliang

  committed
  d2b3df4

  Copy full SHA for d2b3df4

• fix(ci): Temporarily remove the build artifact upload

  maxemiliang

  committed
  9644bfc

  Copy full SHA for 9644bfc

Commits on Mar 14, 2023

• refactor(ci): Refactor the build process to use reusable workflows and readded the artifact storage.

  maxemiliang

  committed
  4b1fcbd

  Copy full SHA for 4b1fcbd

• fix(ci): Attempt to use the runner workspace as base for the artifact outputs

  maxemiliang

  committed
  b96269b

  Copy full SHA for b96269b

• fix(ci): Use correct input for the retention

  maxemiliang

  committed
  f8780d6

  Copy full SHA for f8780d6

• fix(ci): Update checkout version and fix naming for one step

  maxemiliang

  committed
  ee1720f

  Copy full SHA for ee1720f

Commits on Mar 17, 2023

• feat(ci): Added a step to publish the test results.

  maxemiliang

  committed
  087496b

  Copy full SHA for 087496b

• feat(ci): Added runner-init.yml script to initialize runners and updated the build script to use docker-runners

  maxemiliang

  committed
  cb8445e

  Copy full SHA for cb8445e

• fix(ci): Fixed so the correct variables are used ✏️

  maxemiliang

  committed
  dfdfcac

  Copy full SHA for dfdfcac

• fix: Fixed permission issues with docker and documented the runner-init.yml a bit better.

  maxemiliang

  committed
  cf8d1e2

  Copy full SHA for cf8d1e2

• fix(ci): Attempt to use the correct output

  maxemiliang

  committed
  721ba04

  Copy full SHA for 721ba04

Commits on Mar 20, 2023

• feat(ci): Allow for disabling artifact output and build args as inputs

  maxemiliang

  committed
  cb1c0b4

  Copy full SHA for cb1c0b4

Commits on Mar 21, 2023

• chore(ci): Formatting for the workflow

  maxemiliang

  committed
  fdc840a

  Copy full SHA for fdc840a

• feat(ci): Output test artifact name even if the other artifacts are not to be uploaded

  maxemiliang

  committed
  884d000

  Copy full SHA for 884d000

• refactor(ci): refactored runner.workspace -> github.workspace

  maxemiliang

  committed
  50070ed

  Copy full SHA for 50070ed

• feat(ci): Added ability to specify proprietary build and added gurobi download and license file setup

  maxemiliang

  committed
  03af112

  Copy full SHA for 03af112

• feat(ci): Updated the reusable workflow to correctly get secrets

  maxemiliang

  committed
  7a175fb

  Copy full SHA for 7a175fb

• feat(ci): Actually compile with gurobi as a test

  maxemiliang

  committed
  a2abadc

  Copy full SHA for a2abadc

• chore(ci): Updated the job count to match the current runner

  maxemiliang

  committed
  c676c11

  Copy full SHA for c676c11

• chore(ci): Removed debug from cleanup

  maxemiliang

  committed
  0fff51f

  Copy full SHA for 0fff51f

• feat(ci): Added GAMS installation steps and compile using it

  maxemiliang

  committed
  1a5ea88

  Copy full SHA for 1a5ea88

• feat(ci): Added concurrency, some comments and ability to add suffix to artifacts.

  maxemiliang

  committed
  1e4ae73

  Copy full SHA for 1e4ae73

• fix(ci): Fixed the publish test job to use correct outputs

  maxemiliang

  committed
  ff5b695

  Copy full SHA for ff5b695

• fix(ci): Fixed GAMS installation as it always extracts using the same name

  maxemiliang

  committed
  b1a7cfe

  Copy full SHA for b1a7cfe

• chore(ci): Formatting the workflow

  maxemiliang

  committed
  5192d10

  Copy full SHA for 5192d10

• fix(ci): Use the correct format for the GAMS library

  maxemiliang

  committed
  e55148e

  Copy full SHA for e55148e

• feat(ci): Added GAMS path to the runner path

  maxemiliang

  committed
  0837d1a

  Copy full SHA for 0837d1a

Commits on Mar 22, 2023

• fix(ci): Correctly use the gurobi path

  maxemiliang

  committed
  fa29e0d

  Copy full SHA for fa29e0d

• fix(ci): Attempt to escape the environment variables so they are correctly read by bash

  maxemiliang

  committed
  0e7270c

  Copy full SHA for 0e7270c

• refactor(ci): Always pass the installation paths of the proprietary software directly in the workflow

  maxemiliang

  committed
  9ec908c

  Copy full SHA for 9ec908c

• chore(ci): Supress output from wget to not clog the logs

  maxemiliang

  committed
  e673aed

  Copy full SHA for e673aed

• refactor(ci): Run the proprietary build after publishing the test results and re-enable the normal build

  maxemiliang

  committed
  2d42f84

  Copy full SHA for 2d42f84

• refactor(ci): Run the publish action last in an attempt to make the publish action publish all artifacts

  maxemiliang

  committed
  700407c

  Copy full SHA for 700407c

• fix(ci): Use the correct artifact naming/download format

  maxemiliang

  committed
  7a1a3ef

  Copy full SHA for 7a1a3ef

Commits on Apr 27, 2023

• refactor(ci): Refactored the proprietary switch to enable gams and gurobi separate of each-other.

  maxemiliang

  committed
  802cf90

  Copy full SHA for 802cf90

• fix(ci): do not try to use gurobi/gams by default

  maxemiliang

  committed
  ac5ef67

  Copy full SHA for ac5ef67

Commits on Sep 24, 2023

• feat(ci): Allow for running the default workflow manually

  maxemiliang

  committed
  0024893

  Copy full SHA for 0024893

• feat(ci): Added the benchmarking step

  maxemiliang

  committed
  a487dea

  Copy full SHA for a487dea

• fix(ci): Updated the SHOT executable path.

  maxemiliang

  committed
  2828609

  Copy full SHA for 2828609

• fix(ci): Updated the version for the action

  maxemiliang

  committed
  30ceaac

  Copy full SHA for 30ceaac

Commits on Oct 1, 2023

• fix(ci): Updated the version for the action

  maxemiliang

  committed
  fc2a296

  Copy full SHA for fc2a296

Commits on Oct 10, 2023

• fix(ci): updated the action version to -> 1.3

  maxemiliang

  committed
  df3b1f4

  Copy full SHA for df3b1f4

• fix(ci): updated the action version to -> 1.4 and disabled proprietary build for a while

  maxemiliang

  committed
  b3304dc

  Copy full SHA for b3304dc

• fix(ci): Fixed an issue with the commented step.

  maxemiliang

  committed
  2485be0

  Copy full SHA for 2485be0

• fix(ci): updated the action version to -> 1.5

  maxemiliang

  committed
  22ac5df

  Copy full SHA for 22ac5df

Commits on Oct 17, 2023

• chore: Updated the version of the benchmarker

  maxemiliang

  committed
  f991c55

  Copy full SHA for f991c55

• fix: temporarily remove the work folder as sudo

  maxemiliang

  committed
  2a5516f

  Copy full SHA for 2a5516f

• fix: malformed previous commit

  maxemiliang

  committed
  0bb3411

  Copy full SHA for 0bb3411

• chore: updated action version -> 1.7

  maxemiliang

  committed
  eeea793

  Copy full SHA for eeea793

Commits on Oct 18, 2023

• chore: bump composite action version

  maxemiliang

  committed
  751fbdd

  Copy full SHA for 751fbdd

• refactor: move the benchmark action into this repo

  maxemiliang

  committed
  ad91fdb

  Copy full SHA for ad91fdb

• fix: typo fix

  maxemiliang

  committed
  1c9edf6

  Copy full SHA for 1c9edf6

• fix: Fixed an issue with working-directory indentation

  maxemiliang

  committed
  6f030b8

  Copy full SHA for 6f030b8

• fix: Move the working directory for the python script correctly

  maxemiliang

  committed
  e0e5647

  Copy full SHA for e0e5647

Commits on Oct 19, 2023

• fix: some minor fixes to the benchmarker workflow

  maxemiliang

  committed
  06ba4db

  Copy full SHA for 06ba4db

• chore: comment out more steps to ease debugging

  maxemiliang

  committed
  7a07e3f

  Copy full SHA for 7a07e3f

• fix: Set the default where github context apparently is available.

  maxemiliang

  committed
  3e56f00

  Copy full SHA for 3e56f00

• fix: use the env variable instead

  maxemiliang

  committed
  6c4c3f5

  Copy full SHA for 6c4c3f5

• fix: revert to context variable instead

  maxemiliang

  committed
  c2dd029

  Copy full SHA for c2dd029

• fix: just use relative for now..

  maxemiliang

  committed
  9203efd

  Copy full SHA for 9203efd

• refactor: Make the git pull less error prone.

  maxemiliang

  committed
  2f22c63

  Copy full SHA for 2f22c63

• refactor: Make the git pull less error prone. part 2

  maxemiliang

  committed
  a37e4a2

  Copy full SHA for a37e4a2

• feat: Added the ran benchmarks as an output to the job.

  maxemiliang

  committed
  635b43a

  Copy full SHA for 635b43a

• feat: upload the benchmark osrl files

  maxemiliang

  committed
  32e8e36

  Copy full SHA for 32e8e36

• chore: Added back the old build steps, to test the whole workflow

  maxemiliang

  committed
  f9d844b

  Copy full SHA for f9d844b

Commits on Oct 22, 2023

• refactor(ci): refactored the benchmarker to add GAMS/Gurobi license if it is needed

  maxemiliang

  committed
  fcd1591

  Copy full SHA for fcd1591

• fix(ci): Cleanup license files

  maxemiliang

  committed
  af42c78

  Copy full SHA for af42c78

Commits on Nov 9, 2023

• refactor: benchmarker, test with artifact.

  maxemiliang

  committed
  35789d6

  Copy full SHA for 35789d6

• fix: attempt correct output of the artifacts name

  maxemiliang

  committed
  f1929eb

  Copy full SHA for f1929eb

• fix: move the outputs to the correct place and naming

  maxemiliang

  committed
  3f51c66

  Copy full SHA for 3f51c66

• fix: move the outputs to the correct place and naming

  maxemiliang

  committed
  b91f2be

  Copy full SHA for b91f2be

Commits on Nov 11, 2023

• fix: Attempt to just pass the name of the artifact directly. ✨

  maxemiliang

  committed
  a616ee5

  Copy full SHA for a616ee5

Commits on Feb 1, 2024

• chore(ci): Since we are using the latest version of CMake, we can use -S

  maxemiliang

  committed
  cf168ef

  Copy full SHA for cf168ef

Commits on Mar 17, 2024

• feat(ci): Updated the benchmarker + added secrets. Also temporarly disable the licensed builds.

  maxemiliang

  committed
  3fd73b1

  Copy full SHA for 3fd73b1

• fix(ci): Fixed an issue with the build dependencies as the licensed build is not running

  maxemiliang

  committed
  21effd9

  Copy full SHA for 21effd9

• fix(ci): Fixed an issue with the build dependencies as the licensed build is not running

  maxemiliang

  committed
  4e06b64

  Copy full SHA for 4e06b64

• Merge remote-tracking branch 'origin/feature/ci-cd-improvements' into feature/ci-cd-improvements

  maxemiliang

  committed
  fd094f7

  Copy full SHA for fd094f7

• fix(ci): Added Auth URL secret

  maxemiliang

  committed
  b74e9e1

  Copy full SHA for b74e9e1

• fix(ci): Added GITHUB_TOKEN secret

  maxemiliang

  committed
  9b941f6

  Copy full SHA for 9b941f6

• fix(ci): Correctly wrap the values to escape special characters.

  maxemiliang

  committed
  b22eca2

  Copy full SHA for b22eca2

• fix(ci): Disable all other builds + some testing stuff

  maxemiliang

  committed
  08b50c7

  Copy full SHA for 08b50c7

• fix(ci): Re-enable building

  maxemiliang

  committed
  de804a4

  Copy full SHA for de804a4

• fix(ci): Removed unnecessary step

  maxemiliang

  committed
  3452396

  Copy full SHA for 3452396

• fix(ci): Actually pass the secrets to the reusable workflow..

  maxemiliang

  committed
  ed3967a

  Copy full SHA for ed3967a

• fix(ci): Wrap the secret to escape

  maxemiliang

  committed
  4ed607d

  Copy full SHA for 4ed607d

Commits on Mar 29, 2024

• chore: add gams/gurobi status to the benchmarker

  maxemiliang

  authored
  de28256

  Copy full SHA for de28256

Commits on Apr 6, 2024

• refactor: Allow for different Gurobi and GAMS versions. Also test the new Benchmarker.

  maxemiliang

  committed
  8151310

  Copy full SHA for 8151310

• Merge remote-tracking branch 'origin/feature/ci-cd-improvements' into feature/ci-cd-improvements

  maxemiliang

  committed
  b3207a0

  Copy full SHA for b3207a0

• feat: Re enable licensed build workflow

  maxemiliang

  committed
  aa5a597

  Copy full SHA for aa5a597

• fix: Fixed an issue with getting the short version of GAMS and Gurobi from the workflow

  maxemiliang

  committed
  013ed53

  Copy full SHA for 013ed53

• fix: forgot to add $ to variable

  maxemiliang

  committed
  9b0dab0

  Copy full SHA for 9b0dab0

Commits on Apr 7, 2024

• fix: Use the correct way to get the version to build the paths

  maxemiliang

  committed
  9c175f8

  Copy full SHA for 9c175f8

• fix: bash variable expansion correctness

  maxemiliang

  committed
  b37251e

  Copy full SHA for b37251e

• fix: rollback to GAMS 42.3.0

  maxemiliang

  committed
  947ab13

  Copy full SHA for 947ab13

• fix: moved shot binary to its own folder in the benchmark step to avoid conflicts.

  maxemiliang

  committed
  75200e5

  Copy full SHA for 75200e5

• fix: More fixes to the benchmarker, to correctly handle permissions.

  maxemiliang

  committed
  531d8c3

  Copy full SHA for 531d8c3

Commits on Apr 17, 2024

• feat: cleanup workspace before benchmarking, to test if it helps with SHOT.

  maxemiliang

  committed
  a2a0896

  Copy full SHA for a2a0896

• chore: Added linked libraries output to debug the build

  maxemiliang

  committed
  1845a58

  Copy full SHA for 1845a58

• chore: Added linked libraries output to debug the build

  maxemiliang

  committed
  49b8a1b

  Copy full SHA for 49b8a1b

Commits on Apr 20, 2024

• feat: Moved the benchmarking to be done directly after build, to correctly used the linked binaries.

  maxemiliang

  committed
  9053d13

  Copy full SHA for 9053d13

• fix: No longer depend on the benchmarker.

  maxemiliang

  committed
  a49fd1e

  Copy full SHA for a49fd1e

• fix: always run benchmarks after build + some inputs to the benchmarker and secrets.

  maxemiliang

  committed
  ed3d84e

  Copy full SHA for ed3d84e

• fix: try to fix the usage of github workspace.

  maxemiliang

  committed
  b278758

  Copy full SHA for b278758

• fix: Updated the upload-artifacts workflow to use v4

  maxemiliang

  committed
  22447c9

  Copy full SHA for 22447c9

• fix: Fixed an issue with the benchmarker SHOT path

  maxemiliang

  committed
  13d70fe

  Copy full SHA for 13d70fe

• feat: Run proprietary license benchmarks on CI as well.

  maxemiliang

  committed
  aafcc59

  Copy full SHA for aafcc59

• fix: Download artifacts using the correct version of actions/download-artifact

  maxemiliang

  committed
  8ccdd22

  Copy full SHA for 8ccdd22

• fix: Correctly set the license file path + license file contents in benchmarker

  maxemiliang

  committed
  c6046fd

  Copy full SHA for c6046fd

• fix: Corrected the license file path in the build workflow

  maxemiliang

  committed
  c6c01b7

  Copy full SHA for c6c01b7

• fix: Artifact suffix added to benchmarker workflow

  maxemiliang

  committed
  970dfe1

  Copy full SHA for 970dfe1

• refactor: benchmarker no longer compares Gurobi/Gams to Ipopt/CBC

  maxemiliang

  committed
  4129788

  Copy full SHA for 4129788