Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Move CI infrastructure to GitHub Actions #3321

Draft
wants to merge 68 commits into
base: master
Choose a base branch
from

Conversation

JCGoran
Copy link
Collaborator

@JCGoran JCGoran commented Jan 28, 2025

According to https://github.com/orgs/community/discussions/70492#discussioncomment-7362186, public repositories have unlimited free minutes, with a time limit for each job of about 6 hours, which should be plenty for our use-case.

Since the external CIs were used for building wheels on various platforms, we now build the following wheels with GitHub Actions:

  • MacOS, x86_64 and arm64 (new, used to be manual), with Python versions 3.9 to 3.13
  • manylinux, x86_64 and aarch64, with Python versions 3.9 to 3.13

Supersedes #3213.

Would close #2359.

TODO list (not exhaustive):

  • add upload step for both nightly (automatic on schedule) and release (manual)
  • add MPT headers (do we need this?)
  • disable azure-pipelines comment bot (should probably be done after this PR is merged)
  • make the corresponding changes to:
  • update docs
  • update issue templates
  • assess how difficult is it to backport to older releases (notably 8.2); see Backport #3321 to 8.2 release #3329 for progress (UPDATE: it's not necessary to backport the CI, only the documentation would require updating)
  • remove azure pipeline as a required pipeline
  • remove circleCI as a pipeline in general
  • (optional) add GHA comment bot (note that the URL can be pasted into the various CIs we use, and a browser where one is logged in, but one cannot directly download the artifact using wget or curl without auth. To do this with a CLI tool, see here)
  • make the wheels that do not have custom versions default to using -nightly tag and correct version (see here for how setuptools-scm does that)
  • replace get-last-azure-url job in external.yml with get-last-artifact-url, and update the other ones to make it work with a GitHub comment

@JCGoran JCGoran force-pushed the jelic/move_infra_to_gha branch from a1f0eaf to c57ea5f Compare January 28, 2025 09:21
@JCGoran JCGoran force-pushed the jelic/move_infra_to_gha branch from 9ea3830 to de7d057 Compare January 28, 2025 10:12
Copy link

codecov bot commented Jan 28, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 67.08%. Comparing base (b17d872) to head (832f5f3).

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #3321   +/-   ##
=======================================
  Coverage   67.08%   67.08%           
=======================================
  Files         571      571           
  Lines      111044   111044           
=======================================
  Hits        74489    74489           
  Misses      36555    36555           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link

✔️ 6b49704 -> Azure artifacts URL

Copy link
Contributor

✔️ accacd9 -> artifacts URL

Copy link

✔️ accacd9 -> Azure artifacts URL

Copy link
Contributor

✔️ 1cc77d6 -> artifacts URL

Copy link

✔️ 1cc77d6 -> Azure artifacts URL

Copy link
Contributor

✔️ c5144ef -> artifacts URL

Copy link

✔️ c5144ef -> Azure artifacts URL

Copy link
Contributor

✔️ 5a28a75 -> artifacts URL

@JCGoran JCGoran force-pushed the jelic/move_infra_to_gha branch 2 times, most recently from c5190a0 to 5a00cab Compare February 25, 2025 13:16
Copy link
Contributor

✔️ c5190a0 -> artifacts URL

Copy link
Contributor

✔️ 5a00cab -> artifacts URL

Copy link

✔️ 5a00cab -> Azure artifacts URL

@JCGoran JCGoran force-pushed the jelic/move_infra_to_gha branch from 5a00cab to d4b2129 Compare February 25, 2025 20:37
Copy link
Contributor

✔️ d4b2129 -> artifacts URL

Copy link

✔️ d4b2129 -> Azure artifacts URL

@JCGoran JCGoran force-pushed the jelic/move_infra_to_gha branch 2 times, most recently from b9fa846 to 832f5f3 Compare February 26, 2025 11:32
Copy link
Contributor

✔️ 832f5f3 -> artifacts URL

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI Continuous Integration wheel
Projects
None yet
Development

Successfully merging this pull request may close these issues.

missing neuron-nightly for macOS M1/M2
2 participants