Skip to content

Latest commit

 

History

History
141 lines (102 loc) · 3.89 KB

CONTRIBUTING.md

File metadata and controls

141 lines (102 loc) · 3.89 KB
Raw

Steps to release

Note: These steps can also be used to release a docker-cloud-action image to test your changes.

Step 1. Log into docker ghcr.io

See authenticate to GHCR with a PAT.

If you have a PAT handy you can just do:

% echo $YOUR_GITHUB_PAT | docker login ghcr.io -u $YOUR_GITHUB_USERNAME --password-stdin

Step 2. Determine the new point version and create a release branch,

% git checkout main
% git fetch origin --tags --force
% git tag
pex-v0.1
pex-v0.1.14
prha
v0.1
v0.1.10
v0.1.11
v0.1.12
v0.1.13
v0.1.14
v0.1.15
v0.1.16
v0.1.17
v0.1.18
v0.1.19
v0.1.20
v0.1.21

The point version is the next unused v0.1.* version, eg v0.1.22 above. Create a release branch

% git checkout -b release-0.1.22

Step 3. Build and deploy a new docker-cloud-action image, a new dagster.cloud.pex and update code references to docker

A script does this work. Note: a virtual environment using Python3.11 is required to run the script.

# Note no 'v' prefix
# This accepts `NEW_VERSION OLD_VERSION` so it can update code references from the old to the new version.
% python scripts/release.py create-rc 0.1.22 0.1.21

This leaves uncommitted changes in the working directory.

Commit and tag the new version

View changes made by the release script
% git diff

# Commit
% git add . && git commit -m "Rebuild"

# Tag: using '-a' lets us add an annotation message, typically we use the version "v0.1.22"
% git tag -a v0.1.22

Step 5. Push and Test

# push the release branch
% git push --set-upstream origin release-0.1.22
# push the tag
% git push origin v0.1.22
# to test, change the reference in a github workflow yaml file `@v0.1 -> @v0.1.22` and `@pex-v0.1 -> @v0.1.22`
# see also dagster-cloud-action-test

It is recommended to test the release with both Serverless and Hybrid deployments.

Serverless:

  • GitLab: Deploy to a test organization in Dagster+ after updating the image version in the CI/CD file.
  • GitHub: Deploy to a test organization in Dagster+ with both PEX and docker deployments.

Hybrid:

  • GitHub: Create a new branch in the Hooli repo to update the tags with the new version in the CI/CD file. Push your changes and open a PR to test the deployment to Dagster+.

Step 5b. Iterate

If you make any changes and rebuild the rc, you need to retag and push the release tag:

python scripts/release.py create-rc 0.1.22 0.1.21

# the only autogenerated change should be to the pex file because changes to the yamls have already committed

# -f to force since the tag exists
git tag -f -a v0.1.22
git push -f origin v0.1.22

# test again, fix and repeat

Step 6. Promote

Most users point at a dot version tag for the GitHub Action, e.g. @v0.1 and @pex-v0.1. If you are releasing a fix or non-breaking feature, you want to move this tag so existing users get access to your changes.

Due an unfortunate bug, the ci-summary step in many user's workflow is pinned to v0.1.27, so we need v0.1.27 to follow v0.1 as well. See https://github.com/dagster-io/dagster-cloud-hybrid-quickstart/commit/2149359dd1076f3bcd6f652dc00cb74ac9c81636

# use '-f' to force move the tag, since these tags already exist
git tag -f v0.1 v0.1.22
git tag -f pex-v0.1 v0.1.22
git tag -f v0.1.27 v0.1

# needs a force push to move remote tags
git push -f origin v0.1
git push -f origin pex-v0.1
git push -f origin v0.1.27

Note: both v0.1 and pex-v0.1 tags should be kept in sync.

Step 7. Merge the release branch into main

Create a PR, get approval, merge.

Step 8. (optional) Revert

To revert, just tag the previous point version with the live tag and re push

git tag -f v0.1 v0.1.21
git tag -f pex-v0.1 v0.1.21
git push -f origin v0.1
git push -f origin pex-v0.1