-
Notifications
You must be signed in to change notification settings - Fork 15.2k
[llvm][release] Reveal download links based on uploaded assets #167688
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
For the 21.x release, download links were supposed to be revealed once all the release builds had completed. In reality, MacOS never had a succesfull build so I had to hand edit the release messages. This PR fixes this by focusing instead on what is in the release assets. 1. Links are now built from a format string, with the linked files being format arguments for that string. This is a balance between ease of editing the format, and having the file names for use later. (I tried regex-ing file names out of the final links, which can work but is error prone and will be hard to debug in production) 2. uncomment_download_links now looks at the release assets to decide whether to reveal a given link line. If all the files that line links to are present, it can be revealed. This means we can still run this at the end of release-tasks.yml, where it will be atomic. Intially I was going to accumulate the statuses from the release build matrix job, but this does not seem to be possible (https://github.com/orgs/community/discussions/17245). Workarounds for this often include uploading artefacts from each job, which is for us, the same as checking the release's assets. This process is done for all assets we would like to link to, not just the ones currently built in GitHub. So if some become automatically built, they will "just work". If we want to hand edit the links in, that's still an option because the full links are in the release message, but hidden from view. As we are looking for "<!-- SOME_TAG", the script can be run multiple times on the same release and it will not try to edit anything already revealed. As it's possible no link lines have all their files, the text immediately after the links has been updated to make sense when there are no links.
| " These files are not present:", | ||
| files.difference(release_assets), | ||
| ) | ||
| print(" Link line will remain hidden.") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm leaving the prints in for logging purposes, they're not leftover debug prints.
Some example output:
Found release assets: {'clang+llvm-vX.Y.Z-1-aarch64-pc-windows-msvc.tar.xz', 'LLVM-vX.Y.Z-1-Linux-X64.tar.xz.jsonl', 'LLVM-vX.Y.Z-1-Linux-X64.tar.xz'}
Found link line "LINUX_X86":
Files required: {'LLVM-vX.Y.Z-1-Linux-X64.tar.xz.jsonl', 'LLVM-vX.Y.Z-1-Linux-X64.tar.xz'}
All files present, revealing link line.
<...>
Found link line "WINDOWS_ARM64":
Files required: {'clang+llvm-vX.Y.Z-1-aarch64-pc-windows-msvc.tar.xz.sig', 'LLVM-vX.Y.Z-1-woa64.exe', 'LLVM-vX.Y.Z-1-woa64.exe.sig', 'clang+llvm-vX.Y.Z-1-aarch64-pc-windows-msvc.tar.xz'}
These files are not present: {'clang+llvm-vX.Y.Z-1-aarch64-pc-windows-msvc.tar.xz.sig', 'LLVM-vX.Y.Z-1-woa64.exe', 'LLVM-vX.Y.Z-1-woa64.exe.sig'}
Link line will remain hidden.
Either this will never go wrong and no one will see any of it, or, more likely, it will, and this will be helpful to have in the log.
|
The script is currently run from here:
Right after the release binaries jobs have finished (with whatever status). |
|
Below is a set of generated links for a release |
For the 21.x release, download links were supposed to be revealed once all the release builds had completed. In reality, MacOS never had a successful build so I had to hand edit the release messages.
This PR fixes this by focusing instead on what is in the release assets.
(I tried regex-ing file names out of the final links, which can work but is error prone and will be hard to debug in production)
Here's an example line:
This means we can still run this at the end of release-tasks.yml, where it will be atomic.
Initially I was going to accumulate the statuses from the release build matrix job, but this does not seem to be possible (https://github.com/orgs/community/discussions/17245).
Workarounds for this often include uploading artifacts from each job, which for us, is the same as checking the release's assets.
This process is done for all assets we would like to link to, not just the ones currently built in GitHub.
So if some become automatically built, they will "just work". If we want to hand edit the links in, that's still an option because the full links are in the release message, but hidden from view.
As we are looking for
<!-- SOME_TAG, the script can be run multiple times on the same release and it will not try to edit anything already revealed.As it's possible no link lines have all their files, the text immediately after the links has been updated to make sense when there are no links.