Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Additional changes for the RHTAP pipeline #1343

Closed
wants to merge 39 commits into from

Conversation

kylape
Copy link
Contributor

@kylape kylape commented Dec 6, 2023

This is just another PR to allow more development of the build pipeline while the original PR #1334 is largely frozen to allow for review by the scanner team. Once that PR merges, this one will be adjusted to be reviewable by the scanner team.

A few differences from the standard RHTAP build pipeline:

* Use of 6GB buildah image to avoid OOMs during container build task
* There is an extra step to fetch the vuln feed data.  This is done
  outside of the build step to make hermetic builds easier.

The vuln feed data script pulls the definitions from the Google storage
location and writes them to the "source" folder of the "source"
workspace which is shared by the build-container task.  This task will
build using `image/scanner/rhtap/Dockerfile`, which expects the vuln
files to be in the buildah working directory.

I decided to create a separate dockerfile for RHTAP to avoid any
regressions with modifying the existing ones.  The dockerfile was
created using a combination of the upstream and downstream dockerfiles.

Current RHTAP build trigger config:

* PRs will only build in RHTAP when "rhtap" is in the branch name
* Pushes to master will trigger an RHTAP build
This reverts commit f627931.
kylape and others added 9 commits December 5, 2023 21:47
This reverts commit aa1d705.
This will hopefully speed up the build a bit.

Some other changes:

* Switched to the builder image from brew instead of from quay.io/stackrox-io
* Cleaned up some debug statements
* The buildah container no longer needs to be 6Gi
* Moved unzipping the vuln dumps into the gen-vuln-feed-data step
* Removed the builder image altogether from the dockerfile
@ghost
Copy link

ghost commented Dec 6, 2023

Images are ready for the commit at 5fe26ec.

To use the images, use the tag 2.31.x-86-g5fe26ecf5f.

Copy link

openshift-ci bot commented Dec 6, 2023

@kylape: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-tests 5fe26ec link false /test e2e-tests

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@kylape kylape closed this Jan 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant