plugins: Introduce test-subset plugin

[oshoval]

Allows to run specific labels on a lane
/test-subset <job-name> <labels>

It will create a job, inject the label to its env var, and give it a unique suffix, so it won't
affect the official jobs.
Opposed to focus (which is also not encouraged, now that we have labels), the job won't fail if all lanes
pass, which reduce emails, comments, and the need to manually look on the job results on both cases.

[kubevirt-bot]

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

[kubevirt-bot]

@oshoval: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
pull-prow-kubevirt-labels-update-precheck	cb31120	link	true	/test pull-prow-kubevirt-labels-update-precheck
pull-prow-nmstate-labels-update-precheck	cb31120	link	true	/test pull-prow-nmstate-labels-update-precheck

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

[oshoval]

@oshoval: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
pull-prow-kubevirt-labels-update-precheck cb31120 link true /test pull-prow-kubevirt-labels-update-precheck
pull-prow-nmstate-labels-update-precheck cb31120 link true /test pull-prow-nmstate-labels-update-precheck

how come it runs it on draft

[oshoval]

/close

lets reopen once / if we are back to it

[dhiller]

/cc

[oshoval]

resolved conflicts only

[kubevirt-bot]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign brianmcarey for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[oshoval]

@brianmcarey @dhiller
before i rename it (anyhow it is still wip),
do you like the name Daniel suggest test-subset ?

btw, maybe better to consider a name without - ?
easier to trigger it, and maybe looks bit nicer on the manifests (but this is nit)

[dhiller]

@brianmcarey @dhiller before i rename it (anyhow it is still wip), do you like the name Daniel suggest test-subset ?

btw, maybe better to consider a name without - ? easier to trigger it, and maybe looks bit nicer on the manifests (but this is nit)

IMHO the dash should stay for readability reasons, also it seems common practice to use it as can be seen on our command help page: https://prow.ci.kubevirt.io/command-help

[oshoval]

renamed