You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
What would you like to be added:
During the quality gate we want to check if results are being tested from > 70% of namespaces.
Example: coverage of namespaces sampled is at 71%, a user adds a new provider that adds a new namespace, coverage would drop < 70% causing the gate to fail since the new namespace is not yet exercised by at least one test image.
Why is this needed:
To catch if there are failures using our test data against current/new providers before running a vunnel release
Additional context:
The tools team is able to point to a Post-Mortem regarding missing debian data that resulted in this issue being filed
The text was updated successfully, but these errors were encountered:
spiffcs
changed the title
Test: quality gate for percentage of namespaces covered
Test: add quality gate for percentage of namespaces covered
Sep 29, 2023
spiffcs
changed the title
Test: add quality gate for percentage of namespaces covered
Test: add quality gate for percentage of namespaces exercised by at least one test image
Sep 29, 2023
What would you like to be added:
During the quality gate we want to check if results are being tested from > 70% of namespaces.
Example: coverage of namespaces sampled is at 71%, a user adds a new provider that adds a new namespace, coverage would drop < 70% causing the gate to fail since the new namespace is not yet exercised by at least one test image.
Why is this needed:
To catch if there are failures using our test data against current/new providers before running a vunnel release
Additional context:
The tools team is able to point to a Post-Mortem regarding missing debian data that resulted in this issue being filed
The text was updated successfully, but these errors were encountered: