Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Combined Jenkins Ask] Capsule testing for sanity #15948

Merged
merged 3 commits into from
Sep 18, 2024
Merged

[Combined Jenkins Ask] Capsule testing for sanity #15948

merged 3 commits into from
Sep 18, 2024

Conversation

jyejare
Copy link
Member

@jyejare jyejare commented Aug 16, 2024 •
edited
Loading

Problem Statement

Caspule Test isnt a part of sanity testing due to several reasons:

  1. Most test cases were dependent on Satellite and not on capsule
  2. The running time for sanity for separate capsule checkout and installation, configuration exceeds our target sanity runtime

Solution

Adding capsule installer test as part of sanity since Sanity is replacing bats tests in jenkins migration in delivery.

Related Issues

@jyejare jyejare requested review from a team as code owners August 16, 2024 09:39
@jyejare jyejare added CherryPick PR needs CherryPick to previous branches 6.13.z Introduced in or relating directly to Satellite 6.13 6.14.z Introduced in or relating directly to Satellite 6.14 6.15.z Introduced in or relating directly to Satellite 6.15 labels Aug 16, 2024
@jyejare
Copy link
Member Author

jyejare commented Aug 16, 2024

trigger: test-robottelo
pytest: tests/foreman/installer/test_installer.py

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 8128
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/installer/test_installer.py --external-logging
Test Result : ========== 3 deselected, 29 warnings, 21 errors in 203.12s (0:03:23) ===========

@Satellite-QE Satellite-QE added the PRT-Failed Indicates that latest PRT run is failed for the PR label Aug 16, 2024
@jyejare jyejare removed the PRT-Failed Indicates that latest PRT run is failed for the PR label Aug 16, 2024
@jyejare
Copy link
Member Author

jyejare commented Aug 16, 2024

Current S-C-H issue is still failing tests checkout in AT and hence all the tests are failed. Removing the PRT-Failed marker for now.

JacobCallahan
JacobCallahan requested changes Aug 20, 2024
View reviewed changes
Copy link
Member

@JacobCallahan JacobCallahan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A question and minor suggestion

tests/foreman/installer/test_installer.py Outdated Show resolved Hide resolved
@jyejare jyejare force-pushed the capsule_sanity branch 2 times, most recently from fe4a1c8 to b107d2f Compare August 21, 2024 11:26
@jyejare jyejare added the 6.16.z Introduced in or relating directly to Satellite 6.16 label Aug 22, 2024
@jyejare
Copy link
Member Author

jyejare commented Aug 28, 2024

trigger: test-robottelo
pytest: tests/foreman/installer/test_installer.py

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 8314
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/installer/test_installer.py --external-logging
Test Result : = 4 failed, 17 passed, 3 deselected, 618 warnings, 1 error in 11309.96s (3:08:29) =

@Satellite-QE Satellite-QE added the PRT-Failed Indicates that latest PRT run is failed for the PR label Aug 28, 2024
@jyejare
Copy link
Member Author

jyejare commented Aug 29, 2024

trigger: test-robottelo
pytest: tests/foreman/installer/test_installer.py

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 8374
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/installer/test_installer.py --external-logging
Test Result : = 4 failed, 17 passed, 3 deselected, 576 warnings, 1 error in 11268.11s (3:07:48) =

@jyejare jyejare force-pushed the capsule_sanity branch 2 times, most recently from 0e21207 to ed3241b Compare September 2, 2024 12:46
@jyejare
Copy link
Member Author

jyejare commented Sep 2, 2024

trigger: test-robottelo
pytest: tests/foreman/installer/test_installer.py

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 8420
Build Status: SUCCESS
PRT Comment: pytest tests/foreman/installer/test_installer.py --external-logging
Test Result : ========= 21 passed, 3 deselected, 551 warnings in 11401.64s (3:10:01) =========

@Satellite-QE Satellite-QE added PRT-Passed Indicates that latest PRT run is passed for the PR and removed PRT-Failed Indicates that latest PRT run is failed for the PR labels Sep 2, 2024
rmynar
rmynar approved these changes Sep 16, 2024
View reviewed changes
Copy link
Contributor

@rmynar rmynar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It may be useful to put a note that only one test of these using "module_sat_ready_rhels" may be marked with "build sanity".
But that's non-blocking. ACK

@jyejare
Copy link
Member Author

jyejare commented Sep 18, 2024

@JacobCallahan Could we merge now ?

@JacobCallahan JacobCallahan merged commit 723ec21 into SatelliteQE:master Sep 18, 2024
9 checks passed
This was referenced Sep 18, 2024
Closed
Closed
Closed
github-actions bot pushed a commit that referenced this pull request Sep 18, 2024
@jyejare @web-flow
[Combined Jenkins Ask] Capsule testing for sanity (#15948)
4ad612d 
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation

(cherry picked from commit 723ec21)
@Satellite-QE Satellite-QE mentioned this pull request Sep 18, 2024
Merged
jyejare added a commit to jyejare/robottelo that referenced this pull request Sep 19, 2024
@jyejare
[Combined Jenkins Ask] Capsule testing for sanity (SatelliteQE#15948)
b7970b0 
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation
jyejare added a commit to jyejare/robottelo that referenced this pull request Sep 19, 2024
@jyejare
[Combined Jenkins Ask] Capsule testing for sanity (SatelliteQE#15948)
e7c8f29 
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation
jyejare added a commit to jyejare/robottelo that referenced this pull request Sep 19, 2024
@jyejare
[Combined Jenkins Ask] Capsule testing for sanity (SatelliteQE#15948)
3abdf61 
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation
jyejare added a commit to jyejare/robottelo that referenced this pull request Sep 19, 2024
@jyejare
[Combined Jenkins Ask] Capsule testing for sanity (SatelliteQE#15948)
b4d6543 
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation
jyejare added a commit to jyejare/robottelo that referenced this pull request Sep 19, 2024
@jyejare
[Combined Jenkins Ask] Capsule testing for sanity (SatelliteQE#15948)
6241802 
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation
jyejare added a commit to jyejare/robottelo that referenced this pull request Sep 19, 2024
@jyejare
[Combined Jenkins Ask] Capsule testing for sanity (SatelliteQE#15948)
bcfd392 
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation
jyejare added a commit to jyejare/robottelo that referenced this pull request Sep 19, 2024
@jyejare
[Combined Jenkins Ask] Capsule testing for sanity (SatelliteQE#15948)
d5c6213 
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation
jyejare added a commit to jyejare/robottelo that referenced this pull request Sep 19, 2024
@jyejare
[Combined Jenkins Ask] Capsule testing for sanity (SatelliteQE#15948)
fe2fc62 
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation
jyejare added a commit to jyejare/robottelo that referenced this pull request Sep 20, 2024
@jyejare
[Combined Jenkins Ask] Capsule testing for sanity (SatelliteQE#15948)
4613fe8 
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation
jyejare added a commit to jyejare/robottelo that referenced this pull request Sep 20, 2024
@jyejare
[Combined Jenkins Ask] Capsule testing for sanity (SatelliteQE#15948)
7c6f8fa 
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation
jyejare added a commit to jyejare/robottelo that referenced this pull request Sep 20, 2024
@jyejare
[Combined Jenkins Ask] Capsule testing for sanity (SatelliteQE#15948)
715972d 
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation
ogajduse pushed a commit that referenced this pull request Sep 23, 2024
@jyejare
[6.15.z][Combined Jenkins Ask] Capsule testing for sanity (#15948) (#…
fc36c12 
…16420)

[Combined Jenkins Ask] Capsule testing for sanity (#15948)

* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation
ogajduse pushed a commit that referenced this pull request Sep 23, 2024
@jyejare
[6.14.z][Combined Jenkins Ask] Capsule testing for sanity (#15948) (#…
be80094 
…16421)

* [Combined Jenkins Ask] Capsule testing for sanity (#15948)

* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation

* Capsule RHEL version fix
ogajduse pushed a commit that referenced this pull request Sep 23, 2024
@jyejare
[6.13.z][Combined Jenkins Ask] Capsule testing for sanity (#15948) (#…
c61a915 
…16422)

* [Combined Jenkins Ask] Capsule testing for sanity (#15948)

* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation

* Capsule RHEL version fix
@jyejare jyejare mentioned this pull request Oct 14, 2024
Merged
jyejare added a commit to jyejare/robottelo that referenced this pull request Oct 19, 2024
@jyejare
[Combined Jenkins Ask] Capsule testing for sanity (SatelliteQE#15948)
ce05ac8 
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation
This was referenced Oct 26, 2024
Open
Open
Merged
Open
jyejare added a commit that referenced this pull request Nov 11, 2024
@jyejare
[Combined Jenkins Ask] Capsule testing for sanity (#15948)
36cbd8c 
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation

(cherry picked from commit 723ec21)
jyejare added a commit that referenced this pull request Nov 11, 2024
@Satellite-QE @jyejare
[6.16.z] [Combined Jenkins Ask] Capsule testing for sanity (#16403)
727f715 
[Combined Jenkins Ask] Capsule testing for sanity (#15948)

* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation

(cherry picked from commit 723ec21)

Co-authored-by: Jitendra Yejare <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@lpramuk lpramuk lpramuk left review comments

@rmynar rmynar rmynar approved these changes

@JacobCallahan JacobCallahan JacobCallahan approved these changes

Assignees

@jyejare jyejare

Labels
6.13.z Introduced in or relating directly to Satellite 6.13 6.14.z Introduced in or relating directly to Satellite 6.14 6.15.z Introduced in or relating directly to Satellite 6.15 6.16.z Introduced in or relating directly to Satellite 6.16 CherryPick PR needs CherryPick to previous branches Framework Changes A modification of the robottelo framework
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@jyejare @Satellite-QE @JacobCallahan @lpramuk @rmynar