Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Security Soluiton] Add logging and unskip rule bootstrap test #203799

Closed
wants to merge 1 commit into from

Conversation

xcrzx
Copy link
Contributor

@xcrzx xcrzx commented Dec 11, 2024

@xcrzx xcrzx requested a review from kibanamachine as a code owner December 11, 2024 13:32
@xcrzx xcrzx self-assigned this Dec 11, 2024
@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#7578

[✅] x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/configs/ess.config.ts: 25/25 tests passed.

see run history

@elasticmachine
Copy link
Contributor

💛 Build succeeded, but was flaky

Failed CI Steps

Metrics [docs]

✅ unchanged

cc @xcrzx

banderror added a commit that referenced this pull request Dec 24, 2024
…point (#205106)

**Fixes: #197108
**Fixes: #202037
**Fixes: #203632

## Summary

Builds on top of #203799 and:

- simplifies the package deletion code (1 [API
call](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)
instead of 2, per package)
- adds retry logic
- refactors the testing utils a bit

Flaky test runs:

-
[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)
- 190 runs
-
[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)
- 100 runs

## Details

Here's how the test logs look like:

```
 info Starting tests

 └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management
   └-> "before all" hook: beforeTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"
   └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules
     └-> "before all" hook: beforeTestSuite.trigger for "should install fleet packages required for detection engine to function"
     └-> should install fleet packages required for detection engine to function
       └-> "before each" hook: global before each for "should install fleet packages required for detection engine to function"
       └-> "before each" hook for "should install fleet packages required for detection engine to function"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'security_detection_engine is not installed'
         │      }
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'endpoint is not installed'
         │      }
       └- ✓ pass  (21.6s)
     └-> should skip installing fleet packages if they are already installed
       └-> "before each" hook: global before each for "should skip installing fleet packages if they are already installed"
       └-> "before each" hook for "should skip installing fleet packages if they are already installed"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was installed)
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was installed)
       └- ✓ pass  (22.4s)
     └-> "after all" hook: afterTestSuite.trigger for "should skip installing fleet packages if they are already installed"
   └-> "after all" hook: afterTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"

2 passing (1.0m)
```

### Checklist

- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed
@banderror
Copy link
Contributor

Addressed in #205106

@banderror banderror closed this Dec 24, 2024
banderror added a commit to banderror/kibana that referenced this pull request Dec 24, 2024
…point (elastic#205106)

**Fixes: elastic#197108
**Fixes: elastic#202037
**Fixes: elastic#203632

## Summary

Builds on top of elastic#203799 and:

- simplifies the package deletion code (1 [API
call](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)
instead of 2, per package)
- adds retry logic
- refactors the testing utils a bit

Flaky test runs:

-
[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)
- 190 runs
-
[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)
- 100 runs

## Details

Here's how the test logs look like:

```
 info Starting tests

 └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management
   └-> "before all" hook: beforeTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"
   └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules
     └-> "before all" hook: beforeTestSuite.trigger for "should install fleet packages required for detection engine to function"
     └-> should install fleet packages required for detection engine to function
       └-> "before each" hook: global before each for "should install fleet packages required for detection engine to function"
       └-> "before each" hook for "should install fleet packages required for detection engine to function"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'security_detection_engine is not installed'
         │      }
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'endpoint is not installed'
         │      }
       └- ✓ pass  (21.6s)
     └-> should skip installing fleet packages if they are already installed
       └-> "before each" hook: global before each for "should skip installing fleet packages if they are already installed"
       └-> "before each" hook for "should skip installing fleet packages if they are already installed"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was installed)
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was installed)
       └- ✓ pass  (22.4s)
     └-> "after all" hook: afterTestSuite.trigger for "should skip installing fleet packages if they are already installed"
   └-> "after all" hook: afterTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"

2 passing (1.0m)
```

### Checklist

- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed

(cherry picked from commit 71144ed)

# Conflicts:
#	x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_endpoint_fleet_package.ts
#	x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_prebuilt_rules_fleet_package.ts
banderror added a commit to banderror/kibana that referenced this pull request Dec 24, 2024
…point (elastic#205106)

**Fixes: elastic#197108
**Fixes: elastic#202037
**Fixes: elastic#203632

## Summary

Builds on top of elastic#203799 and:

- simplifies the package deletion code (1 [API
call](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)
instead of 2, per package)
- adds retry logic
- refactors the testing utils a bit

Flaky test runs:

-
[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)
- 190 runs
-
[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)
- 100 runs

## Details

Here's how the test logs look like:

```
 info Starting tests

 └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management
   └-> "before all" hook: beforeTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"
   └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules
     └-> "before all" hook: beforeTestSuite.trigger for "should install fleet packages required for detection engine to function"
     └-> should install fleet packages required for detection engine to function
       └-> "before each" hook: global before each for "should install fleet packages required for detection engine to function"
       └-> "before each" hook for "should install fleet packages required for detection engine to function"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'security_detection_engine is not installed'
         │      }
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'endpoint is not installed'
         │      }
       └- ✓ pass  (21.6s)
     └-> should skip installing fleet packages if they are already installed
       └-> "before each" hook: global before each for "should skip installing fleet packages if they are already installed"
       └-> "before each" hook for "should skip installing fleet packages if they are already installed"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was installed)
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was installed)
       └- ✓ pass  (22.4s)
     └-> "after all" hook: afterTestSuite.trigger for "should skip installing fleet packages if they are already installed"
   └-> "after all" hook: afterTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"

2 passing (1.0m)
```

### Checklist

- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed

(cherry picked from commit 71144ed)

# Conflicts:
#	x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/bootstrap_prebuilt_rules.ts
#	x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_endpoint_fleet_package.ts
#	x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_prebuilt_rules_fleet_package.ts
banderror added a commit to banderror/kibana that referenced this pull request Dec 24, 2024
…point (elastic#205106)

**Fixes: elastic#197108
**Fixes: elastic#202037
**Fixes: elastic#203632

## Summary

Builds on top of elastic#203799 and:

- simplifies the package deletion code (1 [API
call](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)
instead of 2, per package)
- adds retry logic
- refactors the testing utils a bit

Flaky test runs:

-
[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)
- 190 runs
-
[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)
- 100 runs

## Details

Here's how the test logs look like:

```
 info Starting tests

 └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management
   └-> "before all" hook: beforeTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"
   └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules
     └-> "before all" hook: beforeTestSuite.trigger for "should install fleet packages required for detection engine to function"
     └-> should install fleet packages required for detection engine to function
       └-> "before each" hook: global before each for "should install fleet packages required for detection engine to function"
       └-> "before each" hook for "should install fleet packages required for detection engine to function"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'security_detection_engine is not installed'
         │      }
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'endpoint is not installed'
         │      }
       └- ✓ pass  (21.6s)
     └-> should skip installing fleet packages if they are already installed
       └-> "before each" hook: global before each for "should skip installing fleet packages if they are already installed"
       └-> "before each" hook for "should skip installing fleet packages if they are already installed"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was installed)
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was installed)
       └- ✓ pass  (22.4s)
     └-> "after all" hook: afterTestSuite.trigger for "should skip installing fleet packages if they are already installed"
   └-> "after all" hook: afterTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"

2 passing (1.0m)
```

### Checklist

- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed

(cherry picked from commit 71144ed)

# Conflicts:
#	x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_endpoint_fleet_package.ts
#	x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_prebuilt_rules_fleet_package.ts
banderror added a commit that referenced this pull request Dec 24, 2024
…rap endpoint (#205106) (#205134)

# Backport

This will backport the following commits from `main` to `8.17`:
- [[Security Solution] Unskip tests for the prebuilt rules bootstrap
endpoint (#205106)](#205106)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Georgii
Gorbachev","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-12-24T09:58:37Z","message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","v9.0.0","Team:Detections
and Resp","Team: SecuritySolution","Team:Detection Rule
Management","Feature:Prebuilt Detection
Rules","backport:version","v8.18.0","v8.16.3","v8.17.1"],"number":205106,"url":"https://github.com/elastic/kibana/pull/205106","mergeCommit":{"message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16","8.17"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","labelRegex":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/205106","number":205106,"mergeCommit":{"message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},{"branch":"8.x","label":"v8.18.0","labelRegex":"^v8.18.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.3","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.17","label":"v8.17.1","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->
banderror added a commit that referenced this pull request Dec 24, 2024
…ap endpoint (#205106) (#205133)

# Backport

This will backport the following commits from `main` to `8.x`:
- [[Security Solution] Unskip tests for the prebuilt rules bootstrap
endpoint (#205106)](#205106)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Georgii
Gorbachev","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-12-24T09:58:37Z","message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","v9.0.0","Team:Detections
and Resp","Team: SecuritySolution","Team:Detection Rule
Management","Feature:Prebuilt Detection
Rules","backport:version","v8.18.0","v8.16.3","v8.17.1"],"number":205106,"url":"https://github.com/elastic/kibana/pull/205106","mergeCommit":{"message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16","8.17"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","labelRegex":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/205106","number":205106,"mergeCommit":{"message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},{"branch":"8.x","label":"v8.18.0","labelRegex":"^v8.18.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.3","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.17","label":"v8.17.1","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->
banderror added a commit that referenced this pull request Dec 24, 2024
…rap endpoint (#205106) (#205135)

# Backport

This will backport the following commits from `main` to `8.16`:
- [[Security Solution] Unskip tests for the prebuilt rules bootstrap
endpoint (#205106)](#205106)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Georgii
Gorbachev","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-12-24T09:58:37Z","message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","v9.0.0","Team:Detections
and Resp","Team: SecuritySolution","Team:Detection Rule
Management","Feature:Prebuilt Detection
Rules","backport:version","v8.18.0","v8.16.3","v8.17.1"],"number":205106,"url":"https://github.com/elastic/kibana/pull/205106","mergeCommit":{"message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16","8.17"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","labelRegex":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/205106","number":205106,"mergeCommit":{"message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},{"branch":"8.x","label":"v8.18.0","labelRegex":"^v8.18.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.3","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.17","label":"v8.17.1","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants