Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FailsOnMKI] Observability AI Assistant API Integration tests.x-pack/test_serverless/api_integration/test_suites/observability/ai_assistant/tests/knowledge_base/knowledge_base.spec.ts #205581

Open
pheyos opened this issue Jan 6, 2025 · 1 comment · May be fixed by #205779
Open

[FailsOnMKI] Observability AI Assistant API Integration tests.x-pack/test_serverless/api_integration/test_suites/observability/ai_assistant/tests/knowledge_base/knowledge_base.spec.ts #205581

pheyos opened this issue Jan 6, 2025 · 1 comment · May be fixed by #205779
Assignees
@neptunian
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Obs AI Assistant Observability AI Assistant

Comments

@pheyos
Copy link
Member

pheyos commented Jan 6, 2025 •
edited
Loading

The serverless Observability AI assistant knowledge base API integration tests are failing conistently when running on MKI since they have been unskipped in #205519.

Test file: x-pack/test_serverless/api_integration/test_suites/observability/ai_assistant/tests/knowledge_base/knowledge_base.spec.ts

Failures

Observability AI Assistant API tests knowledge_base/knowledge_base.spec.ts Knowledge base when managing a single entry returns 200 on create

Failure message

Error: expected 200 "OK", got 500 "Internal Server Error"
    at Context.apply (knowledge_base.spec.ts:58:12)
    at Object.apply (wrap_function.js:74:30)
----
    at Test._assertStatus (node_modules/supertest/lib/test.js:252:14)
    at /root/.qaf/data/git/kibana/node_modules/supertest/lib/test.js:308:13
    at Test._assertFunction (node_modules/supertest/lib/test.js:285:13)
    at Test.assert (node_modules/supertest/lib/test.js:164:23)
    at localAssert (node_modules/supertest/lib/test.js:120:14)
    at fn (node_modules/supertest/lib/test.js:125:7)
    at Test.callback (node_modules/supertest/node_modules/superagent/src/node/index.js:899:3)
    at fn (node_modules/supertest/node_modules/superagent/src/node/index.js:1165:18)
    at IncomingMessage. (node_modules/supertest/node_modules/superagent/src/node/parsers/json.js:19:7)
    at IncomingMessage.emit (node:events:531:35)
    at endReadableNT (node:internal/streams/readable:1696:12)
    at processTicksAndRejections (node:internal/process/task_queues:82:21)

Observability AI Assistant API tests knowledge_base/knowledge_base.spec.ts Knowledge base when managing a single entry returns 200 on get entries and entry exists

Failure message

TypeError: Cannot read properties of undefined (reading 'id')
    at Context. (knowledge_base.spec.ts:89:22)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Object.apply (wrap_function.js:74:16)

Observability AI Assistant API tests knowledge_base/knowledge_base.spec.ts Knowledge base when managing a single entry returns 200 on delete

Failure message

Error: expected 200 "OK", got 500 "Internal Server Error"
    at Context.apply (knowledge_base.spec.ts:103:12)
    at Object.apply (wrap_function.js:74:30)
----
    at Test._assertStatus (node_modules/supertest/lib/test.js:252:14)
    at /root/.qaf/data/git/kibana/node_modules/supertest/lib/test.js:308:13
    at Test._assertFunction (node_modules/supertest/lib/test.js:285:13)
    at Test.assert (node_modules/supertest/lib/test.js:164:23)
    at localAssert (node_modules/supertest/lib/test.js:120:14)
    at fn (node_modules/supertest/lib/test.js:125:7)
    at Test.callback (node_modules/supertest/node_modules/superagent/src/node/index.js:899:3)
    at fn (node_modules/supertest/node_modules/superagent/src/node/index.js:1165:18)
    at IncomingMessage. (node_modules/supertest/node_modules/superagent/src/node/parsers/json.js:19:7)
    at IncomingMessage.emit (node:events:531:35)
    at endReadableNT (node:internal/streams/readable:1696:12)
    at processTicksAndRejections (node:internal/process/task_queues:82:21)

Observability AI Assistant API tests knowledge_base/knowledge_base.spec.ts Knowledge base when managing multiple entries "before each" hook for "returns 200 on create"

Failure message

Error: expected 200 "OK", got 500 "Internal Server Error"
    at Context. (knowledge_base.spec.ts:181:12)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Object.apply (wrap_function.js:74:16)
----
    at Test._assertStatus (node_modules/supertest/lib/test.js:252:14)
    at /root/.qaf/data/git/kibana/node_modules/supertest/lib/test.js:308:13
    at Test._assertFunction (node_modules/supertest/lib/test.js:285:13)
    at Test.assert (node_modules/supertest/lib/test.js:164:23)
    at localAssert (node_modules/supertest/lib/test.js:120:14)
    at fn (node_modules/supertest/lib/test.js:125:7)
    at Test.callback (node_modules/supertest/node_modules/superagent/src/node/index.js:899:3)
    at fn (node_modules/supertest/node_modules/superagent/src/node/index.js:1165:18)
    at IncomingMessage. (node_modules/supertest/node_modules/superagent/src/node/parsers/json.js:19:7)
    at IncomingMessage.emit (node:events:531:35)
    at endReadableNT (node:internal/streams/readable:1696:12)
    at processTicksAndRejections (node:internal/process/task_queues:82:21)
@pheyos pheyos added failed-test A test failure on a tracked branch, potentially flaky-test Team:Obs AI Assistant Observability AI Assistant labels Jan 6, 2025
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ai-assistant (Team:Obs AI Assistant)

@pheyos pheyos changed the title [FailsOnMKI] Observability AI Assistant API Integration tests.x-pack/test_serverless/api_integration/test_suites/observability/ai_assistant/tests/knowledge_base/knowledge_base·spec.ts [FailsOnMKI] Observability AI Assistant API Integration tests.x-pack/test_serverless/api_integration/test_suites/observability/ai_assistant/tests/knowledge_base/knowledge_base.spec.ts Jan 6, 2025
@pheyos pheyos mentioned this issue Jan 6, 2025
Merged
pheyos added a commit that referenced this issue Jan 6, 2025
@pheyos
Skip serverless AI assistant knowledge base tests on MKI (#205582)
69cb966 
## Summary

This PR skips the serverless API integration tests for Observability AI
assistant knowledge base for MKI runs.

Details in #205581
kibanamachine pushed a commit to kibanamachine/kibana that referenced this issue Jan 6, 2025
@pheyos
Skip serverless AI assistant knowledge base tests on MKI (elastic#205582
90e68ac 
)

## Summary

This PR skips the serverless API integration tests for Observability AI
assistant knowledge base for MKI runs.

Details in elastic#205581

(cherry picked from commit 69cb966)
kibanamachine added a commit that referenced this issue Jan 6, 2025
@kibanamachine @pheyos
[8.x] Skip serverless AI assistant knowledge base tests on MKI (#205582…
88dad1b 
…) (#205590)

# Backport

This will backport the following commits from `main` to `8.x`:
- [Skip serverless AI assistant knowledge base tests on MKI
(#205582)](#205582)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Robert
Oskamp","email":"[email protected]"},"sourceCommit":{"committedDate":"2025-01-06T10:07:24Z","message":"Skip
serverless AI assistant knowledge base tests on MKI (#205582)\n\n##
Summary\r\n\r\nThis PR skips the serverless API integration tests for
Observability AI\r\nassistant knowledge base for MKI
runs.\r\n\r\nDetails in
#205581","sha":"69cb96654bb0f0018dfe19130046653d45963291","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","backport:prev-minor","v8.18.0"],"title":"Skip
serverless AI assistant knowledge base tests on
MKI","number":205582,"url":"https://github.com/elastic/kibana/pull/205582","mergeCommit":{"message":"Skip
serverless AI assistant knowledge base tests on MKI (#205582)\n\n##
Summary\r\n\r\nThis PR skips the serverless API integration tests for
Observability AI\r\nassistant knowledge base for MKI
runs.\r\n\r\nDetails in
#205581","sha":"69cb96654bb0f0018dfe19130046653d45963291"}},"sourceBranch":"main","suggestedTargetBranches":["8.x"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/205582","number":205582,"mergeCommit":{"message":"Skip
serverless AI assistant knowledge base tests on MKI (#205582)\n\n##
Summary\r\n\r\nThis PR skips the serverless API integration tests for
Observability AI\r\nassistant knowledge base for MKI
runs.\r\n\r\nDetails in
#205581","sha":"69cb96654bb0f0018dfe19130046653d45963291"}},{"branch":"8.x","label":"v8.18.0","branchLabelMappingKey":"^v8.18.0$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Robert Oskamp <[email protected]>
@pheyos pheyos mentioned this issue Jan 7, 2025
Open
@neptunian neptunian self-assigned this Jan 7, 2025
@neptunian neptunian linked a pull request Jan 7, 2025 that will close this issue
Draft
kowalczyk-krzysztof pushed a commit to kowalczyk-krzysztof/kibana that referenced this issue Jan 7, 2025
@pheyos @kowalczyk-krzysztof
Skip serverless AI assistant knowledge base tests on MKI (elastic#205582
83016aa 
)

## Summary

This PR skips the serverless API integration tests for Observability AI
assistant knowledge base for MKI runs.

Details in elastic#205581
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@neptunian neptunian

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Obs AI Assistant Observability AI Assistant
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Obs AI Assistant] fix knowledge base tests failing in MKI neptunian/kibana
3 participants
@neptunian @pheyos @elasticmachine