Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Onboard Core and plugins for the Smoke test #5247

Open
zelinh opened this issue Jan 21, 2025 · 2 comments
Open

Onboard Core and plugins for the Smoke test #5247

zelinh opened this issue Jan 21, 2025 · 2 comments
Assignees
Labels
enhancement New Enhancement

Comments

@zelinh
Copy link
Member

zelinh commented Jan 21, 2025

Since the smoke test framework (#5223) is already established, we aim to expand its capabilities by onboarding more OpenSearch API tests and selected plugin tests into the framework. This effort will enhance the testing coverage, ensuring greater reliability and functionality validation for OpenSearch and its plugins.

Objectives for the First Onboarding Phase:

OpenSearch Core API Tests:

Identify key OpenSearch APIs for inclusion in the smoke test framework.
Ensure comprehensive test coverage for critical functionalities.

Plugin Tests:

Select a few high-priority OpenSearch plugins to be onboarded during this phase.
Develop plugin-specific tests to validate their functionality when integrated with the OpenSearch core.

Collaboration with Plugin Owners:

We will work closely with plugin owners to encourage their participation in onboarding plugin tests into the smoke test framework. Providing detailed guidelines, documentation, and support will help them contribute effectively to the testing process.

Expected Outcome:

By onboarding core API tests and plugin tests, we aim to:

  • Strengthen the robustness of OpenSearch releases.
  • Provide a reliable, reusable testing framework for ongoing and future plugin validation.
@zelinh zelinh self-assigned this Jan 21, 2025
@zelinh zelinh converted this from a draft issue Jan 21, 2025
@github-actions github-actions bot added the untriaged Issues that have not yet been triaged label Jan 21, 2025
@zelinh zelinh changed the title Onboard Core and w plugins on the Smoke test Onboard Core and plugins for the Smoke test Jan 21, 2025
@zelinh
Copy link
Member Author

zelinh commented Jan 21, 2025

Tried to onboard k-NN into smoke test framework.
Able to test /_plugins/_knn/stats.

However, training model is a large task after ingesting the data, the cluster also stops every time we run /_plugins/_knn/models/_train. We would not include this as part of k-NN smoke tests.

@zelinh
Copy link
Member Author

zelinh commented Jan 22, 2025

Working on index-management plugins and successfully onboarded few essential APIs to our smoke tests.

@gaiksaya gaiksaya added enhancement New Enhancement and removed untriaged Issues that have not yet been triaged labels Jan 23, 2025
@zelinh zelinh moved this from 🆕 New to 🏗 In progress in Engineering Effectiveness Board Jan 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New Enhancement
Projects
Status: 🏗 In progress
Development

No branches or pull requests

2 participants