add automation test configs #14455
Merged
add automation test configs #14455
+231
−4
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Contributor
anirudhwarrier
commented
Sep 17, 2024
•
anirudhwarrier
commented
- - Running automation-nightly-tests - https://github.com/smartcontractkit/chainlink/actions/runs/10925168333
- - Running automation-benchmark-test - https://github.com/smartcontractkit/chainlink/actions/runs/10933862447
- - Running automation-load-test - https://github.com/smartcontractkit/chainlink/actions/runs/10934197701
- - Running automation-benchmark-test - (soak) - https://github.com/smartcontractkit/chainlink/actions/runs/10934677949
…to TT-1550-automation
…to TT-1550-automation
…to TT-1550-automation
…to TT-1550-automation
…to TT-1550-automation
…to TT-1550-automation
…to TT-1550-automation
…nlink into TT-1550-automation
…to TT-1550-automation
anirudhwarrier
force-pushed
the
TT-1550-automation
branch
from
14363c0
to
a3adca5
Compare
anirudhwarrier
force-pushed
the
TT-1550-Provide-PoC-for-keeping-test-configs-in-git
branch
from
090ea7a
to
a319182
Compare
…to TT-1550-automation
anirudhwarrier
force-pushed
the
TT-1550-automation
branch
from
4405a41
to
dd5c3e0
Compare
anirudhwarrier
force-pushed
the
TT-1550-automation
branch
from
fb2fe5b
to
151bcad
Compare
anirudhwarrier
force-pushed
the
TT-1550-automation
branch
from
b0f26ad
to
17edcfd
Compare
anirudhwarrier
force-pushed
the
TT-1550-automation
branch
from
17edcfd
to
937607c
Compare
This reverts commit 937607c.
anirudhwarrier
merged commit 7e6f7f4
into
TT-1550-Provide-PoC-for-keeping-test-configs-in-git
63 of 64 checks passed
|
github-merge-queue bot
pushed a commit
that referenced
this pull request
Sep 23, 2024
) * Update some test workflows to run with test config path * Fix summary * Fix * Update on-demand-ocr-soak-test.yml * Run vrfplus tests on ARBITRUM_SEPOLIA on existing env * Add config for staging release testing on arbitrum sepolia * Show test_secrets_override_key in summary * Generate hash of integration-tests/ for test runner image if tag not provided * test updating config but not rebuilding test image * Fix test_runner_hash * Commit all configs for staging * test config change * Update release configs * Do not rebuild test image when md or .github files were changed * Add wemix testnet config for ocrv2 soak test * Use chainlink version from config * Update reusable workflow inputs * Add soak/ocr_test.go:^TestOCRv2Soak$WemixTestnet to CI tests * Fix * Fix test image tag * Remove image from default.toml * Fix chainlink_version * Fix test image hash value * Fix summary * Update workflow * Update config overrides, read from default, env vars and then from BASE64_CONFIG_OVERRIDE if exists BASE64_CONFIG_OVERRIDE should be able to override everything that was already set in the test config * Build chainlink image sha if required * Fix * Add new workflow * Show test config path in reusable workflow * Update list of tests * Update run-selected-tests workflow * Fix * Rename steps * fix workflow * Add TestVRFv2Plus_LiveTestnets to CI tests definition * Fix * Run vrfv2plus tests on simulated network by default * Fix * fix * fix * Update test definition * Add TestVRFv2Plus_Release_Sepolia * Add workflow to run vrf e2e release tests * test new workflow with slack notification * fix * fix * fix * fix color * fix * revert if * revert test definition changes * Add test_secrets_override_key * fix for slack notification after test * TT-1550: reorganizing VRF V2 Plus configs * Use test_config_override_path instead of base64 in other VRFv2Plus workflows * remove file * Refactor on-demand-vrfv2plus-performance-test.yml * Add slack notification for on-demand-vrfv2plus-smoke-tests.yml * Fix * fix 2 * remove debug info * update color of slack notification * Migrate on-demand-vrfv2-eth2-clients-test * Migrate on-demand-ocr-soak-test.yml (WIP) * Rename step * update test names * fix * fix name * fix * Migrate automation-nightly-tests.yml * Build remote runner image asap * Fix * add ocr2 celo_alfajores and base_sepolia test configs * Fix * Fix * Migrate automation-benchmark-tests.yml * fix * Migrate automation-load-tests.yml * Migrate on-demand-vrfv2-eth2-clients-test.yml * Migrate on-demand-vrfv2-performance-test.yml * Remove unused actions * Always show console logs for ocr tests * Allow custom docker test artifacts * Migrate ccip-load-tests.yml * revert this commits * fix ARTIFACT_PATHS * fix * Allow to upload custom test artifacts * Fux * Fix * Clean up toml examples * Remove unused live-testnet-tests.yml workflow Confirmed with Adam * Remove old action * Fix * Fix * update test duration to 24h * Fix citool * debug artifacts on failure * debug * Fix * Use ubuntu-latest * Update workflow slack notifications * Fix test id when running custom tests * Fix * Fix * Add OCR test configs * remove unused workflow * Add slack notifications for vrfv2 workflows * Fix slack notifications for automation workflows * Fix SLACK_USER input in on-demand-ocr-soak-test.yml * Do not use github.sha as default chainlink version * Remove chainlink_version input form automation workflows. Use config instead * update base sepolia test config duration to 1h * Fix * Do not upload cpu and memory profile by default * Do not set E2E_TEST_PYROSCOPE_ENABLED. Get it from toml config instead * reverting base sepolia duration to 24h * Fix TEST_UPLOAD_CPU_PROFILE and TEST_UPLOAD_MEM_PROFILE * debug TEST_UPLOAD_CPU_PROFILE * Read config from env var first then override with TOML * remove debug info * Include tag and sha in workflow slack notification * Fix notification Do not use link for tag because it may not exist. Use short sha. * Revert "Read config from env var first then override with TOML" This reverts commit 2b2fb18. * Fix and bump ctf * go mod tidy * bump ctf * add automation test configs (#14455) * add automation test configs * update grafana config * update testid in workflow * update testid in e2e-tests * restructure configs * update config * add testType input in benchmark workflow * add testType input in e2e reusable workflow * Revert "add testType input in e2e reusable workflow" This reverts commit 937607c. * update benchmark workflow * update test log level for load and benchmark --------- Co-authored-by: lukaszcl <[email protected]> * Increase test_log_upload_retention_days from 3 to 5 * Fix * Debug CCIP Load Test in E2E Workflow Conversion (#14479) Fixes CCIP load tests * Run selected e2e tests in merge queue * Run selected e2e tests in merge queue part 2 * Run selected e2e tests in merge queue part 3 * Use [email protected] * Fix suites for k8s tests Use test_suite input and matrix.tests.test_env_vars.TEST_SUITE to set test suites for tests in e2e-tests.yml * Update gha * Rename step * Update run-tests GHA * update testsconfigs to use ocr common --------- Co-authored-by: Ilja Pavlovs <[email protected]> Co-authored-by: joaoluisam <[email protected]> Co-authored-by: davidcauchi <[email protected]> Co-authored-by: Anirudh Warrier <[email protected]> Co-authored-by: Adam Hamrick <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.