Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TT-1473 Refactor integration-tests.yml workflow to use run-e2e-tests-reusable-workflow.yml #14134

Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
88 commits
Select commit Hold shift + click to select a range
02d17d2
wip
lukaszcl Aug 12, 2024
993ba93
fix secrets and test log level
lukaszcl Aug 12, 2024
9cd107e
comment eth-smoke-tests-matrix-automation and use reusable workflow i…
lukaszcl Aug 12, 2024
8151eca
comment eth-smoke-tests-matrix-log-poller and use reusable workflow i…
lukaszcl Aug 12, 2024
d7af61f
Fix
lukaszcl Aug 12, 2024
cd9a7a8
migrate node upgrade tests
lukaszcl Aug 12, 2024
07c3700
fix test_config_chainlink_upgrade_version
lukaszcl Aug 12, 2024
e62aec8
use default workflow name
lukaszcl Aug 12, 2024
75076ee
bump run-tests
lukaszcl Aug 12, 2024
81f2817
comment compare-tests
lukaszcl Aug 12, 2024
9bc7829
add name to reusable workflow
lukaszcl Aug 12, 2024
c816f72
Add chainlink-testing-framework/show-test-summary to reusable workflo…
lukaszcl Aug 12, 2024
8277557
Move Upload CL Node Coverage Data Artifacts to reusable workflow
lukaszcl Aug 12, 2024
cda6db7
Fix
lukaszcl Aug 12, 2024
646ca45
Update cl node coverage artifact prefix
lukaszcl Aug 12, 2024
67fa16d
Update reusable workflow to have test results as output
lukaszcl Aug 12, 2024
851b8ec
Fix
lukaszcl Aug 12, 2024
be73357
fix
lukaszcl Aug 12, 2024
3cf5918
test
lukaszcl Aug 12, 2024
9085fea
fix
lukaszcl Aug 12, 2024
ab5c9a8
remove old node migration tests
lukaszcl Aug 12, 2024
b5bfb47
migrate otel traces steps to reusable workflow
lukaszcl Aug 14, 2024
a57b3c8
uncomment eth-smoke-go-mod-cache
lukaszcl Aug 14, 2024
1ca63e7
rename some steps and jobs
lukaszcl Aug 14, 2024
e071310
Use citool from CTF
lukaszcl Aug 14, 2024
d816390
Fix
lukaszcl Aug 14, 2024
1f68172
Fix
lukaszcl Aug 14, 2024
f9d035c
Add cache for citool
lukaszcl Aug 14, 2024
3810977
Update setup-go GHA
lukaszcl Aug 14, 2024
a6043e8
Cache ctf builds
lukaszcl Aug 14, 2024
6be80fe
Bump
lukaszcl Aug 14, 2024
9e7c12c
Fix
lukaszcl Aug 14, 2024
e4c1b1a
Bump
lukaszcl Aug 14, 2024
717ba23
Remove eth-smoke-go-mod-cache as cache is saved in run-tests
lukaszcl Aug 15, 2024
dfac379
Bump
lukaszcl Aug 15, 2024
2ae927b
Remove duplicated step
lukaszcl Aug 15, 2024
1b534ec
Bump
lukaszcl Aug 15, 2024
5c27ae1
Bump
lukaszcl Aug 15, 2024
58cc680
trigger build
lukaszcl Aug 15, 2024
e6ee43d
Clean up after_tests job
lukaszcl Aug 15, 2024
45d1b0e
Run all PR tests
lukaszcl Aug 16, 2024
a5be274
Fix record test result step
lukaszcl Aug 16, 2024
630577f
Remove duplicated tests from e2e-tests.yml
lukaszcl Aug 16, 2024
6b8744a
Bump GHA
lukaszcl Aug 16, 2024
f6f78ef
Merge branch 'develop' into TT-1473-Migrate-integration-tests.yml-in-…
lukaszcl Aug 16, 2024
316331d
Merge branch 'develop' into TT-1473-Migrate-integration-tests.yml-in-…
lukaszcl Aug 19, 2024
8ba6d86
Run ccip tests in reusable workflow
lukaszcl Aug 19, 2024
9cbcd63
fix go mod
lukaszcl Aug 19, 2024
5fe1f56
Fix
lukaszcl Aug 19, 2024
98521fa
Update test_env names
lukaszcl Aug 19, 2024
fa8180a
Install citool bin intead of checking out ctf repo
lukaszcl Aug 20, 2024
4e3085e
Add more ccip tests
lukaszcl Aug 20, 2024
32ef769
chore: Update Go setup in reusable workflow
lukaszcl Aug 20, 2024
c059f0b
Update test names
lukaszcl Aug 20, 2024
7a236a0
Merge branch 'develop' into TT-1473-Migrate-integration-tests.yml-in-…
lukaszcl Aug 20, 2024
4760779
Use ctf from branch
lukaszcl Aug 20, 2024
c7dc177
Run all PR tests
lukaszcl Aug 20, 2024
2376965
fix plugins test
lukaszcl Aug 20, 2024
029f1b2
Run core and ccip tests based on changes
lukaszcl Aug 20, 2024
c2bfa0b
Merge branch 'develop' into TT-1473-Migrate-integration-tests.yml-in-…
lukaszcl Aug 20, 2024
d5d57f3
Fix
lukaszcl Aug 20, 2024
82d74d4
Bump citool
lukaszcl Aug 20, 2024
c59895c
Bump run-tests
lukaszcl Aug 20, 2024
b554ae3
Fix collect metrics
lukaszcl Aug 20, 2024
f2abd64
Bump ctf
lukaszcl Aug 20, 2024
8f2e20c
Simplify test ids
lukaszcl Aug 20, 2024
21279a8
uncomment tags
lukaszcl Aug 20, 2024
b0b554e
fix
lukaszcl Aug 20, 2024
258d777
Fix TEST_TYPE
lukaszcl Aug 20, 2024
9227f66
Fix test env vars
lukaszcl Aug 20, 2024
d763c03
Merge branch 'develop' into TT-1473-Migrate-integration-tests.yml-in-…
lukaszcl Aug 20, 2024
ef664da
Merge branch 'develop' into TT-1473-Migrate-integration-tests.yml-in-…
lukaszcl Aug 21, 2024
0757641
Update check-e2e-test-results
lukaszcl Aug 21, 2024
04645f2
Merge branch 'TT-1473-Migrate-integration-tests.yml-in-Core-repo-to-u…
lukaszcl Aug 21, 2024
6691e87
Fix check results
lukaszcl Aug 21, 2024
c9b4b68
test
lukaszcl Aug 21, 2024
c8c6aa5
fix
lukaszcl Aug 21, 2024
307969d
test
lukaszcl Aug 21, 2024
3860e8b
fix
lukaszcl Aug 21, 2024
d8193ee
Merge branch 'develop' into TT-1473-Migrate-integration-tests.yml-in-…
lukaszcl Aug 21, 2024
1cb4f08
Do not build integration-tests, run only lint
lukaszcl Aug 21, 2024
e2f2fa3
fix test_result artifact
lukaszcl Aug 21, 2024
5385898
Fix cache
lukaszcl Aug 21, 2024
27a3635
Fix unique workflow id
lukaszcl Aug 21, 2024
6ab22ae
Fix e2e-tests and skip one test
lukaszcl Aug 21, 2024
b743101
test when ccip tests skipped
lukaszcl Aug 21, 2024
1f31a04
Merge branch 'develop' into TT-1473-Migrate-integration-tests.yml-in-…
lukaszcl Aug 21, 2024
f240ee2
fix
lukaszcl Aug 21, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
640 changes: 375 additions & 265 deletions .github/e2e-tests.yml

Large diffs are not rendered by default.

1,218 changes: 128 additions & 1,090 deletions .github/workflows/integration-tests.yml

Large diffs are not rendered by default.

68 changes: 34 additions & 34 deletions .github/workflows/run-automation-ondemand-e2e-tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -91,53 +91,53 @@ jobs:

# Always run upgrade tests
cat > test_list.yaml <<EOF
- id: integration-tests/smoke/automation_upgrade_test.go:^TestAutomationNodeUpgrade/registry_2_0
test_inputs:
chainlink_image: ${{ steps.determine-build.outputs.image }}
chainlink_version: ${{ steps.determine-build.outputs.version }}
chainlink_upgrade_image: ${{ steps.determine-build.outputs.upgrade_image }}
chainlink_upgrade_version: ${{ steps.determine-build.outputs.upgrade_version }}
- id: smoke/automation_upgrade_test.go:^TestAutomationNodeUpgrade/registry_2_0
test_env_vars:
E2E_TEST_CHAINLINK_IMAGE: ${{ steps.determine-build.outputs.image }}
E2E_TEST_CHAINLINK_VERSION: ${{ steps.determine-build.outputs.version }}
E2E_TEST_CHAINLINK_UPGRADE_IMAGE: ${{ steps.determine-build.outputs.upgrade_image }}
E2E_TEST_CHAINLINK_UPGRADE_VERSION: ${{ steps.determine-build.outputs.upgrade_version }}

- id: integration-tests/smoke/automation_upgrade_test.go:^TestAutomationNodeUpgrade/registry_2_1
test_inputs:
chainlink_image: ${{ steps.determine-build.outputs.image }}
chainlink_version: ${{ steps.determine-build.outputs.version }}
chainlink_upgrade_image: ${{ steps.determine-build.outputs.upgrade_image }}
chainlink_upgrade_version: ${{ steps.determine-build.outputs.upgrade_version }}
- id: smoke/automation_upgrade_test.go:^TestAutomationNodeUpgrade/registry_2_1
test_env_vars:
E2E_TEST_CHAINLINK_IMAGE: ${{ steps.determine-build.outputs.image }}
E2E_TEST_CHAINLINK_VERSION: ${{ steps.determine-build.outputs.version }}
E2E_TEST_CHAINLINK_UPGRADE_IMAGE: ${{ steps.determine-build.outputs.upgrade_image }}
E2E_TEST_CHAINLINK_UPGRADE_VERSION: ${{ steps.determine-build.outputs.upgrade_version }}

- id: integration-tests/smoke/automation_upgrade_test.go:^TestAutomationNodeUpgrade/registry_2_2
test_inputs:
chainlink_image: ${{ steps.determine-build.outputs.image }}
chainlink_version: ${{ steps.determine-build.outputs.version }}
chainlink_upgrade_image: ${{ steps.determine-build.outputs.upgrade_image }}
chainlink_upgrade_version: ${{ steps.determine-build.outputs.upgrade_version }}
- id: smoke/automation_upgrade_test.go:^TestAutomationNodeUpgrade/registry_2_2
test_env_vars:
E2E_TEST_CHAINLINK_IMAGE: ${{ steps.determine-build.outputs.image }}
E2E_TEST_CHAINLINK_VERSION: ${{ steps.determine-build.outputs.version }}
E2E_TEST_CHAINLINK_UPGRADE_IMAGE: ${{ steps.determine-build.outputs.upgrade_image }}
E2E_TEST_CHAINLINK_UPGRADE_VERSION: ${{ steps.determine-build.outputs.upgrade_version }}
EOF

# Run reorg tests if enabled
if [[ "${{ github.event.inputs.enableReorg }}" == 'true' ]]; then
cat >> test_list.yaml <<EOF
- id: integration-tests/reorg/automation_reorg_test.go^TestAutomationReorg/registry_2_0
test_inputs:
chainlink_image: ${{ steps.determine-build.outputs.image }}
chainlink_version: ${{ steps.determine-build.outputs.version }}
- id: integration-tests/reorg/automation_reorg_test.go^TestAutomationReorg/registry_2_1
test_inputs:
chainlink_image: ${{ steps.determine-build.outputs.image }}
chainlink_version: ${{ steps.determine-build.outputs.version }}
- id: integration-tests/reorg/automation_reorg_test.go^TestAutomationReorg/registry_2_2
test_inputs:
chainlink_image: ${{ steps.determine-build.outputs.image }}
chainlink_version: ${{ steps.determine-build.outputs.version }}
- id: reorg/automation_reorg_test.go^TestAutomationReorg/registry_2_0
test_env_vars:
E2E_TEST_CHAINLINK_IMAGE: ${{ steps.determine-build.outputs.image }}
E2E_TEST_CHAINLINK_VERSION: ${{ steps.determine-build.outputs.version }}
- id: reorg/automation_reorg_test.go^TestAutomationReorg/registry_2_1
test_env_vars:
E2E_TEST_CHAINLINK_IMAGE: ${{ steps.determine-build.outputs.image }}
E2E_TEST_CHAINLINK_VERSION: ${{ steps.determine-build.outputs.version }}
- id: reorg/automation_reorg_test.go^TestAutomationReorg/registry_2_2
test_env_vars:
E2E_TEST_CHAINLINK_IMAGE: ${{ steps.determine-build.outputs.image }}
E2E_TEST_CHAINLINK_VERSION: ${{ steps.determine-build.outputs.version }}
EOF
fi

# Run chaos tests if enabled
if [[ "${{ github.event.inputs.enableChaos }}" == 'true' ]]; then
cat >> test_list.yaml <<EOF
- id: integration-tests/chaos/automation_chaos_test.go
test_inputs:
chainlink_image: ${{ steps.determine-build.outputs.image }}
chainlink_version: ${{ steps.determine-build.outputs.version }}
- id: chaos/automation_chaos_test.go
test_env_vars:
E2E_TEST_CHAINLINK_IMAGE: ${{ steps.determine-build.outputs.image }}
E2E_TEST_CHAINLINK_VERSION: ${{ steps.determine-build.outputs.version }}
EOF
fi

Expand Down
Loading
Loading