-
Notifications
You must be signed in to change notification settings - Fork 375
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix failing system tests #4026
base: master
Are you sure you want to change the base?
fix failing system tests #4026
Conversation
.github/workflows/system-tests.yml
Outdated
if [ ${{ matrix.scenario }} != "CROSSED_TRACING_LIBRARIES" ]; then | ||
./run.sh ++docker ${{ matrix.scenario }} ${{matrix.scenario == env.FORCE_TESTS_SCENARIO && env.FORCE_TESTS || ''}} | ||
else | ||
./run.sh ${{ matrix.scenario }} ${{matrix.scenario == env.FORCE_TESTS_SCENARIO && env.FORCE_TESTS || ''}} | ||
fi |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just to leave some mark and not forget to remove it, should we puts some echo
message about it?
BenchmarksBenchmark execution time: 2024-10-24 18:02:34 Comparing candidate commit 4840d30 in PR branch Found 1 performance improvements and 0 performance regressions! Performance is the same for 23 metrics, 2 unstable metrics. scenario:profiler - sample timeline=false
|
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #4026 +/- ##
==========================================
- Coverage 97.86% 97.86% -0.01%
==========================================
Files 1319 1319
Lines 79322 79322
Branches 3934 3934
==========================================
- Hits 77628 77627 -1
- Misses 1694 1695 +1 ☔ View full report in Codecov by Sentry. |
@@ -277,7 +277,7 @@ jobs: | |||
uses: actions/checkout@v4 | |||
with: | |||
repository: 'DataDog/system-tests' | |||
ref: ${{ env.ST_REF }} | |||
ref: conti/set-aws-env-on-docker-runner |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That would mean that system-tests would not run on the main
system-tests branch but on conti/set-aws-env-on-docker-runner
branch. If that's intended you can replace ST_REF: main
at line 14 but this should not be merged in dd-trace-rb master
, as this is only a way to use a system-tests branch (while waiting for it to be merged in main) on your branch/PR and this should always be set to main
on dd-trace-rb master
branch
What does this PR do?
System tests job is currently failing because the runner expects certain AWS env variables to be set. However, the use of
++docker
, which runs the runner in a docker container, was not covered by the latest commit adding these system tests., and only the case that the runner is on the local machine was covered. Run the failing scenario using a non-containerized runner until the case is fixed within the system tests repo.Motivation:
Change log entry
Additional Notes:
How to test the change?