Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix failing system tests #4026

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

fix failing system tests #4026

wants to merge 3 commits into from

Conversation

wconti27
Copy link
Contributor

@wconti27 wconti27 commented Oct 24, 2024

What does this PR do?

System tests job is currently failing because the runner expects certain AWS env variables to be set. However, the use of ++docker, which runs the runner in a docker container, was not covered by the latest commit adding these system tests., and only the case that the runner is on the local machine was covered. Run the failing scenario using a non-containerized runner until the case is fixed within the system tests repo.

Motivation:

Change log entry

Additional Notes:

How to test the change?

@wconti27 wconti27 requested a review from a team as a code owner October 24, 2024 17:00
Comment on lines 303 to 307
if [ ${{ matrix.scenario }} != "CROSSED_TRACING_LIBRARIES" ]; then
./run.sh ++docker ${{ matrix.scenario }} ${{matrix.scenario == env.FORCE_TESTS_SCENARIO && env.FORCE_TESTS || ''}}
else
./run.sh ${{ matrix.scenario }} ${{matrix.scenario == env.FORCE_TESTS_SCENARIO && env.FORCE_TESTS || ''}}
fi
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just to leave some mark and not forget to remove it, should we puts some echo message about it?

@pr-commenter
Copy link

pr-commenter bot commented Oct 24, 2024

Benchmarks

Benchmark execution time: 2024-10-24 18:02:34

Comparing candidate commit 4840d30 in PR branch conti/fix-system-tests with baseline commit 06e050b in branch master.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 23 metrics, 2 unstable metrics.

scenario:profiler - sample timeline=false

  • 🟩 throughput [+0.615op/s; +0.624op/s] or [+9.993%; +10.146%]

@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 97.86%. Comparing base (06e050b) to head (4840d30).
Report is 3 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #4026      +/-   ##
==========================================
- Coverage   97.86%   97.86%   -0.01%     
==========================================
  Files        1319     1319              
  Lines       79322    79322              
  Branches     3934     3934              
==========================================
- Hits        77628    77627       -1     
- Misses       1694     1695       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Strech
Strech previously approved these changes Oct 24, 2024
@@ -277,7 +277,7 @@ jobs:
uses: actions/checkout@v4
with:
repository: 'DataDog/system-tests'
ref: ${{ env.ST_REF }}
ref: conti/set-aws-env-on-docker-runner
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That would mean that system-tests would not run on the main system-tests branch but on conti/set-aws-env-on-docker-runner branch. If that's intended you can replace ST_REF: main at line 14 but this should not be merged in dd-trace-rb master, as this is only a way to use a system-tests branch (while waiting for it to be merged in main) on your branch/PR and this should always be set to main on dd-trace-rb masterbranch

@Strech Strech dismissed their stale review October 25, 2024 12:47

Code changed into different direction

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants