Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add test that fails a lot #510

Closed
wants to merge 55 commits into from
Closed

Add test that fails a lot #510

wants to merge 55 commits into from

Conversation

oxve
Copy link
Collaborator

@oxve oxve commented Aug 1, 2023

b/290997541

oxve and others added 30 commits July 17, 2023 11:53
@oxve
Upload unit test reports to datadog action (#480)
6fa729b 
Adds an action that runs after the linux pipeline and looks for archived
unit test reports.

The reports are organized based on platform and shard: android-arm
├── 1
...
└── 4
linux-x64-x11
├── 1
...
└── 4
etc.

b/290997541
@oxve
Update script action version and code (#482)
6d01dc8 
Some api changes and better variable naming.

b/290997541
@oxve
Add workflow to trigger uploader faster (#483)
6cc3a0d
@oxve
Check out source code before trying to archive files (#484)
e179bac 
b/290997541
@oxve
Fix array indexing, more logging (#486)
9e87aaa 
b/290997541
@oxve
Use correct syntax (#487)
a0c04b7 
b/290997541
@oxve
Move env, more logging (#488)
b1dffbe 
b/290997541
@oxve
Fix glob (#489)
9af3ea6 
b/290997541
@oxve
Add a bunch of TODOs
900d25e 
b/290997541
@oxve
Explain folder structure in comment
6693f64 
b/290997541
@oxve
Add clarifying comments
758f46c 
b/290997541
@oxve
Populate git metadata
dfdf1bf 
b/290997541
@andrewsavage1
Test PR labeling (internal) (#466)
928f952
@andrewsavage1
Check PR for bug number (#492)
9d55589 
b/283308580
@andrewsavage1
Test single commit for bug id check (#493)
393121e 
b/283308580
@andrewsavage1
Multi series PR test for bug id check (#494)
9eb36c7 
b/283308580
@andrewsavage1
Test subtree merge commit (#495)
6fac605 
Squashed 'third_party/glm_test/' content from commit 3d00cdeb8d3

git-subtree-dir: third_party/glm_test
git-subtree-split: 3d00cdeb8d380cc5a2d1da95d5d9bdbc6e3c197b

b/283308580
@oxve
Clean up datadog upload workflow (#496)
bcf7bc4 
b/290997541
@oxve
Add comment on PR step (#497)
1a12acd 
b/290997541
@oxve
Fix syntax error (#498)
6223b9a 
b/290997541
@oxve
Fix syntax error again
ffa9929 
b/290997541
@oxve
Allow workflow to create comments
56631d4 
b/290997541
@oxve
Use pull-request permission
3f119eb 
b/290997541
@oxve
Clean up comments and add evergreen
a06537e 
b/290997541
@oxve
Only try to comment on failure
c68554a 
b/290997541
@oxve
Multiple tags must be passed via env var
d6b0760 
b/290997541
@oxve
Add debug logging
a9b7e59 
b/290997541
@oxve
Final clean up (#502)
673c27c 
b/290997541
@andrewsavage1
Add title to cherry picked PRs (#503)
c5db57d 
b/283308580
@andrewsavage1
Use body in CP PR message (#505)
1ae9229 
b/283308580
oxve added 8 commits July 28, 2023 13:03
@oxve
Merge remote-tracking branch 'upstream/main' into main_sandbox
d067150
@oxve
Fix sha256 sum for datadog-ci
d80eeab 
b/290997541
@oxve
Fix name of shasum env var
c4d4463 
b/290997541
@oxve
Run local executable instead of one on PATH
9433837 
b/290997541
@oxve
Don't try to upload if tests were cancelled
b74bd66 
b/290997541
@oxve
Increase traceability in unit test upload
89a861d 
b/290997541
@oxve
Only download github artifacts for on-host workflows
a314c98 
b/290997541
@oxve
Move coverage to its own workflow (#1063) (#509)
dabc79c 
* Move coverage to its own workflow (#1063)

The coverage job does not support sharding and takes ~1h to run. That's
~40 minutes longer than all other linux test runs. By breaking out
coverage from the linux workflow we can get unit test results from
datadog in less than half the time.

b/290997541

* Upload unit test reports to DataDog (#1059)

Unit tests produce test results in JUnit xml format. These files can be
ingested by DataDog to fuel their CI analysis, unlocking flaky test
detection, regressions, platform analysis, and more!

The upload must happen in a separately triggered workflow to have access
to upload the reports. In a forked PR workflow this access is
restricted.

Initially reports from unit tests run on-host from linux, evergreen, and
win32 will be uploaded.

b/290997541
@datadog-cobalt-youtube
Copy link

datadog-cobalt-youtube bot commented Aug 1, 2023 •
edited
Loading

Datadog Report

Branch report: test-failure
Commit report: c68dae8

✅ cobalt_sandbox: 0 Failed, 0 New Flaky, 33886 Passed, 0 Skipped, 12m 42.98s Wall Time

@oxve oxve force-pushed the main branch 2 times, most recently from 4fca35b to 2e8c30c Compare November 16, 2023 23:41
@oxve oxve closed this Jun 25, 2024
@kaidokert kaidokert deleted the test-failure branch September 20, 2024 22:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@oxve @andrewsavage1