Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Clean up datadog upload workflow #496

Merged
merged 4 commits into from
Jul 20, 2023
Merged

Clean up datadog upload workflow #496

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
014483a
First comment is used as step "name"
oxve Jul 20, 2023
3d07d01
Clean up upload workflow
oxve Jul 20, 2023
2ff51b7
Fix indentation
oxve Jul 20, 2023
8d6ea62
Update error message
oxve Jul 20, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
190 changes: 88 additions & 102 deletions .github/workflows/unit_test_report.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,112 +22,98 @@ on:
- completed

jobs:
# Gets unit test report from artifact storage and uploads them to DataDog.
unit-test-report:
permissions: {}
if: always()
runs-on: ubuntu-latest
name: Upload Unit Test Reports
steps:
- name: Collect Unit Test Reports
id: collect-report
uses: actions/github-script@v6
with:
script: |
console.log('context', context);
console.log('context.payload.workflow_run.pull_requests', context.payload.workflow_run.pull_requests);
console.log('context.payload.workflow_run.head_commit', context.payload.workflow_run.head_commit);
unit-test-report:
permissions: {}
if: always()
runs-on: ubuntu-latest
name: Upload Unit Test Reports
steps:
- name: Download Unit Test Results
id: collect-report
uses: actions/github-script@v6
with:
script: |
// The `download-artifact` action can only access artifacts that
// were uploaded in the same workflow. Since it was not this
// workflow that uploaded the artifacts we must use rest api
// to download them.
// https://docs.github.com/en/actions/using-workflows/events-that-trigger-workflows#using-data-from-the-triggering-workflow

// The `download-artifact` action can only access artifacts that
// were uploaded in the same workflow. Since it was not this
// workflow that uploaded the artifacts we must use rest api
// to download them.
// https://docs.github.com/en/actions/using-workflows/events-that-trigger-workflows#using-data-from-the-triggering-workflow
let allArtifacts = await github.rest.actions.listWorkflowRunArtifacts({
owner: context.repo.owner,
repo: context.repo.repo,
run_id: context.payload.workflow_run.id,
});

let allArtifacts = await github.rest.actions.listWorkflowRunArtifacts({
owner: context.repo.owner,
repo: context.repo.repo,
run_id: context.payload.workflow_run.id,
});
console.log(allArtifacts);
let matchArtifacts = allArtifacts.data.artifacts.filter((artifact) => {
return artifact.name == "unit-test-results"
});
console.log(matchArtifacts)
if (matchArtifacts.length == 0) {
// No reports were uploaded.
console.log('No unit test reports were uploaded');
return false;
}
let matchArtifacts = allArtifacts.data.artifacts.filter((artifact) => {
return artifact.name == "unit-test-results"
});

if (matchArtifacts.length == 1) {
let download = await github.rest.actions.downloadArtifact({
owner: context.repo.owner,
repo: context.repo.repo,
artifact_id: matchArtifacts[0].id,
archive_format: 'zip',
});
let fs = require('fs');
fs.writeFileSync(`${process.env.GITHUB_WORKSPACE}/unit-test-results.zip`, Buffer.from(download.data));
return true;
- run: unzip unit-test-results.zip -d unit-test-results
if: ${{ steps.collect-report.outputs.result == 'true' }}
- name: Install node
if: steps.collect-report.outputs.result
uses: actions/setup-node@v3
with:
node-version: 16
- name: Get Datadog CLI
if: ${{ steps.collect-report.outputs.result == 'true' }}
shell: bash
# TODO: pin version (with checksum?)
run: npm install -g @datadog/datadog-ci
- name: Upload the JUnit files
if: ${{ steps.collect-report.outputs.result == 'true' }}
shell: bash
env:
DATADOG_API_KEY: ${{ secrets.DD_API_KEY }}
DATADOG_SITE: us5.datadoghq.com
DD_ENV: ci
DD_SERVICE: ${{ github.event.repository.name }}
# TODO
# DD_METRICS:
owner: context.repo.owner,
repo: context.repo.repo,
artifact_id: matchArtifacts[0].id,
archive_format: 'zip',
});
let fs = require('fs');
fs.writeFileSync(`${process.env.GITHUB_WORKSPACE}/unit-test-results.zip`, Buffer.from(download.data));
} else {
// TODO: Comment on PR?
core.setFailed(`Expected one artifact with name 'unit-test-results'. Found ${matchArtifacts.length}.`);
}
- name: Extract Archived Unit Test Results
run: unzip unit-test-results.zip -d unit-test-results
- name: Install node
uses: actions/setup-node@v3
with:
node-version: 16
- name: Get Datadog CLI
shell: bash
# TODO: pin version (with checksum?)
run: npm install -g @datadog/datadog-ci
- name: Upload To Datadog
shell: bash
env:
DATADOG_API_KEY: ${{ secrets.DD_API_KEY }}
DATADOG_SITE: us5.datadoghq.com
DD_ENV: ci
DD_SERVICE: ${{ github.event.repository.name }}
# Need to populate git info via env vars as we don't have the repo to look at.
DD_GIT_REPOSITORY_URL: ${{ github.event.repository.git_url }}
DD_GIT_COMMIT_SHA: ${{ github.event.workflow_run.head_sha }}
DD_GIT_BRANCH: ${{ github.event.workflow_run.head_branch }}
DD_GIT_COMMIT_MESSAGE: ${{ github.event.workflow_run.head_commit.message }}
DD_GIT_COMMIT_AUTHOR_NAME: ${{ github.event.workflow_run.head_commit.author.name }}
DD_GIT_COMMIT_AUTHOR_EMAIL: ${{ github.event.workflow_run.head_commit.author.email }}
DD_GIT_COMMIT_AUTHOR_DATE: ${{ github.event.workflow_run.head_commit.timestamp }}
DD_GIT_COMMIT_COMMITTER_NAME: ${{ github.event.workflow_run.head_commit.committer.name }}
DD_GIT_COMMIT_COMMITTER_EMAIL: ${{ github.event.workflow_run.head_commit.committer.email }}
DD_GIT_COMMIT_COMMITTER_DATE: ${{ github.event.workflow_run.head_commit.timestamp }}
run: |
# Loop over each platform, extract the tags and upload xml results.

# Git info
DD_GIT_REPOSITORY_URL: ${{ github.event.repository.git_url }}
DD_GIT_COMMIT_SHA: ${{ github.event.workflow_run.head_sha }}
DD_GIT_BRANCH: ${{ github.event.workflow_run.head_branch }}
DD_GIT_COMMIT_MESSAGE: ${{ github.event.workflow_run.head_commit.message }}
DD_GIT_COMMIT_AUTHOR_NAME: ${{ github.event.workflow_run.head_commit.author.name }}
DD_GIT_COMMIT_AUTHOR_EMAIL: ${{ github.event.workflow_run.head_commit.author.email }}
DD_GIT_COMMIT_AUTHOR_DATE: ${{ github.event.workflow_run.head_commit.timestamp }}
DD_GIT_COMMIT_COMMITTER_NAME: ${{ github.event.workflow_run.head_commit.committer.name }}
DD_GIT_COMMIT_COMMITTER_EMAIL: ${{ github.event.workflow_run.head_commit.committer.email }}
# TODO: Not available?
DD_GIT_COMMIT_COMMITTER_DATE: ${{ github.event.workflow_run.head_commit.timestamp }}
run: |
# Unit test results are archived on the following format:
#
# unit-test-results/
# ├── android-arm
# │ ├── <shards>
# │ │ └── <test result xmls>
# │ └── TAGS
# ├── linux-x64x11
# │ ├── <shards>
# │ │ └── <test result xmls>
# │ └── TAGS
# ├── raspi-2
# │ ├── <shards>
# │ │ └── <test result xmls>
# │ └── TAGS
# etc.
# Unit test results are archived on the following format:
# ├── android-arm
# │ ├── <shards>
# │ │ └── <test result xmls>
# │ └── TAGS
# ├── linux-x64x11
# │ ├── <shards>
# │ │ └── <test result xmls>
# │ └── TAGS
# ├── raspi-2
# │ ├── <shards>
# │ │ └── <test result xmls>
# │ └── TAGS
# etc.

# Loop over each platform, extract the tags and upload xml results.
for dir in unit-test-results/*/; do
echo "Uploading $dir test report"
for dir in unit-test-results/*/; do
echo "Uploading $dir test report"

tags=`cat ${dir}TAGS`
tags=`cat ${dir}TAGS`

datadog-ci junit upload \
--tags $tags \
$dir/**/*.xml
done
datadog-ci junit upload \
--tags $tags \
$dir/**/*.xml
done