Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TDS performance Tests #26

Open
wants to merge 28 commits into
base: main
Choose a base branch
from
Open

TDS performance Tests #26

wants to merge 28 commits into from

Conversation

loremattei
Copy link
Contributor

Task/Issue URL: https://app.asana.com/0/1204165176092271/1209510127996478
Tech Design URL:
CC:

Description:
This PR iterates on the original TDS performance test by adding:

  • Comparison between the TDS to test and a reference TDS. Test fails if performance is worse by more than 5%.
  • Multiple runs and custom averaging to stabilise behaviour on CI.
  • Ability to read parameters from env so that it can be triggered by GH workflows more easily.

The test retains it's original default behaviour when run from XCode.

Steps to test this PR:

  1. Verify example runs: this one successful against current next. This one failing against the known to be problematic Admiral TDS.

  2. Run on XCode and confirm default behaviour still works.

OS Testing:

  • iOS 14

  • iOS 15

  • macOS 10.15

  • macOS 11

  • macOS 12


Internal references:

Software Engineering Expectations
Technical Design Template

@loremattei loremattei removed the request for review from THISISDINOSAUR March 7, 2025 10:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants