Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incorrect Test Execution Time and Cost Calculation #2562

Open
tijanastikic opened this issue Jan 24, 2025 · 0 comments
Open

Incorrect Test Execution Time and Cost Calculation #2562

tijanastikic opened this issue Jan 24, 2025 · 0 comments
Labels

Comments

@tijanastikic
Copy link

Describe the bug
Total test execution time and corresponding costs calculated incorrectly when running tests in parallel on Firebase Test Lab.

To Reproduce

Steps to reproduce the behavior:

  1. With the setup explained bellow in "Details" section, run gradle command: ./gradlew runFlank
  2. Check logs and search for "CostReport" section

Expected behavior

Time displayed in the cost report (therefore the cost should be smaller) should be the same time as needed for test execution

Details:

  • Fladle version: "0.17.5"
  • Devices config: 4 devices total: '[{"model": "x1q", "version": "29"}, {"model": "a52sxq", "version": "34"}, {"model": "dm3q", "version": "33"}, {"model": "cactus", "version": "27"}]'
  • Fladle setup:
Image

Actual behavior

Actual execution time took 4m 20s
Calculated time in cost report 28m

Image Image
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant