Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LAVA jobs: missing tast tests #2588

Open
JenySadadia opened this issue Jun 25, 2024 · 1 comment
Open

LAVA jobs: missing tast tests #2588

JenySadadia opened this issue Jun 25, 2024 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@JenySadadia
Copy link
Collaborator

I have observed an issue with some LAVA tast jobs where LAVA job state is Completed and tast test suite result is pass. However, there are no tast sub-tests that could run other than setup tests such as os-release and tast-tarball.

For example https://lava.collabora.dev/scheduler/job/14549057

The logs look like below:

+ ./tast_parser.py --results
Unsupported data type                     'list_of_scalar_values', skipping                         Apps.ClamshellLauncher.AnimationSmoothness.Close.average
Unsupported data type                     'list_of_scalar_values', skipping                         Apps.ClamshellLauncher.AnimationSmoothness.OpenAppsPage.average
<LAVA_SIGNAL_TESTSET START ui.DesktopControl>
Received signal: <TESTSET> START ui.DesktopControl
Starting test_set ui.DesktopControl
<LAVA_SIGNAL_TESTSET STOP>
Received signal: <TESTSET> STOP
Closing test_set ui.DesktopControl
Unsupported data type                     'list_of_scalar_values', skipping                         Ash.InteractiveWindowResize.TimeToPresent.average
Unsupported data type                     'list_of_scalar_values', skipping                         Ash.Overview.AnimationSmoothness.Enter.ClamshellMode.average
Unsupported data type                     'list_of_scalar_values', skipping                         Ash.Overview.AnimationSmoothness.Exit.ClamshellMode.average
Unsupported data type                     'list_of_scalar_values', skipping                         Ash.Window.AnimationSmoothness.CrossFade.average
Unsupported data type                     'list_of_scalar_values', skipping                         Ash.Window.AnimationSmoothness.CrossFade.DragMaximize.average
Unsupported data type                     'list_of_scalar_values', skipping                         Ash.Window.AnimationSmoothness.CrossFade.DragUnmaximize.average
Unsupported data type                     'list_of_scalar_values', skipping                         Ash.WindowCycleView.AnimationSmoothness.Show.average
<LAVA_SIGNAL_TESTSET START ui.WindowControl>

If the tests are being skipped, it should be reported with skip status or something else in the callback data but no such information is present.

@JenySadadia JenySadadia added the bug Something isn't working label Jun 25, 2024
@a-wai
Copy link
Contributor

a-wai commented Jul 1, 2024

The tests are actually executed, the bug lies in our results parser which should report something instead of completely ignoring those.

I'll have a look ASAP.

@a-wai a-wai self-assigned this Jul 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants