Extend the wwan connection tests to support multiple cycle connection tests (new)

[stanley31huang]

Description

Extend the wwan connection tests to support multiple cycle connection tests, we found an issue that the LTE connection could not be established at second round.

As discussed internally with the QA team, we have all agreed that the default number of test runs for WWAN connections tests is 2.

Resolved issues

Here is the support ticket: 00379830.

Our SWE has identified this issue is related to the modem firmware and modem-manager snap, and they are trying to add a patch to modem-manager snap as a workaround.

Documentation

N/A

Tests

list bootstrapped results:

ubuntu@ubuntu:/var/tmp/checkbox-providers$ sudo checkbox-ce-oem.checkbox-cli list-bootstrapped com.canonical.certification::wwan-automated
$PROVIDERPATH is defined, so following provider sources are ignored ['/snap/checkbox-ce-oem/844/providers/checkbox-provider-ce-oem', '/root/.local/share/plainbox-providers-1', '/var/tmp/checkbox-providers-develop'] 
Using sideloaded provider: checkbox-provider-base, version 4.3.0.dev71 from /var/tmp/checkbox-providers/base
com.canonical.certification::snap
com.canonical.certification::package
com.canonical.plainbox::manifest
com.canonical.certification::wwan/detect
com.canonical.certification::wwan/check-sim-present-Quectel-RM520N-GL-868371053819781-auto
com.canonical.certification::wwan/3gpp-scan-Quectel-RM520N-GL-868371053819781-auto
com.canonical.certification::rtc
com.canonical.certification::sleep
com.canonical.certification::wwan/gsm-connection-Quectel-RM520N-GL-868371053819781-auto
com.canonical.certification::wwan/gsm-reconnection-Quectel-RM520N-GL-868371053819781-auto
com.canonical.certification::suspend/suspend_advanced_auto
com.canonical.certification::after-suspend-wwan/3gpp-scan-Quectel-RM520N-GL-868371053819781-auto

test submission: https://certification.canonical.com/hardware/202502-36310/submission/413123/

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 49.34%. Comparing base (10e8b35) to head (67da594).

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1534      +/-   ##
==========================================
+ Coverage   49.30%   49.34%   +0.04%     
==========================================
  Files         373      373              
  Lines       40454    40453       -1     
  Branches     6834     6835       +1     
==========================================
+ Hits        19946    19963      +17     
+ Misses      19783    19765      -18     
  Partials      725      725              

Flag	Coverage Δ
provider-base	25.28% <100.00%> (+0.10%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[stanley31huang]

The PR is ready, but I did not test it on real machine.