Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Release 2023.10 - RC1 #287

Closed
32 of 86 tasks
MrKevinWeiss opened this issue Oct 16, 2023 · 11 comments
Closed
32 of 86 tasks

Release 2023.10 - RC1 #287

MrKevinWeiss opened this issue Oct 16, 2023 · 11 comments
Labels
help wanted

Comments

@MrKevinWeiss
Copy link
Contributor

MrKevinWeiss commented Oct 16, 2023 •
edited by riot-ci
Loading

This issue lists the status of all tests for the Release Candidate 1 of the 2023.10 release.

Specs tested:
@riot-ci
Copy link

riot-ci commented Oct 16, 2023 •
edited
Loading

Test Report

Task Outcome
✔ 01. Task 02 - Unittests on native PASSED
✔ 01. Task 03 - Unittests on native separated [tests-analog_util] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-base64] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bcd] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bhp_event] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bhp_msg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bitfield] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bloom] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bluetil] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-checksum] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-chunked_ringbuffer] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-clif] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-coding] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-color] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-core] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-credman] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-div] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-dns_cache] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ecc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fib] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fib_sr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fmt] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-frac] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gcoap] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_hdr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_nib] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_mac_internal] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_netif_pktq] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_udp] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-hashes] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ieee802154] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-inet_csum] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv4_addr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv6_addr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv6_hdr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-kernel_defines] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-libc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-luid] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-matstat] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-mtd] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-nanocoap] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-nanocoap_cache] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-netopt] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-netreg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-phydat] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pkt] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pktbuf] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pktqueue] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-printf_float] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-priority_pktqueue] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-rtc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-rtt_rtc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-saul_reg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-scanf_float] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-seq] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sht1x] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan_ctx] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan_sfr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sock_util] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-timex] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-tsrb] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-turo] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-uri_parser] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ut_process] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-uuid] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-vfs] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-zptr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ztimer64] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ztimer] PASSED
✔ 03. Task 01 - ICMPv6 multicast echo on native PASSED
✔ 03. Task 02 - ICMPv6 link-local echo on native PASSED
✔ 03. Task 03 - ICMPv6 link-local echo on native (1 hour) PASSED
✔ 03. Task 04 - ICMPv6 stress test on native (1 hour) PASSED
✔ 03. Task 05 - ICMPv6 stress test on native (neighbor cache stress) PASSED
✔ 03. Task 06 - ICMPv6 link-local echo on native (IPv6 fragmentation) PASSED
✔ 04. Task 01 - ICMPv6 link-local echo with iotlab-m3 PASSED
✖ 04. Task 02 - ICMPv6 multicast echo with iotlab-m3/samr21-xpro FAILED
✔ 04. Task 03 - ICMPv6 echo with large payload PASSED
🔁 04. Task 04 - ICMPv6 echo with iotlab-m3/samr21-xpro 15 minutes RERUN
🟡 04. Task 07 (Experimental) - ICMPv6 multicast echo with samr21-xpro/zero + xbee SKIPPED
🟡 04. Task 08 (Experimental) - ICMPv6 echo with samr21-xpro/zero + xbee SKIPPED
✔ 05. Task 01 - ICMPv6 echo unicast addresess on native (default route) PASSED
✔ 05. Task 03 - ICMPv6 echo unicast addresess on native (specific route) PASSED
✔ 05. Task 04 - ICMPv6 echo unicast addresess on iotlab-m3 (static route) PASSED
✔ 06. Task 03 - UDP on native (non-existent neighbor) PASSED
✔ 06. Task 05 - Empty UDP on native PASSED
✔ 08. Task 01 - ICMPv6 echo between native and Linux PASSED
✔ 09. Task 01 - CORD Endpoint PASSED
✔ 09. Task 02 - Confirmable retries [False-0] PASSED
✔ 09. Task 02 - Confirmable retries [True-1] PASSED
✔ 09. Task 03 - Block1 PASSED
✔ 09. Task 04 - Block2 PASSED
✔ 09. Task 05 - Observe registration and notification PASSED
✔ 10. Task 01 - Destination unreachable - no route to destination PASSED
✔ 10. Task 02 - Destination unreachable - Beyond scope of source address PASSED
✔ 10. Task 03 - Destination unreachable - address unreachable (target node address) PASSED
✔ 10. Task 04 - Destination unreachable - address unreachable (neighbor cache miss) PASSED
✔ 10. Task 05 - Destination unreachable - port unreachable PASSED
✔ 10. Task 06 - Destination unreachable - port unreachable (large payload) PASSED
✔ 10. Task 07 - Packet too big PASSED
✔ 10. Task 08 - Time exceeded - hop limit exceeded in transit PASSED
✔ 10. Task 09 - Parameter problem - erroneous header field encountered PASSED
✔ 10. Task 10 - IPv6-in-IPv6 encapsulation PASSED

@MrKevinWeiss
Copy link
Contributor Author

So after some investigation I found the the iotlab based tests with the firefly are having issues (all seem to be in an ERROR state) as well as no samr21-xpro available in lillie. I am trying to switch to strasbourg but it doesn't acutally book the experiment and I think that I have some parameters wrong.

I tried with both this:

@pytest.mark.parametrize(
    'nodes, iotlab_site',
    [pytest.param(['iotlab-m3', 'openmoteb'], "strasbourg")],
    indirect=['nodes', 'iotlab_site'],
)

and

@pytest.mark.parametrize(
    'nodes, iotlab_site',
    [pytest.param(['iotlab-m3', 'openmote-b'], "strasbourg")],
    indirect=['nodes', 'iotlab_site'],
)

Maybe it is something to do with the openmote-b naming?
It would be nice to somehow enable the log level of the iotlabs-cli so I can see what the issue is but I haven't dug deep enough into the documentation I guess...

@MrKevinWeiss
Copy link
Contributor Author

ping @miri64 or @aabadie maybe?

@MrKevinWeiss
Copy link
Contributor Author

oops I actually get some output:

$ tox -e test -- -k "spec04 and (task05 or task06)" --capture=tee-sys |& tee /tmp/log2.txt
test: commands[0]> pytest -k 'spec04 and (task05 or task06)' --capture=tee-sys
============================= test session starts ==============================
platform linux -- Python 3.10.12, pytest-7.3.2, pluggy-1.3.0 -- /home/weiss/repos/Release-Specs/.tox/test/bin/python
cachedir: .tox/test/.pytest_cache
rootdir: /home/weiss/repos/Release-Specs
configfile: setup.cfg
plugins: rerunfailures-12.0, cov-4.1.0
collecting ... collected 135 items / 133 deselected / 2 selected

04-single-hop-6lowpan-icmp/test_spec04.py::test_task05[nodes0-strasbourg] RERUN [ 50%]
04-single-hop-6lowpan-icmp/test_spec04.py::test_task05[nodes0-strasbourg] RERUN [ 50%]
04-single-hop-6lowpan-icmp/test_spec04.py::test_task05[nodes0-strasbourg] RERUN [ 50%]
04-single-hop-6lowpan-icmp/test_spec04.py::test_task05[nodes0-strasbourg] ERROR [ 50%]
04-single-hop-6lowpan-icmp/test_spec04.py::test_task06[nodes0-strasbourg] RERUN [100%]
04-single-hop-6lowpan-icmp/test_spec04.py::test_task06[nodes0-strasbourg] RERUN [100%]
04-single-hop-6lowpan-icmp/test_spec04.py::test_task06[nodes0-strasbourg] RERUN [100%]
04-single-hop-6lowpan-icmp/test_spec04.py::test_task06[nodes0-strasbourg] ERROR [100%]

==================================== ERRORS ====================================
_______________ ERROR at setup of test_task05[nodes0-strasbourg] _______________

local = False
request = <SubRequest 'nodes' for <Function test_task05[nodes0-strasbourg]>>
boards = ['iotlab-m3', 'openmoteb'], iotlab_site = 'strasbourg'

    @pytest.fixture
    def nodes(local, request, boards, iotlab_site):
        """
        Provides the nodes for a test as a list of RIOTCtrl objects
        """
        ctrls = []
        if boards is None:
            boards = request.param
        only_native = all(b.startswith("native") for b in boards)
        for board in boards:
            if local or only_native or IoTLABExperiment.valid_board(board):
                env = {'BOARD': f'{board}'}
            else:
                env = {
>                   'BOARD': IoTLABExperiment.board_from_iotlab_node(board),
                    'IOTLAB_NODE': f'{board}',
                }

conftest.py:284: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

iotlab_node = 'openmoteb'

    @staticmethod
    def board_from_iotlab_node(iotlab_node):
        """Return BOARD matching iotlab_node"""
        reg = r'([0-9a-zA-Z\-]+)-\d+\.[a-z]+\.iot-lab\.info'
        match = re.search(reg, iotlab_node)
        if match is None:
>           raise ValueError(
                "Unable to parse {iotlab_node} as IoT-LAB node "
                "name of format "
                "<node-name>.<site-name>.iot-lab.info"
            )
E           ValueError: Unable to parse {iotlab_node} as IoT-LAB node name of format <node-name>.<site-name>.iot-lab.info

testutils/iotlab.py:59: ValueError
_______________ ERROR at setup of test_task06[nodes0-strasbourg] _______________

local = False
request = <SubRequest 'nodes' for <Function test_task06[nodes0-strasbourg]>>
boards = ['iotlab-m3', 'openmote-b'], iotlab_site = 'strasbourg'

    @pytest.fixture
    def nodes(local, request, boards, iotlab_site):
        """
        Provides the nodes for a test as a list of RIOTCtrl objects
        """
        ctrls = []
        if boards is None:
            boards = request.param
        only_native = all(b.startswith("native") for b in boards)
        for board in boards:
            if local or only_native or IoTLABExperiment.valid_board(board):
                env = {'BOARD': f'{board}'}
            else:
                env = {
>                   'BOARD': IoTLABExperiment.board_from_iotlab_node(board),
                    'IOTLAB_NODE': f'{board}',
                }

conftest.py:284: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

iotlab_node = 'openmote-b'

    @staticmethod
    def board_from_iotlab_node(iotlab_node):
        """Return BOARD matching iotlab_node"""
        reg = r'([0-9a-zA-Z\-]+)-\d+\.[a-z]+\.iot-lab\.info'
        match = re.search(reg, iotlab_node)
        if match is None:
>           raise ValueError(
                "Unable to parse {iotlab_node} as IoT-LAB node "
                "name of format "
                "<node-name>.<site-name>.iot-lab.info"
            )
E           ValueError: Unable to parse {iotlab_node} as IoT-LAB node name of format <node-name>.<site-name>.iot-lab.info

testutils/iotlab.py:59: ValueError
----- generated xml file: /home/weiss/repos/Release-Specs/test-report.xml ------
============ 133 deselected, 2 errors, 6 rerun in 182.36s (0:03:02) ============
test: exit 1 (183.20 seconds) /home/weiss/repos/Release-Specs> pytest -k 'spec04 and (task05 or task06)' --capture=tee-sys pid=93946
  test: FAIL code 1 (183.24=setup[0.05]+cmd[183.20] seconds)

@MrKevinWeiss
Copy link
Contributor Author

I think I got it. Just need to add openmote to the board map :)

@MrKevinWeiss
Copy link
Contributor Author

Both #289 and RIOT-OS/RIOT#19979 will need to get in before starting RC2 as they fix some of the failing tests...

@MrKevinWeiss
Copy link
Contributor Author

doh, wasn't on the PR...

@MrKevinWeiss
Copy link
Contributor Author

MrKevinWeiss commented Oct 18, 2023 •
edited
Loading

Test Report

Task Outcome
✔ 01. Task 02 - Unittests on native PASSED
✔ 01. Task 03 - Unittests on native separated [tests-analog_util] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-base64] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bcd] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bhp_event] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bhp_msg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bitfield] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bloom] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bluetil] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-checksum] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-chunked_ringbuffer] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-clif] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-coding] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-color] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-core] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-credman] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-div] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-dns_cache] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ecc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fib] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fib_sr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fmt] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-frac] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gcoap] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_hdr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_nib] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_mac_internal] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_netif_pktq] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_sixlowpan_frag_vrb] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_udp] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-hashes] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ieee802154] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-inet_csum] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv4_addr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv6_addr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv6_hdr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-kernel_defines] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-libc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-luid] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-matstat] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-mtd] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-nanocoap] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-nanocoap_cache] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-netopt] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-netreg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-phydat] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pkt] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pktbuf] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pktqueue] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-printf_float] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-priority_pktqueue] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-rtc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-rtt_rtc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-saul_reg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-scanf_float] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-seq] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sht1x] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan_ctx] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan_sfr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sock_util] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-timex] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-tsrb] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-turo] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-uri_parser] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ut_process] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-uuid] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-vfs] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-zptr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ztimer64] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ztimer] PASSED
✖ 01. Task 04 - Unittests on iotlab-m3 FAILED
✔ 03. Task 01 - ICMPv6 multicast echo on native PASSED
✔ 03. Task 02 - ICMPv6 link-local echo on native PASSED
✖ 03. Task 03 - ICMPv6 link-local echo on native (1 hour) FAILED
🟡 03. Task 04 - ICMPv6 stress test on native (1 hour) SKIPPED
✔ 03. Task 05 - ICMPv6 stress test on native (neighbor cache stress) PASSED
✔ 03. Task 06 - ICMPv6 link-local echo on native (IPv6 fragmentation) PASSED
✖ 04. Task 01 - ICMPv6 link-local echo with iotlab-m3 FAILED
✖ 04. Task 02 - ICMPv6 multicast echo with iotlab-m3/samr21-xpro FAILED
✖ 04. Task 03 - ICMPv6 echo with large payload FAILED
✖ 04. Task 04 - ICMPv6 echo with iotlab-m3/samr21-xpro 15 minutes FAILED
🟡 04. Task 05 (Experimental) - ICMPv6 multicast echo with samr21-xpro/cc2538 [strasbourg] SKIPPED
🟡 04. Task 06 (Experimental)- ICMPv6 link-local echo with samr21-xpro/cc2538 [strasbourg] SKIPPED
🟡 04. Task 07 (Experimental) - ICMPv6 multicast echo with samr21-xpro/zero + xbee SKIPPED
🟡 04. Task 08 (Experimental) - ICMPv6 echo with samr21-xpro/zero + xbee SKIPPED
✖ 04. Task 09 - ICMPv6 stress test on iotlab-m3 FAILED
✖ 04. Task 10 (Experimental) - ICMPv6 echo with large payload (IPv6 fragmentation) FAILED
🟡 04. Task 11 (Experimental) - ICMPv6 stress test on nrf802154 SKIPPED
🟡 04. Task 12 (Experimental) - ICMPv6 multicast echo with iotlab-m3/nrf802154 SKIPPED
🟡 04. Task 13 (Experimental) - ICMPv6 link-local echo with iotlab-m3/nrf802154 SKIPPED
✔ 05. Task 01 - ICMPv6 echo unicast addresess on native (default route) PASSED
✖ 05. Task 02 - ICMPv6 echo unicast addresess on iotlab-m3 (default route) FAILED
✔ 05. Task 03 - ICMPv6 echo unicast addresess on native (specific route) PASSED
✔ 05. Task 04 - ICMPv6 echo unicast addresess on iotlab-m3 (static route) PASSED
✖ 06. Task 01 - UDP on iotlab-m3 FAILED
✖ 06. Task 02 - UDP on iotlab-m3 (UDP port compression) FAILED
✔ 06. Task 03 - UDP on native (non-existent neighbor) PASSED
✖ 06. Task 04 - UDP on iotlab-m3 (non-existent neighbor) FAILED
✔ 06. Task 05 - Empty UDP on native PASSED
✖ 06. Task 06 - Empty UDP on iotlab-m3 FAILED
✔ 08. Task 01 - ICMPv6 echo between native and Linux PASSED
✖ 08. Task 08 - UDP between GNRC and lwIP on iotlab-m3 FAILED
🟡 09. Task 01 - CORD Endpoint SKIPPED
🟡 09. Task 02 - Confirmable retries [False-0] SKIPPED
🟡 09. Task 02 - Confirmable retries [True-1] SKIPPED
✔ 09. Task 03 - Block1 PASSED
✔ 09. Task 04 - Block2 PASSED
🟡 09. Task 05 - Observe registration and notification SKIPPED
🟡 10. Task 01 - Destination unreachable - no route to destination SKIPPED
🟡 10. Task 02 - Destination unreachable - Beyond scope of source address SKIPPED
🟡 10. Task 03 - Destination unreachable - address unreachable (target node address) SKIPPED
🟡 10. Task 04 - Destination unreachable - address unreachable (neighbor cache miss) SKIPPED
🟡 10. Task 05 - Destination unreachable - port unreachable SKIPPED
🟡 10. Task 06 - Destination unreachable - port unreachable (large payload) SKIPPED
🟡 10. Task 07 - Packet too big SKIPPED
🟡 10. Task 08 - Time exceeded - hop limit exceeded in transit SKIPPED
🟡 10. Task 09 - Parameter problem - erroneous header field encountered SKIPPED
🟡 10. Task 10 - IPv6-in-IPv6 encapsulation SKIPPED
🟡 11. Task 06 - GNRC LoRaWAN (ABP) [abp] SKIPPED

@MrKevinWeiss
Copy link
Contributor Author

So we will still need to wait for some sock, coap, psa, and release test fixes before RC2...

@MrKevinWeiss
Copy link
Contributor Author

There are still some backports required but maybe it would be good to start a RC2 after RIOT-OS/RIOT#20008 is merged just to see the current state.

@MrKevinWeiss
Copy link
Contributor Author

Closing in favor of #291

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
help wanted
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@riot-ci @MrKevinWeiss