forked from kernelci/kcidb
-
Notifications
You must be signed in to change notification settings - Fork 0
/
tests.yaml
325 lines (325 loc) · 14.6 KB
/
tests.yaml
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
#
# Catalog of canonical test identifiers to be used when submitting test
# results to kcidb.
#
# Find the test you are running in the catalog, and use its key as the "path"
# property when submitting the test result to kcidb.
#
# Each "test" here can be a test program or a collection thereof, but not one
# of the tests executed by such a program. You are encouraged to report the
# latter to kcidb, but they're not recorded or regulated by this catalog.
#
# When adding the test corresponding to a program, use the program's
# widely-known name, e.g. the same one you would call it at a conference. If
# the program is only known inside your company, prepend its name with the
# company name.
#
# The "title" property should describe the test briefly, and must be
# single-line. The optional "description" property could go into greater
# detail and be multi-line.
#
# The "home" property should point to the canonical, upstream location, and is
# intended for identification and as a reference to more information on the
# test, rather than a pointer to exact code being executed. The latter should
# be described within test objects submitted to kcidb instead.
#
# E.g. the Linux Test Project test suite *should* be here under the
# widely-known name "ltp". However, while its own tests, such as "chdir01" or
# "clone03" are welcome to be reported to kcidb as "ltp.chdir01" or
# "ltp.clone03", only the "ltp" test should be in this catalog. The LTP
# project's home page or its main upstream repository should be referred to in
# the "home" property, and not e.g. the specific code being executed, because
# code versions will differ between test result origins and even executions.
#
# Please keep the tests sorted alphabetically by keys.
#
# You can use the "kcidb-tests-validate" tool to check if this file is valid.
# Like this:
#
# kcidb-tests-validate < tests.yaml
#
# If you add the -u/--urls option, it will also check if all URLs are
# reachable:
#
# kcidb-tests-validate --urls < tests.yaml
#
audit:
title: Basic Audit Regression Test Suite for the Linux Kernel
home: https://github.com/linux-audit/audit-testsuite
blktests:
title: Test framework for the Linux kernel block layer and storage stack
home: https://github.com/osandov/blktests
boot:
title: Machine booted with the tested kernel
home: https://www.kernel.org/
bootrr:
title: Bootrr test suite
home: https://github.com/andersson/bootrr
bpf:
title: In-tree BPF test suite module
home: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/lib/test_bpf.c
dacapobench:
title: DaCapo Java benchmarking suite
home: http://dacapobench.sourceforge.net/
dtbs_check:
title: Validate Device Tree files
home: https://docs.kernel.org/devicetree/bindings/writing-schema.html#running-checks
fio:
title: Flexible I/O tester
home: https://github.com/axboe/fio
fluster:
title: Fluster test
home: https://github.com/fluendo/fluster
description: |
Fluster is a testing framework for decoder conformance.
fwts:
title: Firmware Test Suite
home: https://wiki.ubuntu.com/FirmwareTestSuite/
jcstress:
title: The Java Concurrency Stress tests
home: https://github.com/openjdk/jcstress
kernelci_kver:
title: Kernel Version test
home: https://github.com/kernelci/kernelci-pipeline/blob/main/config/runtime/kver.jinja2
description: |
Checks kernel version using "git describe" and verify it with kernel
Makefile version.
kernelci_sleep:
title: KernelCI sleep test
home: https://github.com/kernelci/kernelci-core/blob/main/config/runtime/tests/sleep.jinja2
description: |
Runs sleep and wake-up checks for RTC enabled devices.
kernelci_watchdog_reset:
title: KernelCI watchdog reset test
home: https://github.com/kernelci/kernelci-core/blob/main/config/runtime/tests/watchdog-reset.jinja2
description: |
Verifies the watchdog reset functionality. It opens the watchdog device
and waits for the timeout to expire, triggering a device reset.
kernelci_wifi_basic:
title: KernelCI wifi basic test
home: https://github.com/kernelci/kernelci-core/blob/main/config/runtime/tests/wifi-basic.jinja2
description: |
Test to verify basic WiFi functionality on Chromebooks.
kselftest:
title: Kernel self-tests
home: https://kselftest.wiki.kernel.org/
kunit:
title: Kernel unit tests
home: https://kunit.dev/
kvm-unit-tests:
title: KVM unit tests
home: https://www.linux-kvm.org/page/KVM-unit-tests
libevdev:
title: Libevdev unit tests
home: https://gitlab.freedesktop.org/libevdev/libevdev/
libhugetlbfs:
title: Libhugetlbfs test suite
home: https://github.com/libhugetlbfs/libhugetlbfs
ltp:
title: Linux Test Project test suite
home: https://linux-test-project.github.io
nfs_connectathon:
title: NFS Connectathon test suite
home: http://wiki.linux-nfs.org/wiki/index.php/Connectathon_test_suite
perftool:
title: Perf tool test suite
home: https://github.com/rfmvh/perftool-testsuite.git
pjdfstest:
title: A test suite for exercising filesystem-oriented POSIX system calls
home: https://github.com/pjd/pjdfstest
podman:
title: Podman test suite
home: https://github.com/containers/libpod/tree/master/test
redhat_acpi_table:
title: Red Hat's test for retrieving ACPI tables
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/acpi/acpitable
redhat_amtu:
title: Red Hat's Abstract Machine Test Utility
description: |
Abstract Machine Test Utility (AMTU) is an administrative utility
that checks whether the underlying protection mechanisms of the
hardware are being enforced. These checks are a requirement of the
Controlled Access Protection Profile (CAPP) FPT_AMT.1.
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/misc/amtu
redhat_apache_mod_ssl:
title: Red Hat's Apache mod_ssl smoke tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/packages/httpd/mod_ssl-smoke
redhat_autofs_connectathon:
title: Red Hat's version of AutoFS connectathon test suite
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/autofs/connectathon
redhat_block_fs_fio:
title: Red Hat's Storage block filesystem fio tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/storage/block/fs_fio
redhat_block_mq_sche:
title: Red Hat's Storage block queue scheduler tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/storage/block/mq_sche
redhat_bridge:
title: Red Hat's Ethernet bridge tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/bridge/sanity_check
redhat_cifs_connectathon:
title: Red Hat version of LTP's NFS Connectathon modified to test CIFS
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/filesystems/cifs/connectathon
redhat_cpu_die_layout:
title: Red Hat's test for correct information on CPU die layout
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/cpu/die
redhat_cpu_idle_power:
title: Red Hat's CPU idle power usage tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/cpu/idle
redhat_cpufreq_driver:
title: Red Hat's test for correct cpufreq scaling driver
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/cpu/driver
redhat_cpufreq_governor:
title: Red Hat's cpufreq governor tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/power-management/cpufreq/cpufreq_governor
redhat_cpufreq_misc:
title: Red Hat's miscellaneous cpufreq tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/power-management/cpufreq/sys_cpufreq
redhat_cpupower:
title: Red Hat's tests for cpupower tool
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/power-management/cpupower/sanity
redhat_dm:
title: Red Hat's Device Mapper (DM) tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/storage/dm/common
redhat_ethernet:
title: Red Hat's Ethernet driver sanity tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/driver/sanity
redhat_ftrace:
title: Red Hat's function tracer tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/trace/ftrace/tracer
redhat_geneve:
title: Red Hat's GENEVE sanity tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/tunnel/geneve/basic
redhat_gre:
title: Red Hat's GRE sanity tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/tunnel/gre/basic
redhat_i2cdetect:
title: Red Hat's i2cdetect tool sanity tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/packages/i2c-tools/sanity/i2cdetect-smoke
redhat_igmp:
title: Red Hat's IGMP sanity tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/igmp/conformance
redhat_iommu_boot:
title: Red Hat's test for booting with various iommu options
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/iommu/boot
redhat_iotop:
title: Red Hat's iotop tool sanity tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/packages/iotop/sanity
redhat_ipmi_driver_stress:
title: Red Hat's IPMI driver loading/unloading stress test
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/ipmi/stress/driver
redhat_ipmitool_stress:
title: Red Hat's IPMI tool stress tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/ipmi/stress/ipmitool-loop
redhat_ipsec:
title: Red Hat's IPSec tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/ipsec/ipsec_basic/ipsec_basic_netns
redhat_ipvlan:
title: Red Hat's IPVLAN sanity tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/vnic/ipvlan/basic
redhat_iscsi_params:
title: Red Hat's iSCSI parameter fuzzing test
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/storage/iscsi/params
redhat_kaslr:
title: Red Hat's sanity test for Kernel Address Space Layout Randomization (KASLR)
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/memory/function/kaslr
redhat_kdump:
title: Red Hat's kdump tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/kdump
redhat_l2tp:
title: Red Hat's basic L2TP tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/tunnel/l2tp/basic
redhat_loopdev:
title: Red Hat's loop device sanity tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/filesystems/loopdev/sanity
redhat_lvm_thinp:
title: Red Hat's LVM thin provisioning sanity tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/storage/lvm/thinp/sanity
redhat_macsec:
title: Red Hat's sanity test for MACsec support
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/macsec/sanity_check
redhat_memfd_create:
title: Red Hat's test for memfd_create syscall
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/memory/function/memfd_create
redhat_module_load_unload:
title: Red Hat's test for module loading and unloading
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/misc/module-load
redhat_netfilter:
title: Red Hat's netfilter tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/firewall/netfilter/target
redhat_pciutils:
title: Red Hat's pciutils sanity tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/pciutils/sanity-smoke
redhat_perftool:
title: Red Hat's perf tool test suite
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/packages/perf/internal-testsuite
redhat_pmtu:
title: Red Hat's tests for Path MTU discovery
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/route/pmtu
redhat_rapl:
title: Red Hat's tests for Intel's RAPL (Running Average Power Limit) technology
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/power-management/rapl/powercap
redhat_route:
title: Red Hat's IP routing tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/route/route_func
redhat_scsi_vpd:
title: Red Hat's SCSI Vital Product Data (VPD) retrieval tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/storage/scsi/vpd
redhat_sctp_auth_sockopts:
title: Red Hat's SCTP authentication socket options tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/sctp/auth/sockopts
redhat_socket_fuzz:
title: Red Hat's socket function fuzzing tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/socket/fuzz
redhat_sound_aloop:
title: Red Hat's ALSA PCM loopback tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/sound/aloop
redhat_sound_user-ctl-elem:
title: Red Hat's ALSA User Control Element (mixer) tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/sound/user-ctl-elem
redhat_suspend_resume:
title: Red Hat's Suspend/Resume tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/power-management/suspend-resume
redhat_swraid_trim:
title: Red Hat's test for software RAID TRIM support
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/storage/swraid/trim
redhat_systemtap_tracepoints:
title: Red Hat's test for operation of SystemTap tracepoints
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/tracepoints/operational
redhat_tcp_keepalive:
title: Red Hat's tests for TCP Keep-Alive support
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/tcp/tcp_keepalive
redhat_tuned:
title: Red Hat's tuned daemon tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/packages/tuned/tune-processes-through-perf
redhat_udp_socket:
title: Red Hat's tests for UDP socket support
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/udp/udp_socket
redhat_vxlan:
title: Red Hat's VXLAN sanity tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/networking/tunnel/vxlan/basic
redhat_watchdog_test:
title: Red Hat's Watchdog Timer tests
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/watchdog/hw-generic
rt-tests:
title: RT-linux test suite
home: https://git.kernel.org/pub/scm/utils/rt-tests/rt-tests.git
selinux:
title: SELinux Regression Test Suite for the Linux Kernel
home: https://github.com/SELinuxProject/selinux-testsuite
stress-ng:
title: Stress-ng test suite
home: https://wiki.ubuntu.com/Kernel/Reference/stress-ng
syzkaller:
title: syzkaller fuzzer
home: https://github.com/google/syzkaller
tast:
title: Tast test
home: https://chromium.googlesource.com/chromiumos/platform/tast/+/HEAD/README.md
description: |
Tast is ChromeOS-specific test suite that runs on Chromebooks.
usex:
title: UNIX System Exerciser (USEX)
home: https://gitlab.com/cki-project/kernel-tests/-/tree/main/standards/usex
xfstests:
title: Xfstests filesystem testing suite
home: https://github.com/kdave/xfstests