No Exceedance Data

[Metroidinator]

Hello,
After running ezfio.py there was no exceedance data to look at or graph. Other data and values are present. No obvious errors or warnings in stdout.
ezfio_exceedance_exceedance30.csv was generated without any data in it. After browsing through the code, it seems some *.exc.read/write.csv files should have been created but are not present.

# cat ezfio_exceedance_exceedance30.csv
Drive,/dev/nvme0n1
Model,WUS4BA1A1DSP3X1
Serial,A06893D5
AvailCapacity,14306,GiB
TestedCapacity,14306,GiB
CPU,Intel Xeon Gold 6154 CPU @ 3.00GHz
Cores,72
Frequency,3000
OS,Linux fstlnsr650-8.fst.local 4.18.0-193.19.1.el8_2.x86_64 #1 SMP Mon Sep 14 14:37:00 UTC 2020 x86_64 x86_64
FIOVersion,fio-3.7
QD1 Read Exceedance,,QD1 Write Exceedance,,,QD4 Read Exceedance,,QD4 Write Exceedance,,,QD16 Read Exceedance,,QD16 Write Exceedance,,,QD32 Read Exceedance,,QD32 Write Exceedance,,,
rdusec,rdpct,wrusec,wrpct,,rdusec,rdpct,wrusec,wrpct,,rdusec,rdpct,wrusec,wrpct,,rdusec,rdpct,wrusec,wrpct,,
,,,,,,,,,,,,,,,,,,,,

Command line:
./ezfio.py -d /dev/nvme0n1 --yes

Environment:

• CentOS Linux release 8.2.2004 (Core)
• Linux fstlnsr650-8.fst.local 4.18.0-193.19.1.el8_2.x86_64 #1 SMP Mon Sep 14 14:37:00 UTC 2020 x86_64 x86_64
• Python 3.6.8
• fio-3.7
• ezfio commit 79909e6

Please let me know if I can provide more information.
Best Regards,
Calvin

[earlephilhower]

If you can zip up the whole test directory that would help, assuming no proprietary info is in it (i.e you're not testing a prototype or something). The details dir has the raw CSV outputs used to generate the exceedance data, so it'd be necessary to see those to verify FIO actually wrote the needed data (FIO output format and options often change).

[Metroidinator]

Attached is the output directory.
details_15360GB_72cores_3000MHz_nvme0n1_fstlnsr650-8.fst.local_2021-03-09_14-03-52.zip

[Metroidinator]

I've isolated the issue to this if block:

ezfio/ezfio.py

Lines 627 to 630 in 79909e6

	if ('N' in j['jobs'][0][rdwr]['clat_ns']) and (j['jobs'][0][rdwr]['clat_ns']['N'] > 0):
	bins = j['jobs'][0][rdwr]['clat_ns']['bins']
	else:
	bins = {}

Bypassing this conditional allows the *.exc.read/write.csv files to be generated (with data!).
I don't know if ['clat_ns']['N'] still exists. I could not find it in the latest FIO documentation or through any of my debugging.