Reading a single json+ file getting the error KeyError('rw')

[Anganthier]

Hi,

I created a complex job to file to run through the night. After trying to plot some test-graph with fio-plot I am getting the error:
Error: KeyError('rw')

I did check the json file with jq - everything seems to be fine. Also the key 'rw' does exist.

The Client-Systems are two kubernetes clusters running a workload on 4 nodes each. Fio is running in a client server mode. This run emphasized iodepth as the variable and different bs settings. The number of parallel jobs are constant.

The output of this nightly run.
run-01.json

The job file on which the data was generated on:
job.txt

Fio version used is 3.39. I installed Fio-Plot 1.1.15 into a penv with python 3.12.

Thanks,
David

[Anganthier]

OK,

checking the rw key myself. It seems the the "job options" object, which should contain the "rw" key does not exist in almost all client_stats. The information seems to be missing completely and could only be inferred from the actual job ini file.

[Anganthier]

That said shouldn't fio-plot the assume the default settings from the global options? Still wrong that the job options are missing but nothing fio-plot can do there, but the key error shouldn't happen.

[Anganthier]

That wasn't it. Repaired the json file by adding all missing "job options". Same error. I am not uploading the repaired file for now, not sure if I have introduced anything else.

[louwrentius]

I was able to create a fix that would generate this image:

I truncated the hostnames manually in the json just to make this look ok.

It's in a separate branch as I've not checked if this code introduces new bugs.
https://github.com/louwrentius/fio-plot/tree/issue155

You have to install fio-plot from this branch.