Weather report no longer reports flakes

[jelly]

Our weather report is awfully quiet while we do developers complaining about flakes :-)

So something is wrong, but I can't tell what. Our Grafana also does not show slowest tests anymore and only data for ostree and cockpit?

To replicate the weather report view in a bots checkout:

1. curl https://ci-weather-cockpit.apps.ocp.cloud.ci.centos.org/test-results.db
2. firefox tests.html (chrome seems to have issues loading the db from file:////

P.S. I looked at the code in tests.html and this is some oldschool JavaScript and generally not great. The sqlite wasm npm implementation is not maintained anymore and it isn't the greatest to debug / work on. Should we start investigating something new, simpler? Or combining it with our Grafana?

[jelly]

So two easy queries are:

select * from TestRuns where id in (SELECT run from Tests where failed = 1) order by time;

So that gives us the failed tests, the last one is:

84267|cockpit-project/cockpit-machines|4ac22a5e08ae70807490438b393076b56a05d764|debian-trixie|https://logs-cockpit.apps.ocp.cloud.ci.centos.org/pull-2324-4ac22a5e-20250922-143952-debian-trixie/log.html|1758551992|0|1|1208|success|
84272|cockpit-project/cockpit-machines|4ac22a5e08ae70807490438b393076b56a05d764|fedora-43|https://logs-cockpit.apps.ocp.cloud.ci.centos.org/pull-2324-4ac22a5e-20250922-143955-fedora-43/log.html|1758551995|0|2|1308|success|

All test runs:

select * from TestRuns  order by time asc;

91919|rhinstaller/anaconda-webui|12692a639e95096f6722d8651b6dafd8e4b41e6e|fedora-rawhide-boot/expensive|https://logs-cockpit.apps.ocp.cloud.ci.centos.org/pull-1054-12692a63-20251203-071842-fedora-rawhide-boot-expensive/log.html|1764746321|0|3|1852|success|
91920|rhinstaller/anaconda-webui|12692a639e95096f6722d8651b6dafd8e4b41e6e|fedora-rawhide-boot/other|https://logs-cockpit.apps.ocp.cloud.ci.centos.org/pull-1054-12692a63-20251203-071842-fedora-rawhide-boot-other/log.html|1764746322|0|2|1342|failure|
91921|rhinstaller/anaconda-webui|12692a639e95096f6722d8651b6dafd8e4b41e6e|fedora-rawhide-boot/other|queued-12692a639e95096f6722d8651b6dafd8e4b41e6e-fedora-rawhide-boot/other-1|1764748009|1|0|0|pending|
91922|rhinstaller/anaconda-webui|12692a639e95096f6722d8651b6dafd8e4b41e6e|fedora-rawhide-boot/other|https://logs-cockpit.apps.ocp.cloud.ci.centos.org/pull-1054-12692a63-20251203-075813-fedora-rawhide-boot-other/log.html|1764748691|2|110|816|success|

[jelly]

This seems to be correct, we no longer have failed tests since November:

sqlite> select count(*) from TestRuns where id in (SELECT run from Tests where failed = 1) and url like '%202510%';
465
sqlite> select count(*) from TestRuns where id in (SELECT run from Tests where failed = 1) and url like '%202511%';
0
sqlite> select count(*) from TestRuns where id in (SELECT run from Tests where failed = 1) and url like '%202512%';
0

[jelly]

curl -O "https://logs-cockpit.apps.ocp.cloud.ci.centos.org/pull-22611-966030b0-20251203-144008-rhel-8-10-ws-container-expensive/log"
./store-tests --test-parser log foo | grep FAIL

Gives me:

FAIL test/verify/check-packagekit TestUpdates.testInfoTruncation  time 27s
FAIL test/verify/check-packagekit TestUpdates.testKpatch  time 58s

So we do detect failures