Global Caches not caching a significant proportion of data published by GTS-to-WIS2 gateways

[6a6d74]

In December @golfvert (Remy) and I noticed that the Global Caches did not seem to be caching much of the data published by GTS-to-WIS2 Gateways. See the image below showing:

1. number of messages published by "origin" (one of the GTS-to-WIS2 gateways)
2. number of messages "missed" by the UK-USA Global Cache (i.e., those messages that have not been published by the GC after 10-minutes and are considered to be not cached).

One issue from DWD's gateway was that the download links in the WNMs weren't resolving, giving the following error:

4XX Not found or no permission

Kai fixed this problem.

Now that WIS2 is operational, we need to determine if this behaviour is still persisting.

(BTW - ignore the Gateway flatlining 3/4 of the way through - that was an offline period)

[golfvert]

I have updated the dashboards for the Sensor Global Cache.
It is accessible at https://grafanab.teganet.eu/dashboards/f/fc0c0ea6-3c87-4e2f-9a0e-27139dc85507/sensor-global-cache
User is wis2pilot.

Drop me an email for the password.
We still have a significant number of messages sent by the gateways not cached. See :

[6a6d74]

Talking with @golfvert offline, I can confirm that the data excludes recommended data that the Global Caches ignore.

Note that core data with notification messages that state properties.cache=false (i.e., instructing the GC not to cache the data object) should still result in the GC publishing a new notification message - albeit with a URL pointing back to the original source.

[kaiwirt]

Is this still an issue? I remember, that we made fixes to DWDs GC.

[golfvert]

No. I can still some "Missed" from all GC. But, nothing that significant.

[kaiwirt]

In that case i suggest to close this issue