Remove new/assignment-approve statuses from the list of ACTIVE status #11246
Description
Impact of the new feature
ReqMgr2/WMStats and other services consuming this data
Is your feature request related to a problem? Please describe.
We have been discussing on how to alleviate the load on WMStats - and anything/anyone consuming ACTIVE data - and one of the ideas is to reduce the number of workflows that are constantly monitored by WMStats (and cached by DataCache WMStatsServer application).
That could be done by removing new and assignment-approved from the list of ACTIVE status defined here:
https://github.com/dmwm/WMCore/blob/master/src/python/WMCore/ReqMgr/DataStructs/RequestStatus.py#L71
however, this will impact the data that is served by wmstatsserver app and the content provided, e.g. the protectedlfns and globallocks, used in the microservices for some dangerous and sensitive actions.
Describe the solution you'd like
Before we can shorten this list of ACTIVE status, we need to:
- investigate what the impact is on the system
- investigate if it could cause problems for those consuming the list of protected LFNs (output)
- investigate if it could cause problems for those consuming the global locks (input + output)
if no negative side effects are expected, we should then stop monitoring workflows in status new or assignment-approvement in WMStats. This will also affect those querying ReqMgr2 with this query string status=ACTIVE.
Describe alternatives you've considered
At the current load (30k requests), the system is still behaving properly, but we could see a degradation at 40k or so. So we need to find ways to reduce the footprint on WMStats.