Timeout when adding data in the Fed-BioMed gui

[tomdoel]

Tagging a large dataset in the Fed-BioMed gui can take a long time (>10mins). This can lead to a timeout because the return from the POST call is blocked until the operation completes. There is also a large RAM usage. As a workaround we have increased the timeout in the load balancer and in gunicorn, but there is a maximum limit for the load balancer timeout.

Questions

• Do we expect the tagging to take this long?
• If it should be significantly quicker, then:
  • Could slow tagging be due to a problem in the data structure?
  • Does it take longer on AWS comapred to a local Fed-BioMed install?

Remedies:

• If the slow tagging is related to data structure or aws install, identify and remedy issue
• Fix the Fed-BioMed gui to perform the tagginng asynchronously, so it does not cause a timeout

[tomdoel]

Hi @brangl I'm assigning you this at the moment as you're looking at whether this might be an issue with the data structure.