Skip to content

Use isolated workers for heavy operations (e.g. inference) #11

@zielo-hue

Description

@zielo-hue

The app becomes completely unresponsive when processing requests that involve transformers. Using a queueing system like Celery that offloads such heavy tasks onto separate workers will greatly improve the end-user experience and also make the webapp much more scalable. I recommend using RabbitMQ as the broker and Redis as the backend for Celery, since those seem to be the most widely used.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requesthelp wantedExtra attention is needed

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions