Skip to content

Ask: Add persistent queue for deferred requests #8

@gptankit

Description

@gptankit

The current deferred queue implementation uses Go buffered channels which are inherently in-memory structures. As such, they lose all buffered requests in case of service/node restarts and are also limited by system's memory. Few users have requested to add a persistent queue as well. Although there are low chances of queue filling up unless there is a problem elsewhere in the cluster, but I do see certain benefits of building a persistent deferred queue as an alternative -

  • Not limited by memory
  • Preserve requests across restarts
  • Ordering of requests across serviceq nodes

Metadata

Metadata

Assignees

Labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions