Shigoto

GenStage based worker queue with multiple backing store adapters

Todos

Worker

• Shigoto.Producer (Sourced from the store adapter)
• Shigoto.Consumer (ConsumerSupervisor that spawns and supervise Processor for each job)
• Shigoto.Processor (Task based)

Adapters

• Erlang's :queue module with wrapper
• Redis
• Google Pub/Sub
• AWS SQS

Configurables

• Queue peeking latency
• Queue popping latency
• Adapter Configs
• Maximum Demand (Affects number of active processors at any single point of time)
• Minumum Demand (Minimum availability before requesting for job)