Skip to content

Implement persistent job queue and scheduling service #78

@ecton

Description

@ecton

We need a job service that allows:

  • Independent job queues that can receive jobs.
    • Each queue should have configuration on job handling:
      • Time to allow before allowing another worker to take the job
      • Number of timeouts before considering the job a failure
      • How many completed jobs to retain
  • APIs for:
    • enqueuing a job
    • await an executing job's result
    • dequeue a job
    • posting a job's result
    • query queue statuses
    • scheduling a job as a one-time or recurring job (cron)
  • A mechanism to allow executable jobs to be registered from:
    • Backend
    • Collection
    • Schema
  • Job queues should stop handing out jobs when the server is being shut down, and should block shutdown until jobs have finished.
  • Closing and reopening a database should continue executing any pending jobs.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

Status

Todo

Relationships

None yet

Development

No branches or pull requests

Issue actions