articles/2025/django-task-queues/

[giscus[bot]]

articles/2025/django-task-queues/

I use django-apscheduler to run a queue of scheduled tasks. Now I also need the ability to run one-off tasks and that turned out to not be so simple.

https://www.loopwerk.io/articles/2025/django-task-queues/

[Twixes]

Honestly Celery is great, and it mostly runs itself! Not a lot of fiddling in a Redis-based setup – for tasks like queuing emails I can definitely recommend.

[barraponto]

Systemd has its own cron-like unit, they're called systemd timers. You can both write rules to run on exact times or to run with fixed intervals (meaning you run your next email batch 5 min after the previous batch finished).

[kevinrenskers]

Oh that's pretty interesting, I didn't know about this. Looks like this can run multiple times a minute as well, nice.

[barraponto]

And since you're writing systemd units anyway, it looks like a win.

[sashasimkin]

Celery is battle proven and covers pretty much all use-cases.
Also, I'd not send email as a scheduled task, but rather push email sending task to queue and let worker execute them ASAP. With scheduling, you might end up in overload situation that is hard to scale.

Also, there's https://python-rq.org/ which is a more light-weight alternative to Celery.