MEP 1 - Dramatiq over Celery

• Author: Rodda John
• Status: Adopted
• Adopted: 2023-10-15

Overview

We chose to use Dramatiq instead of Celery.

On Celery

Celery is terrible:

• Documentation is imprecise, incomplete, and contradictory at times.
• Relatively unmaintained (to the community's consternation)
• Celery is overly confusing and has insane default behavior

That said, Celery is quite popular. And a decision to not use it was thus not taken lightly.

On Dramatiq

Dramatiq is significantly newer and less popular.

Dramatiq is simpler, significantly better documented, and more sensible.

We feel comfortable implementing Dramatiq ourselves if needed as a fallback.

Ideally Dramatiq had a persistend DB backed queuing infrastructure, though Redis is good enough.