Tool Open source
effect-mq is an Effect-native background-job library maintained by Warp. It provides schema-first job definitions, a storage-agnostic queue core, a worker runtime, and stores for PostgreSQL, Redis, and memory. Jobs can define typed payloads and results, idempotency keys, metadata, retry attempts, and backoff policies.
The runtime uses at-least-once processing with token-guarded locks, heartbeat renewal, stalled-job recovery, durable retries, and a persisted attempt ledger. It also supports repeatable cron or interval schedules, batch enqueueing, deduplication modes, queue pause and resume, handler timeouts, cross-process cancellation, metrics, and dashboard-oriented listing and retry data. PostgreSQL support integrates with Drizzle schema factories and uses row locking and LISTEN/NOTIFY, while the Redis store performs operations through atomic Lua scripts.
1 use taken from transcripts — each links to the moment in the video.
Adds background jobs to Effect applications with typed schemas, retries, idempotency, metadata, selectable PostgreSQL, Redis, or memory backends, and persistent worker recovery and scheduling.
1 in the library.