Overview
jobq is a standalone, production-inspired distributed job queue server written in Go. It provides durable job ingestion, worker leases, retries, and failure recovery backed by PostgreSQL.
Architecture & Design
- Decoupled System: Queue server acts as standalone infrastructure (like RabbitMQ or SQS) over HTTP; workers run as independent binaries executing business logic.
- Durable Persistence: PostgreSQL-backed job storage with atomic leases,
SKIP LOCKEDworker claims, and exponential backoff retries. - Fault Recovery: Automatic lease reaper for expired or abandoned worker leases, heartbeat keep-alives, and Dead Letter Queue (DLQ).
- Go SDK Client: Clean client interface for job submission, lease renewal, acknowledgements (
ack), and failures (nack).
Progress & Roadmap
- Phase 1: Job model, REST API ingestion, SDK client
- Phase 2: Worker claim protocol, leases & reaper
- Phase 3: Acknowledgement, retries & dead letter queue
- Phase 4: Heartbeats & lease renewal