Overview

jobq is a standalone, production-inspired distributed job queue server written in Go. It provides durable job ingestion, worker leases, retries, and failure recovery backed by PostgreSQL.

Architecture & Design

  • Decoupled System: Queue server acts as standalone infrastructure (like RabbitMQ or SQS) over HTTP; workers run as independent binaries executing business logic.
  • Durable Persistence: PostgreSQL-backed job storage with atomic leases, SKIP LOCKED worker claims, and exponential backoff retries.
  • Fault Recovery: Automatic lease reaper for expired or abandoned worker leases, heartbeat keep-alives, and Dead Letter Queue (DLQ).
  • Go SDK Client: Clean client interface for job submission, lease renewal, acknowledgements (ack), and failures (nack).

Progress & Roadmap

  • Phase 1: Job model, REST API ingestion, SDK client
  • Phase 2: Worker claim protocol, leases & reaper
  • Phase 3: Acknowledgement, retries & dead letter queue
  • Phase 4: Heartbeats & lease renewal