PgQue: Zero-Bloat Postgres Queue System Using Pure SQL and pg_cron
By
gmcabrita
Hand-rolled, kettle-boiled, baked to perfection. Worth every minute at the bakery.
Summary
PgQue is a zero-bloat Postgres queue system that revives the PgQ architecture originally designed at Skype for handling messaging for hundreds of millions of users. The key innovation is that PgQue runs entirely within Postgres using pure SQL, requiring only one SQL file for installation and pg_cron for scheduling, making it compatible with managed Postgres providers where the original PgQ's C extension and external daemon cannot run. The article presents PgQue as a universal edition that brings proven queue architecture to modern Postgres deployments.
Key quotes
· 4 pulledPgQue brings back PgQ — one of the longest-running Postgres queue architectures in production — in a form that runs on any Postgres platform, managed providers included.
PgQ was designed at Skype to run messaging for hundreds of millions of users, and it ran on large self-managed Postgres deployments for over a decade.
Standard PgQ depends on a C extension (pgq) and an external daemon (pgqd), neither of which run on most managed Postgres providers.
PgQue rebuilds that architecture using pure SQL, requiring only one SQL file to install and pg_cron to tick.
You might also wanna read
Lux: A Multi-threaded Redis-Compatible Key-Value Store with Vector Search and 10x Performance Gains
Lux is a Redis-compatible key-value store written in Rust that offers up to 10x faster performance than Redis. It addresses Redis's single-t
github.com·2mo ago
SNKV: A Lightweight, Crash-Safe Embedded Key-Value Store Built on SQLite's Storage Engine
SNKV is a lightweight, crash-safe embedded key-value store built directly on SQLite's storage engine without the SQL layer. It provides a cl
github.com·3mo ago
HelixDB: Open-Source OLTP Graph-Vector Database Built in Rust Now Generally Available
HelixDB, an open-source OLTP graph-vector database built in Rust, has been released after more than a year of development. The database is d
Product Hunt·3mo ago
Alibaba's AliSQL: Enterprise MySQL Branch with DuckDB OLAP and Vector Search
AliSQL is Alibaba's enterprise-grade MySQL branch that combines traditional InnoDB OLTP reliability with DuckDB's columnar OLAP engine and n
github.com·3mo ago
Stoolap: A Modern Embedded SQL Database Built in Rust with Advanced Features
Stoolap is a modern embedded SQL database written in Rust that targets low-latency transactional workloads and real-time analytical queries.
github.com·5mo ago
Arc Core: High-Performance Time-Series Data Warehouse Built on DuckDB and Parquet
Arc Core is a high-performance time-series data warehouse built on DuckDB, Parquet, and MinIO, currently in alpha release as a technical pre
github.com·7mo ago