RX: Embedded Data Store for JSON with In-Place Querying and Automatic Deduplication
By
creationix
Pulled from the oven just right. Trustworthy, fact-dense, deeply satisfying.
Summary
RX is an embedded data store for JSON-shaped data that enables querying encoded documents in place without parsing. It functions as a 'no-SQL SQLite' with automatic pointer deduplication and direct buffer reads. The article presents benchmark results showing significant improvements: a 92 MB JSON file reduces to 5.1 MB in RX format, with route lookups dropping from 69 ms (full JSON parse) to near-instant access.
Key quotes
· 5 pulledRX is an embedded data store for JSON-shaped data. Encode once, then query the encoded document in place — no parsing, no object graph, no GC pressure.
Think of it as no-SQL SQLite: unstructured data with database-style random access.
When encoding as RX, pointers deduplicate automatically: ^z reuses 'apple', ^h reuses the shared key layout.
The encoded form is queryable as-is — no parsing step, just direct reads from the buffer.
Benchmarked on a real 92 MB deployment manifest with 35,000 route keys: JSON (92 MB, 69 ms lookup) vs RX (5.1 MB, 0.00 ms lookup).
You might also wanna read
SICK: Deduplicated Binary Storage Format for JSON with Efficient Binary Aggregate (EBA)
SICK (Streams of Independent Constant Keys) is a representation of JSON-like structures, and this repository provides EBA (Efficient Binary
github.com·7mo agoKefir C compiler development moves to private mode indefinitely
The developer of the Kefir C compiler announces the cessation of public development, transitioning the project to private mode indefinitely.
Why Average LLM Use Is Likely Destroying Value in Software Development
The author argues that, contrary to prevailing hype, the average use of Large Language Models (LLMs) is likely destroying value rather than
unessays.substack.com·19h ago
How AI Accelerated Prototyping: From Idea to Tangible in Record Time
The author reflects on how AI has transformed their prototyping workflow. Previously, the biggest bottleneck was the time needed to scaffold
darylcecile.net·19h ago
GitLab 19.0 launches with Secrets Manager, agentic workflows, and self-hosted AI models
GitLab 19.0 has been released, positioning itself as an intelligent orchestration platform for DevSecOps. The release includes expanded secr
bit.ly·1d ago
Centralizing Error Handling in Rust with Custom AppError Enums
This article discusses the importance of centralizing error handling in Rust applications using a custom AppError enum combined with map_err