Turbolite: Experimental SQLite VFS for Direct S3 Querying with Sub-250ms Cold Latency

Summary

Turbolite is an experimental SQLite VFS (Virtual File System) written in Rust that enables direct querying of SQLite databases stored in S3 object storage with sub-250ms cold latency for point lookups and JOIN operations. The system leverages the decreasing latency gap between local storage and cloud object storage, taking advantage of fast S3 services like S3 Express One Zone. Turbolite also provides page-level compression using zstd and AES-256 encryption for data at rest, which can be used independently of the S3 functionality. The project is experimental and carries risks including potential data corruption.