keybench: A Scriptable Performance Benchmarking Tool for Sorted Key-Value Stores
By
alexpadula
Summary
keybench is a scriptable, extensible performance benchmarking tool designed for sorted key-value stores. Users write workloads in Lua, and keybench drives those workloads across one or more storage engines, timing every operation and reporting throughput (workload units per second and operations per second) along with latency distributions. The same Lua script runs unchanged across different engines, enabling fair comparisons that measure engine performance rather than test harness differences.
Source
Hacker Newskeybench: A Scriptable Performance Benchmarking Tool for Sorted Key-Value Storesgithub.comKey quotes
· 3 pulledYou write the workload in Lua. keybench drives it across one or more storage engines, times every operation, and reports throughput and latency.
The same script runs unchanged against every engine, so a comparison measures the engines and not the harness.
keybench reports two rates and a latency distribution.
You might also wanna read
ParseBench — Document Parsing Benchmark for AI Agents
parsebench.ai·10d ago
Keys and Caches: Open-Source Tool for Simplified AI Model Performance Analysis
Keys and Caches is an open-source developer tool that simplifies AI model performance analysis by providing unified GPU insights directly co
Product Hunt·10mo ago
EdgeBench: A Benchmark for Measuring AI Environment Learning Through Extended Real-World Tasks
EdgeBench is a new benchmark designed to measure how AI agents learn from real-world environments through extended, continuous operation. Un
edge-bench.org·1d ago
CostBench benchmark compares Snowflake vs. ClickHouse Cloud on end-to-end real-time analytics cost and performance
This article introduces CostBench, a benchmark designed to measure real-time analytics systems end-to-end — covering continuous data ingest,
clickhouse.com·2d ago
KernelBench-Mega: Open Benchmark for Agentic GPU Whole-Block Megakernel Performance
KernelBench-Mega is an open benchmark for agentic GPU kernel generation, testing whole-block megakernels that fuse entire model blocks into
kernelbench.com·2d ago
New ITBench-AA Benchmark Reveals AI Models Struggle with Enterprise SRE Tasks
ITBench-AA, a new benchmark developed by Artificial Analysis and IBM Research over six months, reveals that leading AI models like Claude Op
Comments
Sign in to join the conversation.
No comments yet. Be the first.