Disk Access Outperforms Memory Caching in Modern Hardware Systems
By
ghuntley
Front-window bakery material. Catches the eye, delivers the goods.
Summary
This technical article challenges conventional computer science wisdom by demonstrating that sourcing data directly from disk can be faster than caching in memory, contrary to traditional performance assumptions. The author provides evidence showing that while hardware has gotten wider (more parallel), it hasn't gotten faster in terms of latency, requiring new approaches to leverage what actually scales in modern systems.
Key quotes
· 4 pulledSourcing data directly from disk IS faster than caching in memory. I brought receipts.
Because hardware got wider but not faster, the old methods don't get you there.
You need new tools to use what is scaling and avoid what isn't.
Computer Science dogma says that unused memory should be used to cache things from disk, but this article challenges that assumption.
You might also wanna read
Understanding CPU Branch Prediction and Its Impact on Benchmarking
The article discusses how modern processors use branch prediction to execute multiple instructions per cycle, explaining that CPUs have rema
lemire.me·2mo ago
Optimizing Code Performance When Branch Prediction Works Against You
The article discusses techniques for optimizing program performance when branch prediction works against the code, using a financial/trading
nicula.xyz·6mo ago
Optimizing .NET APIs for High Throughput: Techniques for 1M Requests Per Minute
Article discusses techniques for designing high-throughput .NET APIs capable of handling 1M requests per minute. It covers horizontal scalin
blog.elmah.io·15h ago
Reverse-engineering the Intel 8087: A look at microcode and register exchange
A detailed technical deep-dive into the Intel 8087 floating-point co-processor's microcode, specifically examining the register exchange ope
righto.com·1d ago
How micro-optimizations in Azure Service Bus SDK paved the way for a smarter redesign
The article discusses how micro-optimizations in the Azure Service Bus SDK led to meaningful design improvements. Rather than advocating for
How Kestra Improved Orchestrator Performance Across 14 Releases: A Year of Performance Engineering
Kestra's engineering team details their year-long performance engineering journey across releases 0.19 to 1.3, treating performance as an on
medium.com·2d ago