Cloudflare's Technical Journey: Pushing Beyond Linux Networking Stack Limitations
By
meysamazad
The kind of bagel that ruins lesser bagels for you.
Summary
Cloudflare engineers share their experience pushing beyond the design limitations of the Linux networking stack to achieve novel capabilities like soft-unicast for sharing IP subnets across data centers. The article details technical challenges faced when trying to bypass traditional Linux networking constraints and the innovative solutions developed to overcome them, highlighting the tension between operating system design intentions and real-world performance requirements for high-scale networking products.
Key quotes
· 4 pulledThere is a theory which states that if ever anyone discovers exactly what the Linux networking stack does and why it does it, it will instantly disappear and be replaced by something even more bizarre and inexplicable.
Many products at Cloudflare aren’t possible without pushing the limits of network hardware and software to deliver improved performance, increased efficiency, or novel capabilities such as soft-unicast.
Happily, most people do not need to know the intricacies of how your operating system handles network and Internet access in general. Yes, even most people within Cloudflare.
But sometimes we try to push well beyond the design intentions of Linux’s networking stack. This is a story about one of those attempts.
You might also wanna read
Understanding Cloudflare Zero Trust Tunnels: A Practical Guide for Personal Networking
The article is a personal technical guide explaining the author's journey from frustration with Tailscale to becoming a convert to Cloudflar
david.coffee·6mo ago
BGP Lab Project Expanded to Include Full IPv6 Feed
The author extends their BGP lab project to support full IPv6 feeds, following requests from readers who previously received IPv4 BGP feeds.
lukasz.bromirski.net·2d ago
Why local configuration verification is critical before cloud deployment in DevOps pipelines
The article discusses the importance of verifying configuration shifts locally before deploying to cloud clusters, using the example of a co
dev.to·2d ago
Whosthere: A Go-based LAN discovery tool with interactive TUI for unprivileged network scanning
Whosthere is a Go-based Local Area Network (LAN) discovery tool with an interactive Terminal User Interface (TUI). It performs unprivileged,
Product Hunt·10d ago
InstaVM: Hardware-Isolated Cloud Infrastructure for AI Agents with Sub-200ms MicroVMs
InstaVM is a cloud infrastructure platform designed specifically for AI agents, providing them with isolated, fast-booting virtual machines
Product Hunt·11d ago
Investigating Intermittent ECONNRESET Errors in Local TCP Connections (Part 1)
A technical blog post investigating mysterious ECONNRESET errors occurring between two services communicating over TCP on the same machine.