TernFS: Building an Exabyte-Scale Distributed Filesystem for Algorithmic Trading
By
kirlev
If you only eat one bagel today, this is the bagel.
Summary
XTX Markets, a leading algorithmic trading firm, developed TernFS - an exabyte-scale, multi-region distributed filesystem to address massive storage demands from their machine learning research. The system evolved from a simple NFS setup to handle hundreds of petabytes as the firm's compute infrastructure grew to tens of thousands of GPUs and hundreds of thousands of CPUs. TernFS was designed to support the firm's global trading operations that process over $250 billion daily across 35 countries.
Key quotes
· 4 pulledXTX is an algorithmic trading firm: it builds statistical models that produce price forecasts for over 50,000 financial instruments worldwide.
The firm started out with a couple of desktops and an NFS server, and 10 years later ended up with tens of thousands of high-end GPUs, hundreds of thousands of CPUs, and hundreds of petabytes of storage.
As compute grew, storage struggled to keep up. We rapidly outgrew NFS first and existing op
The firm trades over $250bn a day across 35 countries and has over 250 employees based in London, Singapore, New York, Paris, Bristol, Mumbai, Yerevan and Kajaani.
You might also wanna read
XTX Markets Develops TernFS: An Exabyte-Scale Distributed Filesystem for Algorithmic Trading Research
XTX Markets, a leading algorithmic trading firm, developed TernFS as a custom distributed filesystem to handle their massive computational n
xtxmarkets.com·8mo ago
Cathie Wood's ARK Invest holds $497M in Roku despite stock being 73% below all-time high
Cathie Wood's ARK Invest holds a significant position in Roku (ROKU), owning 3.82 million shares worth approximately $497 million, making it
bit.ly·5h ago
Bitcoin Miners Shift Toward Energy Infrastructure as Difficulty Nears 139 Trillion and Hashrate Surpasses 1 ZH/s
Bitcoin's network difficulty increased by 1.72% at block height 951552, while hashrate surpassed 1,000 EH/s (1 ZH/s). Bitcoin's price fluctu
news.bitcoin.com·9h ago
5 ETFs for Investing in Jensen Huang's Embodied AI Vision
The article discusses Jensen Huang's (NVIDIA CEO) vision for the next wave of AI — "embodied AI" — where AI moves beyond language and pixels
5 ETFs for Investing in Jensen Huang's Embodied AI Vision
The article discusses Jensen Huang's (NVIDIA CEO) vision for the next wave of AI — "embodied AI" — where AI moves beyond language and pixels
Circle Freezes $12.6M in USDC From Zama Privacy Contract Following Federal Court Order
Circle blacklisted a smart contract associated with Zama's privacy protocol on May 30, freezing approximately $12.6 million in USDC followin
news.bitcoin.com·13h ago