Optimizing Python Imports in HRT's Monorepo with PEP 690
By
davidteather
Crisp on the outside, thoughtful on the inside. A keeper.
Summary
The article discusses Hudson River Trading's (HRT) approach to managing Python imports in a monorepo environment, highlighting the challenges of import proliferation. It explores leveraging PEP 690 to optimize import speeds, emphasizing the benefits for cross-team collaboration and rapid deployment.
Key quotes
· 3 pulledAt Hudson River Trading (HRT), we’ve found that centralizing our codebase facilitates cross-team collaboration and rapid deployment of new projects.
Unfortunately, the convenience of this arrangement has led to a conundrum: a vast proliferation of imports.
In Python, imports occur at runtime. For each imported name, the interpreter must find, load, and evaluate the contents of a corre
You might also wanna read
Java Performance Optimization: Fixing 8 Common Anti-Patterns to Reduce Processing Time by 80%
The article presents a case study of Java performance optimization where fixing common anti-patterns dramatically improved application perfo
jvogel.me·2mo ago
Performance Optimization: Replacing Virtual Dispatch with Static Polymorphism in C++
The article discusses performance issues with virtual dispatch in object-oriented programming and advocates for using static polymorphism as
david.alvarezrosa.com·3mo ago
Performance Optimization: Achieving 20x Speedup by Removing Code in Rust Data Versioning Tool
A developer shares a performance optimization story where removing code led to a 20x speedup in their data versioning tool. The team at Oxen
suriya.cc·3mo ago
Introducing tprof: A Targeted Profiler for Python Performance Optimization
The article introduces tprof, a targeting profiler for Python that addresses the inefficiency of traditional profilers when optimizing speci
Building memchunk: A High-Performance Text Chunking Library for RAG Pipelines Using SIMD and memchr
The article details the development of memchunk, a high-performance text chunking library for RAG (Retrieval-Augmented Generation) pipelines
minha.sh·4mo ago
GitHub Repository: Fix for VLC Video Source Audio Stuttering and CPU Throttling on Low-End Devices
A GitHub repository containing code that fixes VLC Video Source audio stuttering and CPU throttling issues on low-end or older devices durin
github.com·4mo ago