mytorch: Python Automatic Differentiation Library Inspired by PyTorch
By
iguana2000
Crisped on the outside, thoughtful enough on the inside.
Summary
mytorch is an open-source Python library that implements automatic differentiation with a PyTorch-like API, using NumPy for computations. The project demonstrates graph-based reverse-mode autodifferentiation that can compute arbitrarily high derivatives for both scalars and non-scalars. The implementation is designed to be easily extensible, with potential for adding neural network modules (torch.nn) and GPU support via CuPy or Numba. The author notes it would be an interesting but 'useless' endeavor to rewrite it in a low-level language using BLAS library calls like PyTorch does.
Key quotes
· 5 pulledEasily extensible autograd implemented python with pytorch API.
Uses numpy to do the heavy-lifting.
Implementation is very similar to pytorch (graph-based reverse-mode autodiff).
It would be an interesting (but useless) endeavor to rewrite mytorch in a low level language using BLAS library calls instead on numpy, just like pytorch.
mytorch supports the computation of arbitrarily high derivatives for both scalars and non-scalars.
You might also wanna read
ds4: A lightweight Metal-native inference engine for DeepSeek V4 Flash
ds4.c is a specialized, lightweight native inference engine for DeepSeek V4 Flash, built specifically for Apple's Metal framework. Unlike ge
github.com·24d ago
gtinygrad: A Lightweight Gradient Computation Framework Combining PyTorch, micrograd, and tinygrad Concepts
The article appears to be about a GitHub repository called 'gtinygrad' that combines concepts from PyTorch, micrograd, and tinygrad. It seem
github.com·4mo ago
NVIDIA Releases nvmath-python: Open-Source Math Libraries for the Python Ecosystem
NVIDIA has released nvmath-python, an open-source Python package that brings NVIDIA's math libraries to the Python ecosystem. The package pr
github.com·8mo ago
iNaturalist Releases Subset of Machine Learning Models for Public Use
iNaturalist is making a subset of its machine learning models publicly available, specifically "small" models trained on approximately 500 t
github.com·9mo ago
Netflix engineer's open-source tool cuts AI token usage by up to 90%
Netflix senior engineer Tejas Chopra created software called "Project Headroom" that prunes redundant tokens from AI agent instructions befo
theregister.com·4h ago
Copyparty: A Lightweight File Server That Runs as a Single Python Script
Copyparty is a lightweight, full-featured file server that runs as a single Python script, making it extremely easy to set up without needin
hackaday.com·6h ago