The Origins of Backpropagation in Neural Networks
By
nothrowaways
Hand-rolled, kettle-boiled, baked to perfection. Worth every minute at the bakery.
Summary
The article explores the origins of backpropagation (BP), a foundational technique in neural networks and deep learning. It credits the modern version of BP, also known as the reverse mode of automatic differentiation, to Finnish student Seppo Linnainmaa in 1970, with a precursor by Henry J. Kelley in 1960. The piece highlights BP's significance in the AI field and its 50th anniversary in 2020.
Key quotes
· 3 pulledEfficient backpropagation (BP) is central to the ongoing Neural Network (NN) ReNNaissance and 'Deep Learning.'
BP's modern version (also called the reverse mode of automatic differentiation) was first published in 1970 by Finnish master student Seppo Linnainmaa.
A precursor of BP was published by Henry J. Kelley in 1960.
You might also wanna read
AI-powered charging systems could extend EV battery life by up to 23%, researchers say
Researchers have developed AI-powered charging systems that could extend electric vehicle (EV) battery life by up to 23%. The technology opt
bgr.com·3h ago
Study: 3-Year-Olds Read Intent in Human Eyes but Not in Robot Gaze
A pioneering international study in developmental psychology and AI reveals that children as young as 3 instinctively read intentions in hum
neurosciencenews.com·5h ago
NVIDIA Launches Ising, Open Source Quantum AI Models to Advance Quantum Computing
NVIDIA announced the world's first family of open source quantum AI models, called NVIDIA Ising, designed to help researchers and enterprise
nvidianews.nvidia.com·8h ago
AI method developed to automatically design efficient quantum circuits
Researchers led by Gorka Muñoz-Gil from the Department of Theoretical Physics, in collaboration with NVIDIA and the group of theoretical phy
uibk.ac.at·9h ago
Scientists and engineers race to reduce AI's growing energy consumption
This article explores the massive and growing energy consumption of AI systems, particularly data centers powering large language models lik
knowablemagazine.org·9h ago
Google DeepMind and FutureHouse unveil AI agents Co-Scientist and Robin for research automation
Google DeepMind and FutureHouse have published studies introducing two new AI agent-based tools for scientific discovery: Co-Scientist and R
cenm.ag·17h ago