Wider Neural Networks with Fewer Parameters Improve Performance by Reducing Feature Interference

This work demonstrates how increasing the number of neurons in a network without increasing its total number of non-zero parameters improves performance. We show that this gain corresponds with a…