Seminar on Data Science and Machine Learning - How Much Over-parameterization Is Sufficient to Learn Deep ReLU Networks?
A recent breakthrough in deep learning theory shows that the training of over-parameterized deep neural networks (DNNs) can be characterized by the neural tangent kernel (NTK).