The Institute's School of Mathematics held the workshop "Theory of Deep Learning: Where Next?" October 15–18, 2019, as part of the School's special year on Optimization, Statistics, and Theoretical Machine Learning.
The workshop brought together deep learning practitioners and theorists to discuss the progress that has been made on deep learning theory and to identify promising avenues where theory is possible and useful. It was organized by Sanjeev Arora, Distinguished Visiting Professor in the School, Members Joan Bruna, Rong Ge, Jason Lee, and Bin Yu, and Suriya Gunasekar.
Invited speakers and postdoctoral researchers gave talks on topics such as adaptivity and generalization in deep learning, dimensionality and mode collapse, and neural networks.