Great progress has been made in the past few years in our understanding of nonconvex optimizations. In this talk, I will share with you three of our works in this direction. In one, we study low-rank ...

A group of researchers at the Massachusetts Institute of Technology have devised a potentially more effective way of helping computers solve some of the toughest optimization problems they face. Their ...

Efficient Training of Infinite-depth Neural Networks via Jacobian-free Backpropagation A promising trend in deep learning replaces fixed depth models by approximations of the limit as network depth ...