Hands-on Tutorials

Role of Data in Implicit Regularization

Using Legendre polynomials as the features can significantly improve convergence

Photo by Drew Graham on Unsplash

TL;DR

In this article, we revisit an apparent implicit regularization effect of Gradient Descent-based optimization algorithms. We consider it on a textbook example of…