ORFit: One-Pass Learning via Bridging Orthogonal Gradient Descent and Recursive Least-Squares

Youngjae Min, Namhoon Cho, Navid Azizan

While large machine learning models have shown remarkable performance in various domains, their training typically requires iterating for many passes over the training data. Howeve…