SketchOGD: Memory-Efficient Continual Learning

Youngjae Min, Benjamin Wright, Jeremy Bernstein +1

When machine learning models are trained continually on a sequence of tasks, they are often liable to forget what they learned on previous tasks--a phenomenon known as catastrophic…