Training DNNs in O(1) memory with MEM-DFA using Random Matrices

Tien Chu, Kamil Mykitiuk, Miron Szewczyk +2

This work presents a method for reducing memory consumption to a constant complexity when training deep neural networks. The algorithm is based on the more biologically plausible a…