Neural Parameter Allocation Search

Bryan A. Plummer, Nikoli Dryden, Julius Frost +2

Training neural networks requires increasing amounts of memory. Parameter sharing can reduce memory and communication costs, but existing methods assume networks have many identica…