The Power of External Memory in Increasing Predictive Model Capacity

Cenk Baykal, Dylan J Cutler, Nishanth Dikkala +3

One way of introducing sparsity into deep networks is by attaching an external table of parameters that is sparsely looked up at different layers of the network. By storing the bul…