A block-random algorithm for learning on distributed, heterogeneous data

Prakash Mohan, Marc T. Henry de Frahan, Ryan King +1

Most deep learning models are based on deep neural networks with multiple layers between input and output. The parameters defining these layers are initialized using random values…