1 paper · 2 filters
Neel Mishra, Jichao Jiang, Kushagara Trivedi +3
Distributed training of large neural networks is bottlenecked by full-precision gradient communication and by coordinatewise optimizers that ignore the matrix structure of weight t…