activity
20232026
most citedBeyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping

6 citations · 16 across the 14 of their papers we have counts for

collaborators
Showing 2023Show all

1 paper · 1 filter

cs.LG2023

A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale

Hao-Jun Michael Shi, Tsung-Hsien Lee, Shintaro Iwasaki +5

Shampoo is an online and stochastic optimization algorithm belonging to the AdaGrad family of methods for training neural networks. It constructs a block-diagonal preconditioner wh…