activity
20182026
most citedAdaScale SGD: A User-Friendly Algorithm for Distributed Training

20 citations · 41 across the 5 of their papers we have counts for

collaborators

5 papers

cs.SD2026

Memory Efficient Audio Synthesis with Decoupled Temporal Depth Diffusion Transformers

Dongseong Hwang, Prasanth Yadla, Kaan Elgin +8

Siri Expressive Voices synthesize rich, configurable speech in real time and entirely on device, powered by AFM 3 Core Advanced, Apple's most powerful on-device foundation model. T…

cs.AI2024

Towards Low-bit Communication for Tensor Parallel LLM Inference

Harry Dong, Tyler Johnson, Minsik Cho +1

Tensor parallelism provides an effective way to increase server large language model (LLM) inference efficiency despite adding an additional communication cost. However, as server…

cs.LG2023★ 18 cited

Probabilistic Neural Data Fusion for Learning from an Arbitrary Number of Multi-fidelity Data Sets

Carlos Mora, Jonathan Tammer Eweis-Labolle, Tyler Johnson +2

In many applications in engineering and sciences analysts have simultaneous access to multiple data sources. In such cases, the overall cost of acquiring information can be reduced…

cs.LG2020★ 20 cited

AdaScale SGD: A User-Friendly Algorithm for Distributed Training

Tyler B. Johnson, Pulkit Agrawal, Haijie Gu +1

When using large-batch training to speed up stochastic gradient descent, learning rates must adapt to new batch sizes in order to maximize speed-ups and preserve model quality. Re-…

stat.ML2018★ 3 cited

A Fast, Principled Working Set Algorithm for Exploiting Piecewise Linear Structure in Convex Problems

Tyler B. Johnson, Carlos Guestrin

By reducing optimization to a sequence of smaller subproblems, working set algorithms achieve fast convergence times for many machine learning problems. Despite such performance, w…