2.2k citations · 7.1k across the 72 of their papers we have counts for
8 papers · 1 filter
PHI-S: Distribution Balancing for Label-Free Multi-Teacher Distillation
Mike Ranzinger, Jon Barker, Greg Heinrich +3
Various visual foundation models have distinct strengths and weaknesses, both of which can be improved through heterogeneous multi-teacher knowledge distillation without labels, te…
CleanUNet 2: A Hybrid Speech Denoising Model on Waveform and Spectrogram
Zhifeng Kong, Wei Ping, Ambrish Dantrey +1
In this work, we present CleanUNet 2, a speech denoising model that combines the advantages of waveform denoiser and spectrogram denoiser and achieves the best of both worlds. Clea…
PrefixRL: Optimization of Parallel Prefix Circuits using Deep Reinforcement Learning
Rajarshi Roy, Jonathan Raiman, Neel Kant +6
In this work, we present a reinforcement learning (RL) based approach to designing parallel prefix circuits such as adders or priority encoders that are fundamental to high-perform…
Reducing Activation Recomputation in Large Transformer Models
Vijay Korthikanti, Jared Casper, Sangkug Lym +4
Training large transformer models is one of the most important computational challenges of modern AI. In this paper, we show how to significantly accelerate training of large trans…
Guiding Global Placement With Reinforcement Learning
Robert Kirby, Kolby Nottingham, Rajarshi Roy +2
Recent advances in GPU accelerated global and detail placement have reduced the time to solution by an order of magnitude. This advancement allows us to leverage data driven optimi…
Can -Learning with Graph Networks Learn a Generalizable Branching Heuristic for a SAT Solver?
Vitaly Kurin, Saad Godil, Shimon Whiteson +1
We present Graph--SAT, a branching heuristic for a Boolean SAT solver trained with value-based reinforcement learning (RL) using Graph Neural Networks for function approximation…