171 citations · 219 across the 6 of their papers we have counts for
3 papers · 1 filter
Exploring the limits of Concurrency in ML Training on Google TPUs
Sameer Kumar, James Bradbury, Cliff Young +16
Recent results in language understanding using neural networks have required training hardware of unprecedentedscale, with thousands of chips cooperating on a single training run.…
Sparse GPU Kernels for Deep Learning
Trevor Gale, Matei Zaharia, Cliff Young +1
Scientific workloads have traditionally exploited high levels of sparsity to accelerate computation and reduce memory requirements. While deep neural networks can be made sparse, a…
Bit-Parallel Vector Composability for Neural Acceleration
Soroush Ghodrati, Hardik Sharma, Cliff Young +2
Conventional neural accelerators rely on isolated self-sufficient functional units that perform an atomic operation while communicating the results through an operand delivery-aggr…