Automatically Batching Control-Intensive Programs for Modern Accelerators

Alexey Radul, Brian Patton, Dougal Maclaurin +2

We present a general approach to batching arbitrary computations for accelerators such as GPUs. We show orders-of-magnitude speedups using our method on the No U-Turn Sampler (NUTS…