127 citations · 367 across the 12 of their papers we have counts for
3 papers · 1 filter
Checkmate: Breaking the Memory Wall with Optimal Tensor Rematerialization
Paras Jain, Ajay Jain, Aniruddha Nrusimha +5
We formalize the problem of trading-off DNN training time and memory requirements as the tensor rematerialization optimization problem, a generalization of prior checkpointing stra…
Revec: Program Rejuvenation through Revectorization
Charith Mendis, Ajay Jain, Paras Jain +1
Modern microprocessors are equipped with Single Instruction Multiple Data (SIMD) or vector instructions which expose data level parallelism at a fine granularity. Programmers explo…
The OoO VLIW JIT Compiler for GPU Inference
Paras Jain, Xiangxi Mo, Ajay Jain +3
Current trends in Machine Learning~(ML) inference on hardware accelerated devices (e.g., GPUs, TPUs) point to alarmingly low utilization. As ML inference is increasingly time-bound…