61 citations · 64 across the 2 of their papers we have counts for
3 papers
cs.MS2022★ 3 cited
TorchOpt: An Efficient Library for Differentiable Optimization
Jie Ren, Xidong Feng, Bo Liu +4
Recent years have witnessed the booming of various differentiable optimization algorithms. These algorithms exhibit different execution patterns, and their execution needs massive…
cs.DC2021★ 61 cited
ZeRO-Offload: Democratizing Billion-Scale Model Training
Jie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi +5
Large-scale model training has been a playing ground for a limited few requiring complex model refactoring and access to prohibitively expensive GPU clusters. ZeRO-Offload changes…
cs.DC2020
Demystifying the Performance of HPC Scientific Applications on NVM-based Memory Systems
Ivy Peng, Kai Wu, Jie Ren +2
The emergence of high-density byte-addressable non-volatile memory (NVM) is promising to accelerate data- and compute-intensive applications. Current NVM technologies have lower pe…