2 citations · 4 across the 4 of their papers we have counts for
4 papers
Diagnosing Training Inference Mismatch in LLM Reinforcement Learning via a Zero-Mismatch Reference
Tianle Zhong, Neiwen Ling, Yifan Pi +5
Modern LLM RL systems separate rollout generation from policy optimization. These two stages are expected to produce token probabilities that match exactly. However, implementation…
Study of Dropout in PointPillars with 3D Object Detection
Xiaoxiang Sun, Geoffrey Fox
3D object detection is critical for autonomous driving, leveraging deep learning techniques to interpret LiDAR data. The PointPillars architecture is a prominent model in this fiel…
RINAS: Training with Dataset Shuffling Can Be General and Fast
Tianle Zhong, Jiechen Zhao, Xindi Guo +2
Deep learning datasets are expanding at an unprecedented pace, creating new challenges for data processing in model training pipelines. A crucial aspect of these pipelines is datas…
RTP: Rethinking Tensor Parallelism with Memory Deduplication
Cheng Luo, Tianle Zhong, Geoffrey Fox
In the evolving landscape of neural network models, one prominent challenge stand out: the significant memory overheads associated with training expansive models. Addressing this c…