activity
20222024
most citedColossal-Auto: Unified Automation of Parallelization and Activation Checkpoint for Large-scale Models

6 citations · 12 across the 6 of their papers we have counts for

collaborators

6 papers

cs.CV2024

Unveiling Redundancy in Diffusion Transformers (DiTs): A Systematic Study

Xibo Sun, Jiarui Fang, Aoyu Li +1

The increased model capacity of Diffusion Transformers (DiTs) and the demand for generating higher resolutions of images and videos have led to a significant rise in inference late…

cs.DC20241 cited

xDiT: an Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism

Jiarui Fang, Jinzhe Pan, Xibo Sun +2

Diffusion models are pivotal for generating high-quality images and videos. Inspired by the success of OpenAI's Sora, the backbone of diffusion models is evolving from U-Net to Tra…

cs.LG20243 cited

USP: A Unified Sequence Parallelism Approach for Long Context Generative AI

Jiarui Fang, Shangchun Zhao

Sequence parallelism (SP), which divides the sequence dimension of input tensors across multiple computational devices, is becoming key to unlocking the long-context capabilities o…

cs.DC20241 cited

LoongTrain: Efficient Training of Long-Sequence LLMs with Head-Context Parallelism

Diandian Gu, Peng Sun, Qinghao Hu +11

Efficiently training LLMs with long sequences is important yet challenged by the massive computation and memory requirements. Sequence parallelism has been proposed to tackle these…

cs.LG20236 cited

Colossal-Auto: Unified Automation of Parallelization and Activation Checkpoint for Large-scale Models

Yuliang Liu, Shenggui Li, Jiarui Fang +3

In recent years, large-scale models have demonstrated state-of-the-art performance across various domains. However, training such models requires various techniques to address the…

cs.IR20221 cited

A Frequency-aware Software Cache for Large Recommendation System Embeddings

Jiarui Fang, Geng Zhang, Jiatong Han +5

Deep learning recommendation models (DLRMs) have been widely applied in Internet companies. The embedding tables of DLRMs are too large to fit on GPU memory entirely. We propose a…