49 citations · 60 across the 10 of their papers we have counts for
3 papers · 1 filter
Reconfigurable Stream Network Architecture
Chengyue Wang, Xiaofan Zhang, Jason Cong +1
As AI systems grow increasingly specialized and complex, managing hardware heterogeneity becomes a pressing challenge. How can we efficiently coordinate and synchronize heterogeneo…
SSDTrain: An Activation Offloading Framework to SSDs for Faster Large Language Model Training
Kun Wu, Jeongmin Brian Park, Xiaofan Zhang +5
The growth rate of the GPU memory capacity has not been able to keep up with that of the size of large language models (LLMs), hindering the model training process. In particular,…
ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
Haoran You, Yipin Guo, Yichao Fu +6
Large language models (LLMs) have shown impressive performance on language tasks but face challenges when deployed on resource-constrained devices due to their extensive parameters…