2 papers
cs.LG2024
Fast Inference for Augmented Large Language Models
Rana Shahout, Cong Liang, Shiji Xin +4
Augmented Large Language Models (LLMs) enhance the capabilities of standalone LLMs by integrating external data sources through API calls. In interactive LLM applications, efficien…
cs.DC2024
Communication Optimization for Distributed Training: Architecture, Advances, and Opportunities
Yunze Wei, Tianshuo Hu, Cong Liang +1
The past few years have witnessed the flourishing of large-scale deep neural network models with ever-growing parameter numbers. Training such large-scale models typically requires…