4 papers
MASCRDM: Multi-Agent System for Compliance Risk Detection and Mitigation in Training Process of Large Language Models
Yan Zhang, Chuming Wei, Ruien Li +3
Large Language Models (LLMs) have been applied in various fields. However, ensuring compliance and safety of LLMs, such as avoiding discrimination and bias, still remains a challen…
AutoLoCo: Communication Efficient Distributed LLM Training via Adaptive Synchronization
Pengyu He, Yan Zhang, Ruien Li +1
The pre-training of Large Language Models (LLMs) is increasingly conducted across multiple data centers. As training scales to a larger number of accelerators, the fraction of time…
EADC: Evaluation of Advanced and Deep-level Compliance in Large Language Models
Yan Zhang, Ruien Li, Yaoyao Peng +4
Large Language Models (LLMs) have been used in various industries. However, ensuring their compliance with complex laws and regulatory frameworks remains a great challenge. Existin…
ServeGen: Workload Characterization and Generation of Large Language Model Serving in Production
Yuxing Xiang, Xue Li, Kun Qian +3
With the widespread adoption of Large Language Models (LLMs), serving LLM inference requests has become an increasingly important task, attracting active research advancements. Pra…