3 papers
cs.CL2026
Inference-time Alignment via Sparse Junction Steering
Runyi Hu, Jie Zhang, Shiqian Zhao +7
Token-level steering has emerged as a pivotal approach for inference-time alignment, enabling fine grained control over large language models by modulating their output distributio…
cs.LG2025
DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster
Ji Qi, WenPeng Zhu, Li Li +6
The distributed training of foundation models, particularly large language models (LLMs), demands a high level of communication. Consequently, it is highly dependent on a centraliz…
cs.LG2024
Mind the Cost of Scaffold! Benign Clients May Even Become Accomplices of Backdoor Attack
Xingshuo Han, Xuanye Zhang, Xiang Lan +7
By using a control variate to calibrate the local gradient of each client, Scaffold has been widely known as a powerful solution to mitigate the impact of data heterogeneity in Fed…