1 citations · 2 across the 5 of their papers we have counts for
Showing 2026Show all
3 papers · 1 filter
cs.AI2026
Echo: Error-Compensated 4-Bit Tensor-Parallel Communication for LLM Training and Inference
Xingyu Xie, Xiaoyong Xie, Zhouchen Lin +1
Tensor parallelism ends every layer with an all-reduce that sits between two dependent matrix multiplications, so its cost cannot be hidden and grows as compute outpaces interconne…
cs.LG2026
Evolution of Optimization Methods: Algorithms, Scenarios, and Evaluations
Tong Zhang, Jiangning Zhang, Zhucun Xue +9
Balancing convergence speed, generalization capability, and computational efficiency remains a core challenge in deep learning optimization. First-order gradient descent methods, e…
cs.LG2026★ 1 cited
Slow-Fast Inference: Training-Free Inference Acceleration via Within-Sentence Support Stability
Xingyu Xie, Zhaochen Yu, Yue Liao +3
Long-context autoregressive decoding remains expensive because each decoding step must repeatedly process a growing history. We observe a consistent pattern during decoding: within…