2 papers
cs.LG2026
: Spectral Null-Space Swap Makes Reasoning Models Efficient
Hongbo Ma, Sansheng Cao, Jiajun Fan +2
LLMs trained with Chain-of-thought excel in reasoning capability, but often come with excessive token cost. We find that the core of reasoning capacity lies in the Thinking model's…
cs.LG2026
Hierarchical Zero-Order Optimization for Deep Neural Networks
Sansheng Cao, Zhengyu Ma, Yonghong Tian
Zeroth-order (ZO) optimization has long been favored for its biological plausibility and its capacity to handle non-differentiable objectives, yet its computational complexity has…