Showing 2025Show all
3 papers · 1 filter
cs.LG2025
Towards Analyzing and Understanding the Limitations of VAPO: A Theoretical Perspective
Jintian Shao, Yiming Cheng, Hongyi Huang +4
The VAPO framework has demonstrated significant empirical success in enhancing the efficiency and reliability of reinforcement learning for long chain-of-thought (CoT) reasoning ta…
cs.LG2025
ComplexFormer: Disruptively Advancing Transformer Inference Ability via Head-Specific Complex Vector Attention
Jintian Shao, Hongyi Huang, Jiayi Wu +4
Transformer models rely on self-attention to capture token dependencies but face challenges in effectively integrating positional information while allowing multi-head attention (M…
cs.CL2025
VQ-Logits: Compressing the Output Bottleneck of Large Language Models via Vector Quantized Logits
Jintian Shao, Hongyi Huang, Jiayi Wu +4
Large Language Models (LLMs) have achieved remarkable success but face significant computational and memory challenges, particularly due to their extensive output vocabularies. The…