4 papers
How to Utilize Complementary Vision-Text Information for 2D Structure Understanding
Jiancheng Dong, Pengyue Jia, Derong Xu +9
LLMs typically linearize 2D tables into 1D sequences to fit their autoregressive architecture, which weakens row-column adjacency and other layout cues. In contrast, purely visual…
MOSAIC: Composable Safety Alignment with Modular Control Tokens
Jingyu Peng, Hongyu Chen, Jiancheng Dong +5
Safety alignment in large language models (LLMs) is commonly implemented as a single static policy embedded in model parameters. However, real-world deployments often require conte…
Efficient Reasoning via Reward Model
Yuhao Wang, Xiaopeng Li, Cheng Gong +4
Reinforcement learning with verifiable rewards (RLVR) has been shown to enhance the reasoning capabilities of large language models (LLMs), enabling the development of large reason…
AdaSwitch: Balancing Exploration and Guidance in Knowledge Distillation via Adaptive Switching
Jingyu Peng, Maolin Wang, Hengyi Cai +5
Small language models (SLMs) are crucial for applications with strict latency and computational constraints, yet achieving high performance remains challenging. Knowledge distillat…