5 papers
Preserving Mathematical Reasoning in Compressed Diffusion Language Models via Trajectory-Aware Low-Rank Approximation
Tian Liang, Zishan Shao, Yiran Chen
Diffusion language model (dLLM) compression faces a known challenge because calibration is typically performed on clean, fully visible activations, whereas inference traverses part…
MetaRAG: Belief-Action Aligned Policy Optimization for Agentic RAG
Qiuyi Qi, Tian Liang, Jiamu Wang +7
Agentic retrieval-augmented generation (RAG) requires language models to decide when to continue searching and when to answer. Existing RL-based methods rely on external supervisio…
STAPO: Selective Trajectory-Aware Policy Optimization for LLM Agent Training
Qiuyi Qi, Tian Liang, Mutian Bao +8
Reinforcement Learning (RL) is the dominant paradigm for training Large Language Model (LLM) agents on long-horizon tasks. However, sparse and delayed rewards often lead to traject…
CARL: Constraint-Aware Reinforcement Learning for Planning with LLMs
Qiuyi Qi, Jinjian Zhang, Mutian Bao +9
Despite their strong reasoning capabilities and extensive world knowledge, Large Language Models (LLMs) frequently generate plans that violate task constraints, undermining their r…
Confidence Calibration for Multimodal LLMs: An Empirical Study through Medical VQA
Yuetian Du, Yucheng Wang, Ming Kong +4
Multimodal Large Language Models (MLLMs) show great potential in medical tasks, but their elicited confidence often misaligns with actual accuracy, potentially leading to misdiagno…