5 papers
System 1&2 Synergy via Dynamic Model Interpolation
Chenxu Yang, Qingyi Si, Chong Tian +6
Training a unified language model that adapts between intuitive System 1 and deliberative System 2 remains challenging due to interference between their cognitive modes. Recent stu…
Test-time Prompt Intervention
Chenxu Yang, Qingyi Si, Mz Dai +5
Test-time compute has led to remarkable success in the large language model (LLM) community, particularly for complex tasks, where longer chains of thought (CoTs) are generated to…
Dynamic Early Exit in Reasoning Models
Chenxu Yang, Qingyi Si, Yongjie Duan +6
Recent advances in large reasoning language models (LRLMs) rely on test-time scaling, which extends long chain-of-thought (CoT) generation to solve complex tasks. However, overthin…
Breaking the Trade-Off Between Faithfulness and Expressiveness for Large Language Models
Chenxu Yang, Qingyi Si, Zheng Lin
Grounding responses in external knowledge represents an effective strategy for mitigating hallucinations in Large Language Models (LLMs). However, current LLMs struggle to seamless…
Multimodal Hypothetical Summary for Retrieval-based Multi-image Question Answering
Peize Li, Qingyi Si, Peng Fu +2
Retrieval-based multi-image question answering (QA) task involves retrieving multiple question-related images and synthesizing these images to generate an answer. Conventional "ret…