6 papers · 1 filter
Selective Knowledge Edit Reversal via Gated Singular Vector Shrinkage
Weifeng Jiang, Ruirui Chen, Qianren Mao +3
Knowledge editing provides an efficient way to update factual knowledge in large language models. However, malicious edits may introduce safety risks, making it necessary to revers…
E-Orch: Towards Effective, Efficient, and Extensible Agentic Orchestration with Reinforcement Learning
Junnan Liu, Linhao Luo, Thuy-Trang Vu +1
Agentic orchestration enables multiple autonomous agents to solve complex tasks through adaptive decomposition, delegation, and execution. However, existing orchestrators often rel…
Enhancing Multilingual Reasoning via Steerable Model Merging
Zhuoran Li, Rui Xu, Jian Yang +8
Model merging is an effective technique for composing the capabilities of a multilingual model and a reasoning model. It has achieved promising generalization in multilingual reaso…
OpenCompass: A Universal Evaluation Platform for Large Language Models
Maosong Cao, Kai Chen, Haodong Duan +27
In recent years, the field of artificial intelligence has undergone a paradigm shift from task-specific small-scale models to general-purpose large language models (LLMs). With the…
AIPO: Learning to Reason from Active Interaction
Junnan Liu, Linhao Luo, Thuy-Trang Vu +1
Recent advances in LLMs have demonstrated strong reasoning capabilities, largely stimulated by RLVR. However, the exploration of existing RLVR algorithms remains largely constraine…
SinkRouter: Sink-Aware Routing for Efficient Long-Context Decoding in Large Language and Multimodal Models
Junnan Liu, Xinyan Liu, Peifeng Gao +4
In long-context decoding for LLMs and LMMs, attention becomes increasingly memory-bound because each decoding step must load a large amount of KV-cache data from GPU memory. Existi…