5 papers · 1 filter
Teacher-Guided Tool Learning for Small Language Models via Bidirectional KL Constraints
Haoxuan Gao, Qin-Wen Luo, Xiang Chen +5
External tools can extend the capabilities of small language models (SLMs), enabling their deployment in resource constrained environments. However, their limited capabilities make…
Mind the Execution Gap: Action-Semantic Mismatch in World-Model Control
Shengtao Wen, Xiang Chen, Yu Tian +3
World-model controllers rely on action-conditioned dynamics for prediction and planning, yet real control systems often execute commands asynchronously due to communication delay,…
Decoupling Knowledge and Privacy: Post-Task Self-Distillation Replay for LLM Continual Learning
Shengtao Wen, Yunying Yang, Xiang Chen +3
Privacy-preserving continual learning (PPCL) must reduce the reproduction of sensitive content while retaining useful knowledge across sequential tasks. Formal privacy guarantees c…
SafeThinker: Reasoning about Risk to Deepen Safety Beyond Shallow Alignment
Xianya Fang, Xianying Luo, Yadong Wang +8
Despite the intrinsic risk-awareness of Large Language Models (LLMs), current defenses often result in shallow safety alignment, rendering models vulnerable to disguised attacks (e…
Beyond Superficial Unlearning: Sharpness-Aware Robust Erasure of Hallucinations in Multimodal LLMs
Xianya Fang, Feiyang Ren, Xiang Chen +4
Multimodal LLMs are powerful but prone to object hallucinations, which describe non-existent entities and harm reliability. While recent unlearning methods attempt to mitigate this…