8 papers
MOON: Multi-Objective OrthoNormalized Updates for Multitask Learning
Shiji Zhou, Kunlin Lyu, Lei Zhang +2
Multi-objective optimization (MOO) has demonstrated significant success in multi-task learning by mitigating task conflicts through gradient manipulation. However, most existing me…
PACT: Learning Diverse Diagnostic Strategies via Privileged Synthesis and Branch Consensus
Gen Li, Yuanze Hu, Zhichao Yang +10
Clinical diagnosis requires flexible use of multiple reasoning paradigms under incomplete patient information. Existing LLM-based medical agents show strong medical reasoning abili…
HalluSAE: Detecting Hallucinations in Large Language Models via Sparse Auto-Encoders
Boshui Chen, Zhaoxin Fan, Ke Wang +5
Large Language Models (LLMs) are powerful and widely adopted, but their practical impact is limited by the well-known hallucination phenomenon. While recent hallucination detection…
RoboPARA: Dual-Arm Robot Planning with Parallel Allocation and Recomposition Across Tasks
Shiying Duan, Pei Ren, Nanxiang Jiang +5
Dual-arm robots play a crucial role in improving efficiency and flexibility in complex multitasking scenarios. While existing methods have achieved promising results in task planni…
The Achilles' Heel of LLMs: How Altering a Handful of Neurons Can Cripple Language Abilities
Zixuan Qin, Qingchen Yu, Kunlin Lyu +2
Large Language Models (LLMs) have become foundational tools in natural language processing, powering a wide range of applications and research. Many studies have shown that LLMs sh…
Can Structured Templates Facilitate LLMs in Tackling Harder Tasks? : An Exploration of Scaling Laws by Difficulty
Zhichao Yang, Zhaoxin Fan, Gen Li +6
Structured, procedural reasoning is essential for Large Language Models (LLMs), especially in mathematics. While post-training methods have improved LLM performance, they still fal…