19 papers
The "Knowledge-Behavior Gap" in Cultural Taboo Safety of Large Language Models
Ying He, Sihang Jiang, Xingzhou Chen +6
Cultural taboo safety is essential for deploying large language models (LLMs), as culturally insensitive outputs may cause offense or even social harm. However, existing cultural b…
From Isolated Tasks to Structured Capabilities: A Multilayer Taxonomy for Large Language Models
Shixin Fang, Jiachen Wo, Wenjuan Qin +2
Large language model (LLM) evaluation spans diverse tasks and benchmarks, yet evidence remains organized around tasks rather than the capabilities they probe. This fragmentation li…
When RAG Meets Query Planning: Logical Query Trees for Resolving Exploratory Reasoning Problems
Ganlin Xu, Linghao Zhang, Zhitao Yin +7
Retrieval-Augmented Generation (RAG) effectively grounds large language models (LLMs) in external knowledge but struggles with \textbf{exploratory reasoning problems (ERPs)} that a…
Selective Expert Guidance for Effective and Diverse Exploration in Reinforcement Learning of LLMs
Zishang Jiang, Jinyi Han, Tingyun Li +7
Reinforcement Learning with Verifiable Rewards (RLVR) has become a widely adopted technique for enhancing the reasoning ability of Large Language Models (LLMs). However, the effect…
From Outcomes to Actions: Leveraging Hindsight for Long-Horizon Language Agent Training
Zishang Jiang, Tingyun Li, Jinyi Han +7
Reinforcement learning (RL) has become a widely adopted technique for improving large language models (LLMs) on complex tasks. Despite this progress, existing RL methods still face…
Don't Tell the Answer, Truly Guide the Reasoning During RL Rollouts
Xinyi Wang, Jinyi Han, Zishang Jiang +7
Reinforcement Learning (RL) has become a key driver for enhancing the long chain-of-thought (CoT) reasoning capabilities of Large Language Models (LLMs). However, prevalent methods…