5 papers · 1 filter
Not Just the Destination, But the Journey: Reasoning Traces Causally Shape Generalization Behaviors
Pengcheng Wen, Yanxu Zhu, Jiapeng Sun +5
Chain-of-Thought (CoT) is often viewed as a window into LLM decision-making, yet recent work suggests it may function merely as post-hoc rationalization. This raises a critical ali…
Self-Guided Adaptive Safety Alignment: Synthesizing and Internalizing Guidelines in Reasoning Models
Yuhang Wang, Yanxu Zhu, Jiaming Zhang +2
Explicit safety policies can improve reasoning-model safety, but their effective coverage may lag behind evolving jailbreak strategies. We study whether a reasoning model can synth…
KG-FPQ: Evaluating Factuality Hallucination in LLMs with Knowledge Graph-based False Premise Questions
Yanxu Zhu, Jinlin Xiao, Yuhang Wang +1
Recent studies have demonstrated that large language models (LLMs) are susceptible to being misled by false premise questions (FPQs), leading to errors in factual knowledge, know a…
Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning
Jitao Sang, Yuhang Wang, Jing Zhang +5
This paper presents a follow-up study to OpenAI's recent superalignment work on Weak-to-Strong Generalization (W2SG). Superalignment focuses on ensuring that high-level AI systems…
CDEval: A Benchmark for Measuring the Cultural Dimensions of Large Language Models
Yuhang Wang, Yanxu Zhu, Chao Kong +4
As the scaling of Large Language Models (LLMs) has dramatically enhanced their capabilities, there has been a growing focus on the alignment problem to ensure their responsible and…