10 citations · 31 across the 38 of their papers we have counts for
5 papers · 1 filter
Fast-Slow Thinking RM: Efficient Integration of Scalar and Generative Reward Models
Jiayun Wu, Peixu Hou, Shan Qu +4
Reward models (RMs) are critical for aligning Large Language Models via Reinforcement Learning from Human Feedback (RLHF). While Generative Reward Models (GRMs) achieve superior ac…
IntPro: A Proxy Agent for Context-Aware Intent Understanding via Retrieval-conditioned Inference
Guanming Liu, Meng Wu, Peng Zhang +8
Large language models (LLMs) have become integral to modern Human-AI collaboration workflows, where accurately understanding user intent serves as a crucial step for generating sat…
"Harmless to You, Hurtful to Me!": Investigating the Detection of Toxic Languages Grounded in the Perspective of Youth
Yaqiong Li, Peng Zhang, Lin Wang +4
Risk perception is subjective, and youth's understanding of toxic content differs from that of adults. Although previous research has conducted extensive studies on toxicity detect…
Negating Negatives: Alignment with Human Negative Samples via Distributional Dispreference Optimization
Shitong Duan, Xiaoyuan Yi, Peng Zhang +5
Large language models (LLMs) have revolutionized the role of AI, yet pose potential social risks. To steer LLMs towards human preference, alignment technologies have been introduce…
Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learning
Shitong Duan, Xiaoyuan Yi, Peng Zhang +3
Large Language Models (LLMs) have made unprecedented breakthroughs, yet their increasing integration into everyday life might raise societal risks due to generated unethical conten…