11 citations · 47 across the 26 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.LG2024
A Common Pitfall of Margin-based Language Model Alignment: Gradient Entanglement
Hui Yuan, Yifan Zeng, Yue Wu +3
Reinforcement Learning from Human Feedback (RLHF) has become the predominant approach for language model (LM) alignment. At its core, RLHF uses a margin-based loss for preference o…
cs.LG2024
Accounting for AI and Users Shaping One Another: The Role of Mathematical Models
Sarah Dean, Evan Dong, Meena Jagadeesan +1
As AI systems enter into a growing number of societal domains, these systems increasingly shape and are shaped by user preferences, opinions, and behaviors. However, the design of…
cs.CL2024★ 6 cited
Prompting Fairness: Integrating Causality to Debias Large Language Models
Jingling Li, Zeyu Tang, Xiaoyu Liu +4
Large language models (LLMs), despite their remarkable capabilities, are susceptible to generating biased and discriminatory responses. As LLMs increasingly influence high-stakes d…