From Observation to Intervention: Identifiability of Latent User Bias in Human-AI Interaction

Lucas Biechy, Yuxiao Li, Zhonghao He +1

Alignment methods typically treat user behavior as a reliable proxy for underlying preferences. However, this assumption breaks down when users hold belief-dependent cognitive bias…