Thompson Sampling in Online RLHF with General Function Approximation

Songtao Feng, Jie Fu

Reinforcement learning from human feedback (RLHF) has achieved great empirical success in aligning large language models (LLMs) with human preference, and it is of great importance…