2 papers
cs.LG2026
Data-dependent Exploration for Online Reinforcement Learning from Human Feedback
Zhen-Yu Zhang, Yuting Tang, Jiandong Zhang +2
Online reinforcement learning from human feedback (RLHF) has emerged as a promising paradigm for aligning large language models (LLMs) by continuously collecting new preference fee…
cs.LG2026
Accelerated Dynamic Importance Weighting with Versatile Divergence-Minimizing Estimators
Tongtong Fang, Nan Lu, Gang Niu +2
Importance weighting (IW) is a golden solver for joint distribution shift, where the joint distributions differ between the training and test data. To solve this problem, IW estima…