Online Policy Learning from Offline Preferences

Guoxi Zhang, Han Bao, Hisashi Kashima

In preference-based reinforcement learning (PbRL), a reward function is learned from a type of human feedback called preference. To expedite preference collection, recent works hav…