An Informational Curse of Horizon in Goal-Conditioned Policy Learning

John L. Zhou, Yuxuan Dong, Jonathan C. Kao

The difficulty of learning goal-reaching policies is often attributed to a "curse of horizon" that manifests as bias accumulation in temporal-difference backups and noisy advantage…