FOCUS: From Privileged States to RGB-D with Controlled Modality Switching and Representation Alignment

Filip Grigorov, Kourosh Darvish, Nandita Vijaykumar

Vision-based reinforcement learning for robotic manipulation is sample-inefficient because RGB-D observations are high-dimensional and noisy. Privileged state information available…