X-Distill: Cross-Architecture Vision Distillation for Visuomotor Learning

Maanping Shao, Feihong Zhang, Gu Zhang +3

Visuomotor policies often leverage large pre-trained Vision Transformers (ViTs) for their powerful generalization capabilities. However, their significant data requirements present…