RLHND: Video Foundation Models as Physically Grounded Hand Trackers for Robot Learning

Seungjun Moon, Subin Jeon, Sangwoo Kim +2

Recently, approaches that leverage human video datasets for robot policy training have become increasingly prevalent. However, most existing hand trackers regress pose from cropped…