Continuous Conditioning of VLAs with Augmenting EMG and Visual Task Descriptors

Edward W. Staley, Connor O. Pyles, Rahul Hingorani +5

Vision-Language-Action (VLA) models rely strongly on language for describing task information, despite having multimodal inputs. We hypothesize that other modalities in the state s…