4 papers
Gaze-Regularized Vision-Language-Action Models for Robotic Manipulation
Anupam Pani, Yanchao Yang
Despite advances in Vision-Language-Action (VLA) models, robotic manipulation struggles with fine-grained tasks because current models lack mechanisms for active visual attention a…
Gaze-Regularized VLMs for Ego-Centric Behavior Understanding
Anupam Pani, Yanchao Yang
Eye gaze, encompassing fixations and saccades, provides critical insights into human intentions and future actions. This study introduces a gaze-regularized framework that enhances…
Gaze-VLM:Bridging Gaze and VLMs through Attention Regularization for Egocentric Understanding
Anupam Pani, Yanchao Yang
Eye gaze offers valuable cues about attention, short-term intent, and future actions, making it a powerful signal for modeling egocentric behavior. In this work, we propose a gaze-…
How to Achieve Higher Accuracy with Less Training Points?
Jinghan Yang, Anupam Pani, Yunchao Zhang
In the era of large-scale model training, the extensive use of available datasets has resulted in significant computational inefficiencies. To tackle this issue, we explore methods…