5 papers
GazeAct: A Human-Gaze-Annotated Manipulation Dataset for Attention-Regularized Policies
Anupam Pani, Wang Yuan, Qifan Wang +1
Vision-language-action (VLA) policies must ground language instructions in the right objects, contact points, and target locations for reliable manipulation. Human gaze provides a…
Gaze-Regularized Vision-Language-Action Models for Robotic Manipulation
Anupam Pani, Yanchao Yang
Despite advances in Vision-Language-Action (VLA) models, robotic manipulation struggles with fine-grained tasks because current models lack mechanisms for active visual attention a…
Gaze-Regularized VLMs for Ego-Centric Behavior Understanding
Anupam Pani, Yanchao Yang
Eye gaze, encompassing fixations and saccades, provides critical insights into human intentions and future actions. This study introduces a gaze-regularized framework that enhances…
Gaze-VLM:Bridging Gaze and VLMs through Attention Regularization for Egocentric Understanding
Anupam Pani, Yanchao Yang
Eye gaze offers valuable cues about attention, short-term intent, and future actions, making it a powerful signal for modeling egocentric behavior. In this work, we propose a gaze-…
How to Achieve Higher Accuracy with Less Training Points?
Jinghan Yang, Anupam Pani, Yunchao Zhang
In the era of large-scale model training, the extensive use of available datasets has resulted in significant computational inefficiencies. To tackle this issue, we explore methods…