32 citations · 65 across the 10 of their papers we have counts for
4 papers · 1 filter
Egocentric Deep Multi-Channel Audio-Visual Active Speaker Localization
Hao Jiang, Calvin Murdock, Vamsi Krishna Ithapu
Augmented reality devices have the potential to enhance human perception and enable other assistive functionalities in complex conversational environments. Effectively capturing th…
Egocentric Pose Estimation from Human Vision Span
Hao Jiang, Vamsi Krishna Ithapu
Estimating camera wearer's body pose from an egocentric view (egopose) is a vital task in augmented and virtual reality. Existing approaches either use a narrow field of view front…
Audio-Visual Floorplan Reconstruction
Senthil Purushwalkam, Sebastian Vicenc Amengual Gari, Vamsi Krishna Ithapu +4
Given only a few glimpses of an environment, how much can we infer about its entire floorplan? Existing methods can map only what is visible or immediately apparent from context, a…
SoundSpaces: Audio-Visual Navigation in 3D Environments
Changan Chen, Unnat Jain, Carl Schissler +5
Moving around in the world is naturally a multisensory experience, but today's embodied agents are deaf---restricted to solely their visual perception of the environment. We introd…