Learning Visual Affordance from Audio

Lidong Lu, Guo Chen, Zhu Wei +2

We introduce Audio-Visual Affordance Grounding (AV-AG), a new task that segments object interaction regions from action sounds. Unlike existing approaches that rely on textual inst…