Hear to See: Discerning Stateful Listening for Audio-Visual Instance Segmentation

Leiye Liu, Miao Zhang, Jiahong Jiang +7

Audio-visual instance segmentation (AVIS) requires accurately identifying and tracking individual sounding objects with pixel-level masks. Existing methods struggle to match overla…