18 citations · 31 across the 11 of their papers we have counts for
13 papers
Self-Supervised Object-Centric Representation for Multi-Task Audio Analysis
Parthasaarathy Sudarsanam, Tuomas Virtanen
This paper studies the capability of an object-centric audio representation to support multiple downstream tasks within a unified framework. The object-centric model is trained in…
AVPS-360: A Spatial Audio-Visual Benchmark for Instance Segmentation and Tracking of Sound-Producing Persons
Yifu Sun, Parthasaarathy Sudarsanam, Tuomas Virtanen +1
Audio-visual instance segmentation (AVIS) segments and tracks individual sound-producing objects in videos. Existing benchmarks predominantly use monaural audio, which lacks inter-…
Speaker head orientation estimation with a single microphone array using phase spectrogram features
Balint Turi, Archontis Politis, Parthasaarathy Sudarsanam +1
Estimating a speaker's head orientation from audio can provide valuable information in smart environments, meetings, and driver monitoring. We propose a novel approach that leverag…
CNN Models for Microphone Array Covariance Matrix Upsampling and Acoustic Imaging
Marianthi Adamopoulou, Parthasaarathy Sudarsanam, David Diaz-Guerra +5
Acoustic imaging visualization is a core methodology in acoustics, enabling spatial analysis of sound sources and acoustic scenes. However, limited sensor availability in practical…
FOA Tokenizer: Low-bitrate Neural Codec for First Order Ambisonics with Spatial Consistency Loss
Parthasaarathy Sudarsanam, Sebastian Braun, Hannes Gamper
Neural audio codecs have been widely studied for mono and stereo signals, but spatial audio remains largely unexplored. We present the first discrete neural spatial audio codec for…
Stereo Sound Event Localization and Detection with Onscreen/offscreen Classification
Kazuki Shimada, Archontis Politis, Iran R. Roman +10
This paper presents the objective, dataset, baseline, and metrics of Task 3 of the DCASE2025 Challenge on sound event localization and detection (SELD). In previous editions, the c…
Towards Spatial Audio Understanding via Question Answering
Parthasaarathy Sudarsanam, Archontis Politis
In this paper, we introduce a novel framework for spatial audio understanding of first-order ambisonic (FOA) signals through a question answering (QA) paradigm, aiming to extend th…
Representation Learning for Semantic Alignment of Language, Audio, and Visual Modalities
Parthasaarathy Sudarsanam, Irene Martín-Morató, Tuomas Virtanen
This paper proposes a single-stage training approach that semantically aligns three modalities - audio, visual, and text using a contrastive learning framework. Contrastive trainin…
STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events
Kazuki Shimada, Archontis Politis, Parthasaarathy Sudarsanam +9
While direction of arrival (DOA) of sound events is generally estimated from multichannel audio data recorded in a microphone array, sound events usually derive from visually perce…
Attention-Based Methods For Audio Question Answering
Parthasaarathy Sudarsanam, Tuomas Virtanen
Audio question answering (AQA) is the task of producing natural language answers when a system is provided with audio and natural language questions. In this paper, we propose neur…
STARSS22: A dataset of spatial recordings of real scenes with spatiotemporal annotations of sound events
Archontis Politis, Kazuki Shimada, Parthasaarathy Sudarsanam +7
This report presents the Sony-TAu Realistic Spatial Soundscapes 2022 (STARS22) dataset for sound event localization and detection, comprised of spatial recordings of real scenes co…
Clotho-AQA: A Crowdsourced Dataset for Audio Question Answering
Samuel Lipping, Parthasaarathy Sudarsanam, Konstantinos Drossos +1
Audio question answering (AQA) is a multimodal translation task where a system analyzes an audio signal and a natural language question, to generate a desirable natural language an…
Assessment of Self-Attention on Learned Features For Sound Event Localization and Detection
Parthasaarathy Sudarsanam, Archontis Politis, Konstantinos Drossos
Joint sound event localization and detection (SELD) is an emerging audio signal processing task adding spatial dimensions to acoustic scene analysis and sound event detection. A po…