10 papers
Toward Part-Aware Choral Transcription with singing voice assignment
Hanyu Meng, Zhanhong He, Zixun Guo +1
Single-instrument automatic music transcription (AMT) has advanced substantially, yet choral applications require soprano, alto, tenor, and bass (SATB) to be transcribed as separat…
Controllable Crowd Generation through World-Model Planning
JunGyu Lee, Jisu Shin, Seunghyun Shin +1
Crowd simulation plays a central role in robot navigation, autonomous driving, and urban planning. For these applications, realistic simulation requires crowds to adapt their behav…
Beyond Piano: Cross-Instrument MIDI Velocity Estimation via Differentiable SoundFont Proxies
Zhanhong He, Hanyu Meng, David Defeng Huang +1
Many music datasets contain MIDI notes but lack reliable velocities, defaulting to a constant value. This absence is especially problematic outside the piano domain, as velocity is…
BiEAR: A Human Auditory-Inspired Adaptive Binaural Front-end for Multi-Speaker Localisation and Distance Estimation
Hanyu Meng, Eliathamby Ambikairajah, Vidhyasaharan Sethu +2
We present BiEAR, a human auditory-inspired adaptive binaural front-end for multi-speaker localisation and distance estimation. Inspired by medial olivocochlear (MOC) feedback in h…
Variable-Length Audio Fingerprinting
Hongjie Chen, Hanyu Meng, Huimin Zeng +3
Audio fingerprinting converts audio to much lower-dimensional representations, allowing distorted recordings to still be recognized as their originals through similar fingerprints.…
Adaptive Per-Channel Energy Normalization Front-end for Robust Audio Signal Processing
Hanyu Meng, Vidhyasaharan Sethu, Eliathamby Ambikairajah +2
In audio signal processing, learnable front-ends have shown strong performance across diverse tasks by optimizing task-specific representation. However, their parameters remain fix…
Joint Estimation of Piano Dynamics and Metrical Structure with a Multi-task Multi-Scale Network
Zhanhong He, Hanyu Meng, David Huang +1
Estimating piano dynamic from audio recordings is a fundamental challenge in computational music analysis. In this paper, we propose an efficient multi-task network that jointly pr…
Blind Estimation of Sub-band Acoustic Parameters from Ambisonics Recordings using Spectro-Spatial Covariance Features
Hanyu Meng, Jeroen Breebaart, Jeremy Stoddard +2
Estimating frequency-varying acoustic parameters is essential for enhancing immersive perception in realistic spatial audio creation. In this paper, we propose a unified framework…
Binaural Selective Attention Model for Target Speaker Extraction
Hanyu Meng, Qiquan Zhang, Xiangyu Zhang +2
The remarkable ability of humans to selectively focus on a target speaker in cocktail party scenarios is facilitated by binaural audio processing. In this paper, we present a binau…
Speaking in Wavelet Domain: A Simple and Efficient Approach to Speed up Speech Diffusion Model
Xiangyu Zhang, Daijiao Liu, Hexin Liu +5
Recently, Denoising Diffusion Probabilistic Models (DDPMs) have attained leading performances across a diverse range of generative tasks. However, in the field of speech synthesis,…