8 papers
Toward Part-Aware Choral Transcription with singing voice assignment
Hanyu Meng, Zhanhong He, Zixun Guo +1
Single-instrument automatic music transcription (AMT) has advanced substantially, yet choral applications require soprano, alto, tenor, and bass (SATB) to be transcribed as separat…
Controllable Crowd Generation through World-Model Planning
JunGyu Lee, Jisu Shin, Seunghyun Shin +1
Crowd simulation plays a central role in robot navigation, autonomous driving, and urban planning. For these applications, realistic simulation requires crowds to adapt their behav…
Beyond Piano: Cross-Instrument MIDI Velocity Estimation via Differentiable SoundFont Proxies
Zhanhong He, Hanyu Meng, David Defeng Huang +1
Many music datasets contain MIDI notes but lack reliable velocities, defaulting to a constant value. This absence is especially problematic outside the piano domain, as velocity is…
Joint Estimation of Piano Dynamics and Metrical Structure with a Multi-task Multi-Scale Network
Zhanhong He, Hanyu Meng, David Huang +1
Estimating piano dynamic from audio recordings is a fundamental challenge in computational music analysis. In this paper, we propose an efficient multi-task network that jointly pr…
Filling MIDI Velocity using U-Net Image Colorizer
Zhanhong He, David Cooper, Defeng Huang +1
Modern music producers commonly use MIDI (Musical Instrument Digital Interface) to store their musical compositions. However, MIDI files created with digital software may lack the…
Score-Informed Transformer for Refining MIDI Velocity in Automatic Music Transcription
Zhanhong He, Roberto Togneri, David Huang
MIDI velocity is crucial for capturing expressive dynamics in human performances. In practical scenarios, a music score with inaccurate velocities may be available alongside the pe…
Music Tempo Estimation on Solo Instrumental Performance
Zhanhong He, Roberto Togneri, Xiangyu Zhang
Recently, automatic music transcription has made it possible to convert musical audio into accurate MIDI. However, the resulting MIDI lacks music notations such as tempo, which hin…
End-to-End Lyrics Recognition with Self-supervised Learning
Xiangyu Zhang, Shuyue Stella Li, Zhanhong He +2
Lyrics recognition is an important task in music processing. Despite traditional algorithms such as the hybrid HMM- TDNN model achieving good performance, studies on applying end-t…