From the 1 of 10 linked papers with an AI index.
10 papers
Multi-Task Multi-Frame Visual Piano Transcription
Yonghyun Kim, Hoyeol Sohn, Juhan Nam +1
Audio-based piano transcription performs well on onset, pitch, and velocity, but the sustain pedal lets sound persist long after key release, so audio systems predict pedal-extende…
SKY-Piano: A Multimodal Piano Performance Dataset
Joonhyung Bae, Dawon Park, Taegyun Kwon +10
The paper introduces SKY-Piano, a multimodal dataset of piano performances that includes audio, MIDI, multi-view video, hand and body motion capture, and MusicXML scores from profe…
PiAnnotate: A Web Annotation Tool for Piano Fingering, with a Diagnostic Probe
Joonhyung Bae, Kirak Kim, Hyeyoon Cho +8
Piano fingering shapes how a passage can be played, yet it is difficult to label after a performance. An annotator must decide which finger produced each note while reconciling the…
Tipiano: Cascaded Piano Hand Motion Synthesis via Fingertip Priors
Joonhyung Bae, Kirak Kim, Hyeyoon Cho +9
Synthesizing realistic piano hand motions requires both precision and naturalness. Physics-based methods achieve precision but produce stiff motions; data-driven models learn natur…
D3PIA: A Discrete Denoising Diffusion Model for Piano Accompaniment Generation From Lead sheet
Eunjin Choi, Hounsu Kim, Hayeon Bang +2
Generating piano accompaniments in the symbolic music domain is a challenging task that requires producing a complete piece of piano music from given melody and chord constraints,…
Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation
Junhyung Park, Yonghyun Kim, Joonhyung Bae +4
Piano performance is a multimodal activity that intrinsically combines physical actions with the acoustic rendition. Despite growing research interest in analyzing the multimodal n…