10 papers
SKY-Piano: A Multimodal Piano Performance Dataset
Joonhyung Bae, Dawon Park, Taegyun Kwon +10
Music information retrieval research on piano performance increasingly involves diverse modalities of data and annotations beyond audio and MIDI. We present SKY-Piano, a multimodal…
PiAnnotate: A Web Annotation Tool for Piano Fingering, with a Diagnostic Probe
Joonhyung Bae, Kirak Kim, Hyeyoon Cho +8
Piano fingering shapes how a passage can be played, yet it is difficult to label after a performance. An annotator must decide which finger produced each note while reconciling the…
Tipiano: Cascaded Piano Hand Motion Synthesis via Fingertip Priors
Joonhyung Bae, Kirak Kim, Hyeyoon Cho +9
Synthesizing realistic piano hand motions requires both precision and naturalness. Physics-based methods achieve precision but produce stiff motions; data-driven models learn natur…
Amanous: Distribution-Switching for Superhuman Piano Density on Disklavier
Joonhyung Bae
A player piano can strike more keys, across more of the register, and faster than any pianist can reach. Three traditions dominate composition in that region, namely Nancarrow's te…
Designing a Multimodal Viewer for Piano Performance Analysis -- a Pedagogy-First Approach
Joonhyung Bae, Hyeyoon Cho, Kirak Kim +11
Abstract instructions in piano education, such as "raise your wrist" and "relax your tension," lead to varying interpretations among learners, preventing instructors from effective…
BioArtlas: Computational Clustering of Multi-Dimensional Complexity in Bioart
Joonhyung Bae
Bioart brings living material into artistic practice, where a single work can be at once an aesthetic object, a scientific instrument, and an ethical provocation. Traditional categ…
Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation
Junhyung Park, Yonghyun Kim, Joonhyung Bae +4
Piano performance is a multimodal activity that intrinsically combines physical actions with the acoustic rendition. Despite growing research interest in analyzing the multimodal n…
PianoVAM: A Multimodal Piano Performance Dataset
Yonghyun Kim, Junhyung Park, Joonhyung Bae +4
The multimodal nature of music performance has driven increasing interest in data beyond the audio domain within the music information retrieval (MIR) community. This paper introdu…
Immersive Fantasy Based on Digital Nostalgia: Environmental Narratives for the Korean Millennials and Gen Z
Yerin Doh, Joonhyung Bae
This study introduces the media artwork Dear Passenger, Please Wear a Mask, designed to offer a layered exploration of single-use mask waste, which escalated during the COVID-19 pa…
Thief of Truth: VR comics about the relationship between AI and humans
Joonhyung Bae
Thief of Truth is a first-person perspective Virtual Reality (VR) comic that explores the relationship between humans and artificial intelligence (AI). The work tells the story of…