5 papers
Designing a Multimodal Viewer for Piano Performance Analysis -- a Pedagogy-First Approach
Joonhyung Bae, Hyeyoon Cho, Kirak Kim +11
Abstract instructions in piano education, such as "raise your wrist" and "relax your tension," lead to varying interpretations among learners, preventing instructors from effective…
Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation
Junhyung Park, Yonghyun Kim, Joonhyung Bae +4
Piano performance is a multimodal activity that intrinsically combines physical actions with the acoustic rendition. Despite growing research interest in analyzing the multimodal n…
PianoVAM: A Multimodal Piano Performance Dataset
Yonghyun Kim, Junhyung Park, Joonhyung Bae +4
The multimodal nature of music performance has driven increasing interest in data beyond the audio domain within the music information retrieval (MIR) community. This paper introdu…
Immersive Fantasy Based on Digital Nostalgia: Environmental Narratives for the Korean Millennials and Gen Z
Yerin Doh, Joonhyung Bae
This study introduces the media artwork Dear Passenger, Please Wear a Mask, designed to offer a layered exploration of single-use mask waste, which escalated during the COVID-19 pa…
Thief of Truth: VR comics about the relationship between AI and humans
Joonhyung Bae
Thief of Truth is a first-person perspective Virtual Reality (VR) comic that explores the relationship between humans and artificial intelligence (AI). The work tells the story of…