9 papers
FOAdapter: A Plug-and-Play Spatial Tokenizer for Low-Bitrate FOA Speech Coding
Kirak Kim, Yoonjeong Park, Juhan Nam +2
Spatially encoded speech conveys not only linguistic information but also spatial cues. This enables listeners to distinguish and localize speakers, contributing to more natural an…
Does Persona Make LLMs K-pop Fans? A Pilot Study of LLM-Based Online Concert Audience Agents
Kirak Kim, Hyojin Kim, Yejin Son +2
A concert is a collective experience, but recorded performance videos are typically watched alone, stripping away the shared audience presence that makes concerts feel eventful. We…
PiAnnotate: A Web Annotation Tool for Piano Fingering, with a Diagnostic Probe
Joonhyung Bae, Kirak Kim, Hyeyoon Cho +8
Piano fingering shapes how a passage can be played, yet it is difficult to label after a performance. An annotator must decide which finger produced each note while reconciling the…
Tipiano: Cascaded Piano Hand Motion Synthesis via Fingertip Priors
Joonhyung Bae, Kirak Kim, Hyeyoon Cho +9
Synthesizing realistic piano hand motions requires both precision and naturalness. Physics-based methods achieve precision but produce stiff motions; data-driven models learn natur…
Adapting a Text-to-Audio Model for Room Impulse Response Generation
Kirak Kim, Sungyoung Kim
Room Impulse Responses (RIRs) enable realistic acoustic simulation, with applications ranging from multimedia production to speech data augmentation. However, acquiring high-qualit…
Designing a Multimodal Viewer for Piano Performance Analysis -- a Pedagogy-First Approach
Joonhyung Bae, Hyeyoon Cho, Kirak Kim +11
Abstract instructions in piano education, such as "raise your wrist" and "relax your tension," lead to varying interpretations among learners, preventing instructors from effective…
Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation
Junhyung Park, Yonghyun Kim, Joonhyung Bae +4
Piano performance is a multimodal activity that intrinsically combines physical actions with the acoustic rendition. Despite growing research interest in analyzing the multimodal n…
PianoVAM: A Multimodal Piano Performance Dataset
Yonghyun Kim, Junhyung Park, Joonhyung Bae +4
The multimodal nature of music performance has driven increasing interest in data beyond the audio domain within the music information retrieval (MIR) community. This paper introdu…
The Hall of Singularity: VR Experience of Prophecy by AI
Jisu Kim, Kirak Kim
"The Hall of Singularity" is an immersive art that creates personalized experiences of receiving prophecies from an AI deity through an integration of Artificial Intelligence (AI)…