2 citations · 3 across the 14 of their papers we have counts for
16 papers
UniForge3D: Joint 3D Reconstruction and Generation in a Shared Anchor-Guided Space
Wenjue Chen, Wenyue Chen, Heliang Zheng +3
Generating complete 3D assets from sparse, unposed images requires preserving observed geometry while completing unseen regions. Joint reconstruction and generation offers a way to…
Transfer Learning for Rhythm Game Chart Generation from Music Transcription and Across Games
Sojeong An, Nathan Pruyne, Chris Donahue +1
Rhythm games ask the player to act in time with a recording, following a chart: a sequence of actions, each with a time and, depending on the game, a lane, type, or playfield posit…
UniVerse: Benchmarking and Enhancing LALMs on Culturally Inclusive Low-Resource Music Understanding
Ziya Zhou, Shangda Wu, Shenyang Xu +16
Recent advances in large audio-language models (LALMs) have significantly improved performance in tasks such as music captioning, genre classification, and sound event detection. H…
Measuring Cross-Cultural Style Diffusion Through Era Classification: US and Korean Popular Music
Dasol Lee, Minhee Lee, Seonguk Ju +3
Popular music circulates globally while being locally reinterpreted, yet this process of cross-cultural style diffusion has rarely been quantified. We propose an era-classification…
Pitch Contour Tokenization using VQ-VAE and Its Application on Korean Traditional Music Analysis
Seonguk Ju, Seola Cho, Sooin Chung +2
Computational analysis of music often relies on discrete representations, yet many musical traditions are organized around continuous pitch movement that resists segmentation into…
A Dataset and Benchmark for Optical Music Recognition of String Quartet Scores
Dongmin Kim, Brian Liu, Jose J. Valero-Mas +1
Optical music recognition (OMR) transcribes music scores into digital formats. While the field has advanced significantly on monophonic and piano-form scores, multi-part score tran…
Frame-Level Pansori Mode Classification with Complementary Audio Representations
Sangheon Park, Seonguk Ju, Suin Chung +2
Pansori is a traditional Korean vocal genre whose mode system (jo) is defined not by scale alone but by the entanglement of pitch collection, microtonal ornament (sigimsae), and vo…
Local Multimodal Music Alignment from Global Supervision
Irmak Bukey, Zachary Novack, Jongmin Jung +2
Understanding music requires understanding localized relationships across data modalities, e.g., how time in performance audio maps onto position in a score image. Yet supervision…
Unified Cross-modal Translation of Score Images, Symbolic Music, and Performance Audio
Jongmin Jung, Dongmin Kim, Sihun Lee +5
Music exists in various modalities, such as score images, symbolic scores, MIDI, and audio. Translations between each modality are established as core tasks of music information re…
LAV: Audio-Driven Dynamic Visual Generation with Neural Compression and StyleGAN2
Jongmin Jung, Dasaem Jeong
This paper introduces LAV (Latent Audio-Visual), a system that integrates EnCodec's neural audio compression with StyleGAN2's generative capabilities to produce visually dynamic ou…
Boundary Regression for Leitmotif Detection in Music Audio
Sihun Lee, Dasaem Jeong
Leitmotifs are musical phrases that are reprised in various forms throughout a piece. Due to diverse variations and instrumentation, detecting the occurrence of leitmotifs from aud…
MusicGen-Chord: Advancing Music Generation through Chord Progressions and Interactive Web-UI
Jongmin Jung, Andreas Jansson, Dasaem Jeong
MusicGen is a music generation language model (LM) that can be conditioned on textual descriptions and melodic features. We introduce MusicGen-Chord, which extends this capability…
Towards Computational Analysis of Pansori Singing
Sangheon Park, Danbinaerin Han, Dasaem Jeong
Pansori is one of the most representative vocal genres of Korean traditional music, which has an elaborated vocal melody line with strong vibrato. Although the music is transmitted…
ViolinDiff: Enhancing Expressive Violin Synthesis with Pitch Bend Conditioning
Daewoong Kim, Hao-Wen Dong, Dasaem Jeong
Modeling the natural contour of fundamental frequency (F0) plays a critical role in music audio synthesis. However, transcribing and managing multiple F0 contours in polyphonic mus…
Six Dragons Fly Again: Reviving 15th-Century Korean Court Music with Transformers and Novel Encoding
Danbinaerin Han, Mark Gotham, Dongmin Kim +3
We introduce a project that revives a piece of 15th-century Korean court music, Chihwapyeong and Chwipunghyeong, composed upon the poem Songs of the Dragon Flying to Heaven. One of…
Nested Music Transformer: Sequentially Decoding Compound Tokens in Symbolic Music and Audio Generation
HaeJun Yoo, Hao-Wen Dong, Jongmin Jung +1
Representing symbolic music with compound tokens, where each token consists of several different sub-tokens representing a distinct musical feature or attribute, offers the advanta…