52 citations · 333 across the 67 of their papers we have counts for
9 papers · 1 filter
Vis2Mus: Exploring Multimodal Representation Mapping for Controllable Music Generation
Runbang Zhang, Yixiao Zhang, Kai Shao +2
In this study, we explore the representation mapping from the domain of visual arts to the domain of music, with which we can use visual arts as an effective handle to control musi…
Modeling Perceptual Loudness of Piano Tone: Theory and Applications
Yang Qu, Yutian Qin, Lecheng Chao +3
The relationship between perceptual loudness and physical attributes of sound is an important subject in both computer music and psychoacoustics. Early studies of "equal-loudness c…
Learning Hierarchical Metrical Structure Beyond Measures
Junyan Jiang, Daniel Chin, Yixiao Zhang +1
Music contains hierarchical structures beyond beats and measures. While hierarchical structure annotations are helpful for music information retrieval and computer musicology, such…
Domain Adversarial Training on Conditional Variational Auto-Encoder for Controllable Music Generation
Jingwei Zhao, Gus Xia, Ye Wang
The variational auto-encoder has become a leading framework for symbolic music generation, and a popular research direction is to study how to effectively control the generation pr…
Beat Transformer: Demixed Beat and Downbeat Tracking with Dilated Self-Attention
Jingwei Zhao, Gus Xia, Ye Wang
We propose Beat Transformer, a novel Transformer encoder architecture for joint beat and downbeat tracking. Different from previous models that track beats solely based on the spec…
AccoMontage2: A Complete Harmonization and Accompaniment Arrangement System
Li Yi, Haochen Hu, Jingwei Zhao +1
We propose AccoMontage2, a system capable of doing full-length song harmonization and accompaniment arrangement based on a lead melody. Following AccoMontage, this study focuses on…
Interpreting Song Lyrics with an Audio-Informed Pre-trained Language Model
Yixiao Zhang, Junyan Jiang, Gus Xia +1
Lyric interpretations can help people understand songs and their lyrics quickly, and can also make it easier to manage, retrieve and discover songs efficiently from the growing mas…
Learning long-term music representations via hierarchical contextual constraints
Shiqi Wei, Gus Xia
Learning symbolic music representations, especially disentangled representations with probabilistic interpretations, has been shown to benefit both music understanding and generati…
Sensing the Breath: A Multimodal Singing Tutoring Interface with Breath Guidance
Ziyue Piao, Gus Xia
Breath is a significant component in singing performance, which is still underresearched in most singing-related music interfaces. In this paper, we present a multimodal system tha…