8 citations · 10 across the 13 of their papers we have counts for
13 papers
Note-Level Temporal Grounding of Musical Concepts in Large Audio-Language Models
Kun Fang, Ziyu Wang, Ichiro Fujinaga
Large audio-language models (LALMs) demonstrate growing music-understanding capabilities, but whether their responses are grounded in acoustic evidence remains unclear. Musical lan…
Learning Music Style for Piano Arrangement Through Cross-Modal Bootstrapping
Jingwei Zhao, Gus Xia, Ziyu Wang +1
What is music style? Though often described using text labels such as "swing," "classical," or "emotional," the real style remains implicit and hidden in concrete music examples. I…
Music-JEPA: Learning a World Model of Sound from Action
Ziyu Wang, Kun Fang, Yann LeCun
Joint Embedding Predictive Architectures (JEPA) have recently emerged as a paradigm for learning world models by predicting latent representations, offering a promising direction f…
Real-Time Language Model Jamming: A Case Study for Live Music Accompaniment Generation
Bowen Zheng, Andrew H. Yang, Jiaqi Ruan +5
Language models (LMs) have become one of the most prominent paradigms in modern generative modeling. While making them faster has been the main focus of real-time deployment, speed…
BEAT: Tokenizing and Generating Symbolic Music by Uniform Temporal Steps
Lekai Qian, Haoyu Gu, Jingwei Zhao +1
Tokenizing music to fit the general framework of language models is a compelling challenge, especially considering the diverse symbolic structures in which music can be represented…
ViTex: Visual Texture Control for Multi-Track Symbolic Music Generation via Discrete Diffusion Models
Xiaoyu Yi, Qi He, Gus Xia +1
In automatic music generation, a central challenge is to design controls that enable meaningful human-machine interaction. Existing systems often rely on extrinsic inputs such as t…
TOMI: Transforming and Organizing Music Ideas for Multi-Track Compositions with Full-Song Structure
Qi He, Gus Xia, Ziyu Wang
Hierarchical planning is a powerful approach to model long sequences structurally. Aside from considering hierarchies in the temporal structure of music, this paper explores an eve…
Exploring GPT's Ability as a Judge in Music Understanding
Kun Fang, Ziyu Wang, Gus Xia +1
Recent progress in text-based Large Language Models (LLMs) and their extended ability to process multi-modal sensory data have led us to explore their applicability in addressing m…
Foundation Models for Music: A Survey
Yinghao Ma, Anders Øland, Anton Ragni +39
In recent years, foundation models (FMs) such as large language models (LLMs) and latent diffusion models (LDMs) have profoundly impacted diverse sectors, including music. This com…
Unifying Symbolic Music Arrangement: Track-Aware Reconstruction and Structured Tokenization
Longshen Ou, Jingwei Zhao, Ziyu Wang +3
We present a unified framework for automatic multitrack music arrangement that enables a single pre-trained symbolic music model to handle diverse arrangement scenarios, including…
Unsupervised Disentanglement of Content and Style via Variance-Invariance Constraints
Yuxuan Wu, Ziyu Wang, Bhiksha Raj +1
We contribute an unsupervised method that effectively learns disentangled content and style representations from sequences of observations. Unlike most disentanglement algorithms t…
Whole-Song Hierarchical Generation of Symbolic Music Using Cascaded Diffusion Models
Ziyu Wang, Lejun Min, Gus Xia
Recent deep music generation studies have put much emphasis on long-term generation with structures. However, we are yet to see high-quality, well-structured whole-song generation.…
Structured Multi-Track Accompaniment Arrangement via Style Prior Modelling
Jingwei Zhao, Gus Xia, Ziyu Wang +1
In the realm of music AI, arranging rich and structured multi-track accompaniments from a simple lead sheet presents significant challenges. Such challenges include maintaining tra…