activity
20242026
most citedFoundation Models for Music: A Survey

8 citations · 18 across the 25 of their papers we have counts for

collaborators
Showing eess.ASShow all

8 papers · 1 filter

eess.AS2026

High-Fidelity Song Generation with Joint Discrete and Continuous Modeling

Zheqi Dai, Zhiyue Wu, Ruibin Yuan +5

Generating a full song from lyrics and a style description requires long-range musical planning without sacrificing vocal and instrumental detail. Low-rate discrete semantic tokens…

eess.AS2026

HMU-Bench: Hierarchical Music Understanding Benchmark for Omni Models

Zheqi Dai, Boyang Wang, Zhiyue Wu +6

Music-understanding benchmarks should identify both the evidence available to a model and the operations a correct answer requires. We introduce HMU-Bench, a bilingual benchmark wi…

eess.AS2026

YuE2: Unifying Symbolic and Audio Music Generation at Frontier Quality

Ruibin Yuan, Jiahao Pan, Junyan Jiang +32

Symbolic models make melody, harmony, rhythm, and form explicit but typically stop before a finished recording; audio models produce complete songs while leaving composition implic…

eess.AS2026

StepAudio 3 Music Technical Report

Chengli Feng, Zhiyue Wu, Jiahao Song +10

We introduce StepAudio 3 Music, a large-scale, long-form music generation model that supports explicit musical planning and open-domain text-controlled generation. The StepAudio Mu…

eess.AS2025

SongFormer: Scaling Music Structure Analysis with Heterogeneous Supervision

Chunbo Hao, Ruibin Yuan, Jixun Yao +5

Music structure analysis (MSA) underpins music understanding and controllable generation, yet progress has been limited by small, inconsistent corpora. We present SongFormer, a sca…

eess.AS2025

SongEval: A Benchmark Dataset for Song Aesthetics Evaluation

Jixun Yao, Guobin Ma, Huixin Xue +9

Aesthetics serve as an implicit and important criterion in song generation tasks that reflect human perception beyond objective metrics. However, evaluating the aesthetics of gener…

eess.AS2025★ 1 cited

YuE: Scaling Open Foundation Models for Long-Form Music Generation

Ruibin Yuan, Hanfeng Lin, Shuyue Guo +55

We tackle the task of long-form music generation--particularly the challenging \textbf{lyrics-to-song} problem--by introducing YuE, a family of open foundation models based on the…

eess.AS2024

Editing Music with Melody and Text: Using ControlNet for Diffusion Transformer

Siyuan Hou, Shansong Liu, Ruibin Yuan +4

Despite the significant progress in controllable music generation and editing, challenges remain in the quality and length of generated music due to the use of Mel-spectrogram repr…