activity
20242026
most citedA Survey on Music Generation from Single-Modal, Cross-Modal, and Multi-Modal Perspectives

1 citations · 1 across the 7 of their papers we have counts for

collaborators

8 papers

cs.HC2026

Diptych: Scoped, AI-Interpreted Comparison for Reference Listening in Music Production

Chongjun Zhong, Abhinaba Roy, Archishman Ghosh +2

Reference listening is a common strategy in music production, but current comparison tools often obscure a key human judgment: deciding what should be compared. We present Diptych,…

cs.SD2026

MusicLayout: Explicit Structural Planning for Controllable Text-to-Music Generation

Shuyu Li, Kejun Zhang, Jiahe Lei +5

Text-to-music generation has advanced rapidly, but current systems still rely primarily on global text prompts, leaving the structural organization of generated music implicit and…

cs.SD2026

RPPNet: Perceptually-Grouped Rhythm-Pitch Primitives for Long-Term Structure Melody Generation via Boundary-Aware Modeling

Tieyao Zhang, Yuke Liu, Jiaxing Yu +3

Existing symbolic music generation models typically use bars as the basic structural unit. However, human perception of musical phrases often does not align with notated bar lines,…

cs.SD2025

Diff-V2M: A Hierarchical Conditional Diffusion Model with Explicit Rhythmic Modeling for Video-to-Music Generation

Shulei Ji, Zihao Wang, Jiaxing Yu +4

Video-to-music (V2M) generation aims to create music that aligns with visual content. However, two main challenges persist in existing methods: (1) the lack of explicit rhythm mode…

cs.SD2025★ 1 cited

A Survey on Music Generation from Single-Modal, Cross-Modal, and Multi-Modal Perspectives

Shuyu Li, Shulei Ji, Zihao Wang +3

Multi-modal music generation, using multiple modalities like text, images, and video alongside musical scores and audio as guidance, is an emerging research area with broad applica…

eess.AS2024

SongGLM: Lyric-to-Melody Generation with 2D Alignment Encoding and Multi-Task Pre-Training

Jiaxing Yu, Xinda Wu, Yunfei Xu +4

Lyric-to-melody generation aims to automatically create melodies based on given lyrics, requiring the capture of complex and subtle correlations between them. However, previous wor…

cs.HC2024

ArchiTone: A LEGO-Inspired Gamified System for Visualized Music Education

Jiaxing Yu, Tieyao Zhang, Songruoyao Wu +4

Participation in music activities has many benefits, but often requires music theory knowledge and aural skills, which can be challenging for beginners. To help them engage more ea…

cs.HC2024

SoundScape: A Human-AI Co-Creation System Making Your Memories Heard

Chongjun Zhong, Jiaxing Yu, Yingping Cao +3

Sound plays a significant role in human memory, yet it is often overlooked by mainstream life-recording methods. Most current UGC (User-Generated Content) creation tools emphasize…