5 citations · 6 across the 5 of their papers we have counts for
5 papers
MuMu-LLaMA: Multi-modal Music Understanding and Generation via Large Language Models
Shansong Liu, Atin Sakkeer Hussain, Qilong Wu +2
Research on large language models has advanced significantly across text, speech, images, and videos. However, multi-modal music understanding and generation remain underexplored d…
Editing Music with Melody and Text: Using ControlNet for Diffusion Transformer
Siyuan Hou, Shansong Liu, Ruibin Yuan +4
Despite the significant progress in controllable music generation and editing, challenges remain in the quality and length of generated music due to the use of Mel-spectrogram repr…
MUGen: Multi-modal Music Understanding and Generation with the Power of Large Language Models
Shansong Liu, Atin Sakkeer Hussain, Qilong Wu +2
The current landscape of research leveraging large language models (LLMs) is experiencing a surge. Many works harness the powerful reasoning capabilities of these models to compreh…
HumTrans: A Novel Open-Source Dataset for Humming Melody Transcription and Beyond
Shansong Liu, Xu Li, Dian Li +1
This paper introduces the HumTrans dataset, which is publicly available and primarily designed for humming melody transcription. The dataset can also serve as a foundation for down…
Unified Pretraining Target Based Video-music Retrieval With Music Rhythm And Video Optical Flow Information
Tianjun Mao, Shansong Liu, Yunxuan Zhang +2
Background music (BGM) can enhance the video's emotion. However, selecting an appropriate BGM often requires domain knowledge. This has led to the development of video-music retrie…