4 papers
DigitCode: Symbolic Tokenization of Hand Motion by Anatomical Units
Haoyu Gu, Haotian Lu, Jingrun Du +1
Hand motion carries the finest-grained information in human activity, yet the representations behind hand generation, understanding, and robot learning are overwhelmingly continuou…
BeatEdit: Symbolic Music Generation as Explicit Editing
Haoyu Gu, Lekai Qian, Haowu Zhou +2
Music creation is fundamentally a process of revision. Yet symbolic music generation remains dominated by paradigms that produce complete sequences from scratch, with limited suppo…
MindMelody: A Closed-Loop EEG-Driven System for Personalized Music Intervention
Yimeng Zhang, Yueru Sun, Haoyu Gu +1
Driven by the escalating global burden of mental health conditions, music-based interventions have attracted significant attention as a non-invasive, cost-effective modality for em…
EmoMM: Benchmarking and Steering MLLM for Multimodal Emotion Recognition under Conflict and Missingness
Yueru Sun, Yimeng Zhang, Haoyu Gu +5
Multimodal Emotion Recognition (MER) is critical for interpreting real-world interactions. While Multimodal Large Language Models (MLLM) have shown promise in MER, their internal d…