8 papers
MAJEPPA: Morphing and Assessing in a Unified Piano Performance Space
Jinwen Zhou, Huan Zhang, Weixi Zhai +3
We present MAJEPPA, a self-supervised framework to learn piano performance representations that span the full skill spectrum, from beginner practice sessions to virtuoso concert re…
EmoHeal: An End-to-End System for Personalized Therapeutic Music Retrieval from Fine-grained Emotions
Xinchen Wan, Jinhua Liang, Huan Zhang
Existing digital mental wellness tools often overlook the nuanced emotional states underlying everyday challenges. For example, pre-sleep anxiety affects more than 1.5 billion peop…
Emotion-Aware Speech Generation with Character-Specific Voices for Comics
Zhiwen Qian, Jinhua Liang, Huan Zhang
This paper presents an end-to-end pipeline for generating character-specific, emotion-aware speech from comics. The proposed system takes full comic volumes as input and produces s…
Bridging Discrete and Continuous: A Multimodal Strategy for Complex Emotion Detection
Jiehui Jia, Huan Zhang, Jinhua Liang
In the domain of human-computer interaction, accurately recognizing and interpreting human emotions is crucial yet challenging due to the complexity and subtlety of emotional expre…
Hierarchical Symbolic Pop Music Generation with Graph Neural Networks
Wen Qing Lim, Jinhua Liang, Huan Zhang
Music is inherently made up of complex structures, and representing them as graphs helps to capture multiple levels of relationships. While music generation has been explored using…
Bridging Paintings and Music -- Exploring Emotion based Music Generation through Paintings
Tanisha Hisariya, Huan Zhang, Jinhua Liang
Rapid advancements in artificial intelligence have significantly enhanced generative tasks involving music and images, employing both unimodal and multimodal approaches. This resea…