2 citations · 2 across the 8 of their papers we have counts for
8 papers
MAJEPPA: Morphing and Assessing in a Unified Piano Performance Space
Jinwen Zhou, Huan Zhang, Weixi Zhai +3
We present MAJEPPA, a self-supervised framework to learn piano performance representations that span the full skill spectrum, from beginner practice sessions to virtuoso concert re…
EmoHeal: An End-to-End System for Personalized Therapeutic Music Retrieval from Fine-grained Emotions
Xinchen Wan, Jinhua Liang, Huan Zhang
Existing digital mental wellness tools often overlook the nuanced emotional states underlying everyday challenges. For example, pre-sleep anxiety affects more than 1.5 billion peop…
Emotion-Aware Speech Generation with Character-Specific Voices for Comics
Zhiwen Qian, Jinhua Liang, Huan Zhang
This paper presents an end-to-end pipeline for generating character-specific, emotion-aware speech from comics. The proposed system takes full comic volumes as input and produces s…
Hierarchical Symbolic Pop Music Generation with Graph Neural Networks
Wen Qing Lim, Jinhua Liang, Huan Zhang
Music is inherently made up of complex structures, and representing them as graphs helps to capture multiple levels of relationships. While music generation has been explored using…
Bridging Paintings and Music -- Exploring Emotion based Music Generation through Paintings
Tanisha Hisariya, Huan Zhang, Jinhua Liang
Rapid advancements in artificial intelligence have significantly enhanced generative tasks involving music and images, employing both unimodal and multimodal approaches. This resea…
Bridging Discrete and Continuous: A Multimodal Strategy for Complex Emotion Detection
Jiehui Jia, Huan Zhang, Jinhua Liang
In the domain of human-computer interaction, accurately recognizing and interpreting human emotions is crucial yet challenging due to the complexity and subtlety of emotional expre…
From Audio Encoders to Piano Judges: Benchmarking Performance Understanding for Solo Piano
Huan Zhang, Jinhua Liang, Simon Dixon
Our study investigates an approach for understanding musical performances through the lens of audio encoding models, focusing on the domain of solo Western classical piano music. C…
DExter: Learning and Controlling Performance Expression with Diffusion Models
Huan Zhang, Shreyan Chowdhury, Carlos Eduardo Cancino-Chacón +3
In the pursuit of developing expressive music performance models using artificial intelligence, this paper introduces DExter, a new approach leveraging diffusion probabilistic mode…