9 papers
CONFER: Conflict-Aware Evidence Negotiation for Regime-Calibrated Weak Supervision in Multimodal Emotion Recognition
Bojing Hou, Ruohao Li, Yitong Zhu +2
Multimodal emotion recognition often treats self-reported labels as reliable supervision while overlooking self-report unreliability and cross-modal conflict. We propose \textbf{CO…
BioKD: Selective Physiology-to-Video Knowledge Distillation via Reliability Gate for Emotion Recognition
Bojing Hou, Ruohao Li, Yitong Zhu +3
To address the limitations of video-based emotion recognition under ambiguous or socially masked behavioral cues, as well as the poor deployability of physiological signals, this p…
QA-MoE: Towards a Continuous Reliability Spectrum with Quality-Aware Mixture of Experts for Robust Multimodal Sentiment Analysis
Yitong Zhu, Yuxuan Jiang, Guanxuan Jiang +4
Multimodal Sentiment Analysis (MSA) aims to infer human sentiment from textual, acoustic, and visual signals. In real-world scenarios, however, multimodal inputs are often compromi…
From Adaptation to Intelligence: A Systematic Review of Data, Strategies, and Impact in Personalized VR
Tangyao Li, Yitong Zhu, Hai-Ning Liang +1
As virtual reality (VR) systems advance, they are increasingly expected to adapt intelligently to individual users' states, abilities, and preferences. While prior research has exa…
Hierarchical MoE: Continuous Multimodal Emotion Recognition with Incomplete and Asynchronous Inputs
Yitong Zhu, Lei Han, Guanxuan Jiang +2
Multimodal emotion recognition (MER) is crucial for human-computer interaction, yet real-world challenges like dynamic modality incompleteness and asynchrony severely limit its rob…
Flow-Aware Diffusion for Real-Time VR Restoration: Enhancing Spatiotemporal Coherence and Efficiency
Yitong Zhu, Qianghong Dong, Guanxuan Jiang +2
Cybersickness remains a critical barrier to the widespread adoption of Virtual Reality (VR), particularly in scenarios involving intense or artificial motion cues. Among the key co…
A comparative study of sensory encoding models for human navigation in virtual reality
Tangyao Li, Qiyuan Zhan, Yitong Zhu +2
In virtual reality applications, users often navigate through virtual environments, but the issue of physiological responses, such as cybersickness, fatigue, and cognitive workload…
Balancing Exploration and Cybersickness: Investigating Curiosity-Driven Behavior in Virtual Environments
Tangyao Li, Yuyang Wang
During virtual navigation, users exhibit varied interaction and navigation behaviors influenced by several factors. Existing theories and models have been developed to explain and…
Towards Consumer-Grade Cybersickness Prediction: Multi-Model Alignment for Real-Time Vision-Only Inference
Yitong Zhu, Zhuowen Liang, Yiming Wu +2
Cybersickness remains a major obstacle to the widespread adoption of immersive virtual reality (VR), particularly in consumer-grade environments. While prior methods rely on invasi…