5 papers
Vision-Based Multimodal Interfaces: A Survey and Taxonomy for Enhanced Context-Aware System Design
Yongquan 'Owen' Hu, Jingyu Tang, Xinya Gong +6
The recent surge in artificial intelligence, particularly in multimodal processing technology, has advanced human-computer interaction, by altering how intelligent systems perceive…
Exploring Device-Oriented Video Encryption for Hierarchical Privacy Protection in AR Content Sharing
Yongquan Hu, Dongsheng Zheng, Kexin Nie +3
Content sharing across multiple Augmented Reality (AR) displays is becoming commonplace, enhancing team communication and collaboration through devices like smartphones and AR glas…
Towards Enhanced Context Awareness with Vision-based Multimodal Interfaces
Yongquan Hu, Wen Hu, Aaron Quigley
Vision-based Interfaces (VIs) are pivotal in advancing Human-Computer Interaction (HCI), particularly in enhancing context awareness. However, there are significant opportunities f…
Exploring Large-Scale Language Models to Evaluate EEG-Based Multimodal Data for Mental Health
Yongquan Hu, Shuning Zhang, Ting Dang +4
Integrating physiological signals such as electroencephalogram (EEG), with other data such as interview audio, may offer valuable multimodal insights into psychological states or n…
MultiSurf-GPT: Facilitating Context-Aware Reasoning with Large-Scale Language Models for Multimodal Surface Sensing
Yongquan Hu, Black Sun, Pengcheng An +3
Surface sensing is widely employed in health diagnostics, manufacturing and safety monitoring. Advances in mobile sensing affords this potential for context awareness in mobile com…