7 papers
SpeechAgent: An End-to-End Mobile Infrastructure for Speech Impairment Assistance
Haowei Lou, Chengkai Huang, Hye-young Paik +4
Speech is essential for human communication, yet millions of people face impairments such as dysarthria, stuttering, and aphasia conditions that often lead to social isolation and…
Vision-Based Multimodal Interfaces: A Survey and Taxonomy for Enhanced Context-Aware System Design
Yongquan 'Owen' Hu, Jingyu Tang, Xinya Gong +6
The recent surge in artificial intelligence, particularly in multimodal processing technology, has advanced human-computer interaction, by altering how intelligent systems perceive…
Exploring Device-Oriented Video Encryption for Hierarchical Privacy Protection in AR Content Sharing
Yongquan Hu, Dongsheng Zheng, Kexin Nie +3
Content sharing across multiple Augmented Reality (AR) displays is becoming commonplace, enhancing team communication and collaboration through devices like smartphones and AR glas…
Leafeon: Towards Accurate, Robust and Low-cost Leaf Water Content Sensing Using mmWave Radar
Mark Cardamis, Hong Jia, Hao Qian +6
Plant sensing plays an important role in modern smart agriculture and the farming industry. Remote radio sensing allows for monitoring essential indicators of plant health, such as…
Towards Enhanced Context Awareness with Vision-based Multimodal Interfaces
Yongquan Hu, Wen Hu, Aaron Quigley
Vision-based Interfaces (VIs) are pivotal in advancing Human-Computer Interaction (HCI), particularly in enhancing context awareness. However, there are significant opportunities f…
Exploring Large-Scale Language Models to Evaluate EEG-Based Multimodal Data for Mental Health
Yongquan Hu, Shuning Zhang, Ting Dang +4
Integrating physiological signals such as electroencephalogram (EEG), with other data such as interview audio, may offer valuable multimodal insights into psychological states or n…