5 papers
SAGE: Efficient Protected Vision-Language Inference on Smart Glasses
Zhimin Li, Pan Wang, Jingxian Chen +3
Smart glasses are a promising platform for vision-language assistants, but private split inference remains expensive: protecting visual representations before transmission does not…
Defending Wearable VLMs Against Private Attribute Inference
Zhimin Li, Pan Wang, Jingxian Chen +4
Wearable VLM pipelines promise continuous multimodal assistance from egocentric visual capture: a user asks a task-driven question about the surrounding scene, and the system uses…
Aligning Paralinguistic Understanding and Generation in Speech LLMs via Multi-Task Reinforcement Learning
Jingxiang Chen, Minseok Kim, Seong-Gyun Leem +13
Speech large language models (LLMs) observe paralinguistic cues such as prosody, emotion, and non-verbal sounds--crucial for intent understanding. However, leveraging these cues fa…
ConfRAG: Confidence-Guided Retrieval-Augmenting Generation
Yin Huang, Yifan Ethan Xu, Kai Sun +12
Can Large Language Models (LLMs) be trained to avoid hallucinating factual statements, and can Retrieval-Augmented Generation (RAG) be triggered only when necessary to reduce retri…
Scalable Temporal Localization of Sensitive Activities in Movies and TV Episodes
Xiang Hao, Jingxiang Chen, Shixing Chen +2
To help customers make better-informed viewing choices, video-streaming services try to moderate their content and provide more visibility into which portions of their movies and T…