5 papers
Alignment Is Local: A Paired Diagnostic for GUI Agents under User-Side Persuasion
Haoxin An, Yunpeng Song, Zihao Bai +6
Trustworthy deployment of GUI agents in ubiquitous computing settings requires alignment that survives dynamic interaction and precise threat conditions, not just single-turn refus…
DroidRetriever: A Transparent and Steerable Automation System for Collaborative Mobile Information Seeking
Yiheng Bian, Yunpeng Song, Guiyu Ma +2
Information seeking on mobile devices is often fragmented, trapping users in repetitive cycles of context switching and data re-entry, which increases cognitive load and disrupts w…
Predicting User Behavior in Smart Spaces with LLM-Enhanced Logs and Personalized Prompts
Yunpeng Song, Jiawei Li, Yiheng Bian +1
Enhancing the intelligence of smart systems, such as smart home, and smart vehicle, and smart grids, critically depends on developing sophisticated planning capabilities that can a…
In-Situ Mode: Generative AI-Driven Characters Transforming Art Engagement Through Anthropomorphic Narratives
Yongming Li, Hangyue Zhang, Andrea Yaoyun Cui +4
Art appreciation serves as a crucial medium for emotional communication and sociocultural dialogue. In the digital era, fostering deep user engagement on online art appreciation pl…
VisionTasker: Mobile Task Automation Using Vision Based UI Understanding and LLM Task Planning
Yunpeng Song, Yiheng Bian, Yongtao Tang +2
Mobile task automation is an emerging field that leverages AI to streamline and optimize the execution of routine tasks on mobile devices, thereby enhancing efficiency and producti…