4 papers · 1 filter
AgentLens: Adaptive Visual Modalities for Human-Agent Interaction in Mobile GUI Agents
Jeonghyeon Kim, Byeongjun Joung, Junwon Lee +3
Mobile GUI agents can automate smartphone tasks by interacting directly with app interfaces, but how they should communicate with users during execution remains underexplored. Exis…
Leveraging LLMs for Efficient and Personalized Smart Home Automation
Chaerin Yu, Chihun Choi, Sunjae Lee +4
The proliferation of smart home devices has increased the complexity of controlling and managing them, leading to user fatigue. In this context, large language models (LLMs) offer…
VeriSafe Agent: Safeguarding Mobile GUI Agent via Logic-based Action Verification
Jungjae Lee, Dongjae Lee, Chihun Choi +6
Large Foundation Models (LFMs) have unlocked new possibilities in human-computer interaction, particularly with the rise of mobile Graphical User Interface (GUI) Agents capable of…
Explore, Select, Derive, and Recall: Augmenting LLM with Human-like Memory for Mobile Task Automation
Sunjae Lee, Junyoung Choi, Jungjae Lee +5
The advent of large language models (LLMs) has opened up new opportunities in the field of mobile task automation. Their superior language understanding and reasoning capabilities…