7 papers · 1 filter
TaskSense: Cognitive Chain Modeling and Difficulty Estimation for GUI Tasks
Yiwen Yin, Zhian Hu, Xiaoxi Xu +4
Measuring GUI task difficulty is crucial for user behavior analysis and agent capability evaluation. Yet, existing benchmarks typically quantify difficulty based on motor actions (…
TextOnly: A Unified Function Portal for Text-Related Functions on Smartphones
Minghao Tu, Chun Yu, Xiyuan Shen +3
Text boxes serve as portals to diverse functionalities in today's smartphone applications. However, when it comes to specific functionalities, users always need to navigate through…
Say Your Reason: Extract Contextual Rules In Situ for Context-aware Service Recommendation
Yuxuan Li, Jiahui Li, Lihang Pan +2
This paper introduces SayRea, an interactive system that facilitates the extraction of contextual rules for personalized context-aware service recommendations in mobile scenarios.…
CasualGaze: Towards Modeling and Recognizing Casual Gaze Behavior for Efficient Gaze-based Object Selection
Yingtian Shi, Yukang Yan, Zisu Li +4
We present CasualGaze, a novel eye-gaze-based target selection technique to support natural and casual eye-gaze input. Unlike existing solutions that require users to keep the eye-…
SonarWatch: Field sensing technique for smartwatches based on ultrasound and motion
Yingtian Shi, Chun Yu, Xuyang Lu +3
A smartwatch worn continuously on the wrist has the potential to perceive rich interactive gestures and natural behaviors of the user. Unfortunately, the current interaction functi…
Bridging the gap between natural user expression with complex automation programming in smart homes
Yingtian Shi, Xiaoyi Liu, Chun Yu +4
A long-standing challenge in end-user programming (EUP) is to trade off between natural user expression and the complexity of programming tasks. As large language models (LLMs) are…