activity
20232026
most citedPrompt2Task: Automating UI Tasks on Smartphones from Textual Prompts

6 citations · 16 across the 23 of their papers we have counts for

collaborators
Showing 2024Show all

8 papers · 1 filter

cs.HC2024

SituFont: A Just-in-Time Adaptive Intervention System for Enhancing Mobile Readability in Situational Visual Impairments

Jingruo Chen, Kexin Nie, Mingshan Zhang +5

Situational visual impairments (SVIs) hinder mobile readability, causing discomfort and limiting information access. Building on prior work in adaptive typography and accessibility…

cs.CV2024

PoseAugment: Generative Human Pose Data Augmentation with Physical Plausibility for IMU-based Motion Capture

Zhuojun Li, Chun Yu, Chen Liang +1

The data scarcity problem is a crucial factor that hampers the model performance of IMU-based human motion capture. However, effective data augmentation for IMU-based motion captur…

cs.HC2024★ 1 cited

Say Your Reason: Extract Contextual Rules In Situ for Context-aware Service Recommendation

Yuxuan Li, Jiahui Li, Lihang Pan +2

This paper introduces SayRea, an interactive system that facilitates the extraction of contextual rules for personalized context-aware service recommendations in mobile scenarios.…

cs.HC2024★ 5 cited

AngleSizer: Enhancing Spatial Scale Perception for the Visually Impaired with an Interactive Smartphone Assistant

Xiaoqing Jing, Chun Yu, Kun Yue +6

Spatial perception, particularly at small and medium scales, is an essential human sense but poses a significant challenge for the blind and visually impaired (BVI). Traditional le…

cs.HC2024

CasualGaze: Towards Modeling and Recognizing Casual Gaze Behavior for Efficient Gaze-based Object Selection

Yingtian Shi, Yukang Yan, Zisu Li +4

We present CasualGaze, a novel eye-gaze-based target selection technique to support natural and casual eye-gaze input. Unlike existing solutions that require users to keep the eye-…

cs.HC2024

Bridging the gap between natural user expression with complex automation programming in smart homes

Yingtian Shi, Xiaoyi Liu, Chun Yu +4

A long-standing challenge in end-user programming (EUP) is to trade off between natural user expression and the complexity of programming tasks. As large language models (LLMs) are…

cs.HC2024

A Human-Computer Collaborative Tool for Training a Single Large Language Model Agent into a Network through Few Examples

Lihang Pan, Yuxuan Li, Chun Yu +1

The capabilities of a single large language model (LLM) agent for solving a complex task are limited. Connecting multiple LLM agents to a network can effectively improve overall pe…

cs.HC2024★ 6 cited

Prompt2Task: Automating UI Tasks on Smartphones from Textual Prompts

Tian Huang, Chun Yu, Weinan Shi +4

UI task automation enables efficient task execution by simulating human interactions with graphical user interfaces (GUIs), without modifying the existing application code. However…