activity
20232026
most citedReactGenie: A Development Framework for Complex Multimodal Interactions Using Large Language Models

16 citations · 16 across the 7 of their papers we have counts for

collaborators

8 papers

cs.LG2026

Rondo: Unsupervised Discovery of Recurring Temporal Structure

Yingtian Shi, Ankith Chandra, Thomas Plötz

Many real-world time series data exhibit structural properties at multiple scales, from short, recurring units to complex sequences composed of these units. Unsupervised discovery…

cs.HC2026

TRACE: Temporal Reasoning over Context and Evidence for Activity Recognition in Smart Homes

Yingtian Shi, Abivishaq Balasubramanian, Jessica Herring +7

Human activity recognition (HAR) in smart homes remains challenging because many daily activities exhibit similar local sensor patterns, while minimally intrusive sensing provides…

cs.HC2026

EduGage: A Multimodal Dataset and Benchmark for Sensor-Based Momentary Assessment of Engagement in Self-Guided Video Learning

Zikang Leng, Edan Eyal, Yingtian Shi +3

Engagement, which links to attentional, emotional, and cognitive dimensions, plays an important role in learning. In online and video-based learning environments, learners often ne…

cs.HC2025

LLMartini: Seamless and Interactive Leveraging of Multiple LLMs through Comparison and Composition

Yingtian Shi, Jinda Yang, Yuhan Wang +4

The growing diversity of large language models (LLMs) means users often need to compare and combine outputs from different models to obtain higher-quality or more comprehensive res…

cs.HC2024

CasualGaze: Towards Modeling and Recognizing Casual Gaze Behavior for Efficient Gaze-based Object Selection

Yingtian Shi, Yukang Yan, Zisu Li +4

We present CasualGaze, a novel eye-gaze-based target selection technique to support natural and casual eye-gaze input. Unlike existing solutions that require users to keep the eye-…

cs.HC2024

SonarWatch: Field sensing technique for smartwatches based on ultrasound and motion

Yingtian Shi, Chun Yu, Xuyang Lu +3

A smartwatch worn continuously on the wrist has the potential to perceive rich interactive gestures and natural behaviors of the user. Unfortunately, the current interaction functi…

cs.HC2024

Bridging the gap between natural user expression with complex automation programming in smart homes

Yingtian Shi, Xiaoyi Liu, Chun Yu +4

A long-standing challenge in end-user programming (EUP) is to trade off between natural user expression and the complexity of programming tasks. As large language models (LLMs) are…

cs.HC2023★ 16 cited

ReactGenie: A Development Framework for Complex Multimodal Interactions Using Large Language Models

Jackie Junrui Yang, Yingtian Shi, Yuhan Zhang +7

By combining voice and touch interactions, multimodal interfaces can surpass the efficiency of either modality alone. Traditional multimodal frameworks require laborious developer…