5 papers
AnnoSketch: Evaluating and Collecting Human Sketches for MLLM-assisted Chart Annotation
Yoonjae Oh, Seon Gyeom Kim, Jae Young Choi +4
As multimodal large language models (MLLMs) support a growing range of input modalities, increasing work explores how to incorporate rough sketches to convey user intent. For annot…
Bridging Natural Language and Interactive What-If Interfaces via LLM-Generated Declarative Specifications
Sneha Gathani, Sirui Zeng, Diya Patel +5
What-if analysis (WIA) lets users explore hypothetical scenarios by adjusting parameters, applying constraints, and scoping data through interactive interfaces. Current tools fall…
Evaluating Visual Prompts with Eye-Tracking Data for MLLM-Based Human Activity Recognition
Jae Young Choi, Seon Gyeom Kim, Hyungjun Yoon +7
Large Language Models (LLMs) have emerged as foundation models for IoT applications such as human activity recognition (HAR). However, directly applying high-frequency and multi-di…
Chart-to-Experience: Benchmarking Multimodal LLMs for Predicting Experiential Impact of Charts
Seon Gyeom Kim, Jae Young Choi, Ryan Rossi +2
The field of Multimodal Large Language Models (MLLMs) has made remarkable progress in visual understanding tasks, presenting a vast opportunity to predict the perceptual and emotio…
Understanding the Impact of Spatial Immersion in Web Data Stories
Seon Gyeom Kim, Juhyeong Park, Yutaek Song +6
An increasing number of web articles engage the reader with the feeling of being immersed in the data space. However, the exact characteristics of spatial immersion in the context…