12 papers
Exploring LLM Agent Designs and Interaction Modalities for Scientific Visualization
Jackson Vonderhorst, Kuangshi Ai, Haichao Miao +2
This paper examines how large language model (LLM) agents perform on scientific visualization (SciVis) tasks that require generating visualization workflows from natural-language i…
SciVisAgentBench: A Benchmark for Evaluating Scientific Data Analysis and Visualization Agents
Kuangshi Ai, Haichao Miao, Kaiyuan Tang +13
Recent advances in large language models (LLMs) have enabled agentic systems to translate natural-language intent into executable scientific visualization (SciVis) tasks. Despite r…
HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualization
Kuangshi Ai, Patrick Phuoc Do, Chaoli Wang
Large language model (LLM) agents enable natural language interaction for scientific visualization (SciVis). Still, prior systems have essentially prioritized autonomy over human a…
SciVisAgentSkills: Design and Evaluation of Agent Skills for Scientific Data Analysis and Visualization
Kuangshi Ai, Haichao Miao, Kaiyuan Tang +2
Recent advances in agentic visualization have enabled the translation of natural language into executable scientific visualization (SciVis) workflows. While general-purpose coding…
Toward AI VIS Co-Scientists: A General and End-to-End Agent Harness for Solving Complex Data Visualization Tasks
Haichao Miao, Zhimin Li, Kuangshi Ai +4
The ability to inspect, interpret, and communicate complex data is crucial for virtually any scientific endeavor, but often requires significant expertise outside the core domain r…
Leveraging Multimodal LLMs for Built Environment and Housing Attribute Assessment from Street-View Imagery
Siyuan Yao, Siavash Ghorbany, Kuangshi Ai +6
We present a novel framework for automatically evaluating building conditions nationwide in the United States by leveraging large language models (LLMs) and Google Street View (GSV…