Graphologue: Exploring Large Language Model Responses with Interactive Diagrams
arXiv:2305.11473 · doi:10.1145/3586183.3606737
Abstract
Large language models (LLMs) have recently soared in popularity due to their ease of access and the unprecedented ability to synthesize text responses to diverse user questions. However, LLMs like ChatGPT present significant limitations in supporting complex information tasks due to the insufficient affordances of the text-based medium and linear conversational structure. Through a formative study with ten participants, we found that LLM interfaces often present long-winded responses, making it difficult for people to quickly comprehend and interact flexibly with various pieces of information, particularly during more complex tasks. We present Graphologue, an interactive system that converts text-based responses from LLMs into graphical diagrams to facilitate information-seeking and question-answering tasks. Graphologue employs novel prompting strategies and interface designs to extract entities and relationships from LLM responses and constructs node-link diagrams in real-time. Further, users can interact with the diagrams to flexibly adjust the graphical presentation and to submit context-specific prompts to obtain more information. Utilizing diagrams, Graphologue enables graphical, non-linear dialogues between humans and LLMs, facilitating information exploration, organization, and comprehension.
References in corpus (8)
- Learning to Prompt for Vision-Language Models
- NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queries
- Striking a Balance: Reader Takeaways and Preferences when Integrating Text and Charts
- Wigglite: Low-cost Information Collection and Triage
- Coupling Story to Visualization: Using Textual Analysis as a Bridge Between Data and Interpretation
- CrossData: Leveraging Text-Data Connections for Authoring Data Documents
- Automatically Generating CS Learning Materials with Large Language Models
- CrossCode: Multi-level Visualization of Program Execution
Cited by in corpus (30)
- ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testing
- DirectGPT: A Direct Manipulation Interface to Interact with Large Language Models
- Generative AI for Self-Adaptive Systems: State of the Art and Research Roadmap
- A Taxonomy for Human-LLM Interaction Modes: An Initial Exploration
- WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualization
- LessonPlanner: Assisting Novice Teachers to Prepare Pedagogy-Driven Lesson Plans with Large Language Models
- RELIC: Investigating Large Language Model Responses using Self-Consistency
- KNOWNET: Guided Health Information Seeking from LLMs via Knowledge Graph Integration
- Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualization
- Malleable Overview-Detail Interfaces
- AI-Instruments: Embodying Prompts as Instruments to Abstract & Reflect Graphical Interface Commands as General-Purpose Tools
- Generative AI in Knowledge Work: Design Implications for Data Navigation and Decision-Making
- DesignWeaver: Dimensional Scaffolding for Text-to-Image Product Design
- VeriPlan: Integrating Formal Verification and LLMs into End-User Planning
- DesignFromX: Empowering Consumer-Driven Design Space Exploration through Feature Composition of Referenced Products
- JailbreakLens: Visual Analysis of Jailbreak Attacks Against Large Language Models
- Intent Tagging: Exploring Micro-Prompting Interactions for Supporting Granular Human-GenAI Co-Creation Workflows
- SPROUT: an Interactive Authoring Tool for Generating Programming Tutorials with the Visualization of Large Language Models
- InstructPipe: Generating Visual Blocks Pipelines with Human Instructions and LLMs
- OnGoal: Tracking and Visualizing Conversational Goals in Multi-Turn Dialogue with Large Language Models
- FathomGPT: A Natural Language Interface for Interactively Exploring Ocean Science Data
- GenPara: Enhancing the 3D Design Editing Process by Inferring Users' Regions of Interest with Text-Conditional Shape Parameters
- Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgets
- GazeNoter: Co-Piloted AR Note-Taking via Gaze Selection of LLM Suggestions to Match Users' Intentions
- StoryEnsemble: Enabling Dynamic Exploration & Iteration in the Design Process with AI and Forward-Backward Propagation
- Surfacing Variations to Calibrate Perceived Reliability of MLLM-generated Image Descriptions
- DiscipLink: Unfolding Interdisciplinary Information Seeking Process via Human-AI Co-Exploration
- Feedstack: Layering Structured Representations over Unstructured Feedback to Scaffold Human AI Conversation
- NoTeeline: Supporting Real-Time, Personalized Notetaking with LLM-Enhanced Micronotes
- OOPrompt: Reifying Intents into Structured Artifacts for Modular and Iterative Prompting