Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Models
arXiv:2305.11483 · doi:10.1145/3586183.3606756
Abstract
People are increasingly turning to large language models (LLMs) for complex information tasks like academic research or planning a move to another city. However, while they often require working in a nonlinear manner -- e.g., to arrange information spatially to organize and make sense of it, current interfaces for interacting with LLMs are generally linear to support conversational interaction. To address this limitation and explore how we can support LLM-powered exploration and sensemaking, we developed Sensecape, an interactive system designed to support complex information tasks with an LLM by enabling users to (1) manage the complexity of information through multilevel abstraction and (2) seamlessly switch between foraging and sensemaking. Our within-subject user study reveals that Sensecape empowers users to explore more topics and structure their knowledge hierarchically, thanks to the externalization of levels of abstraction. We contribute implications for LLM-based workflows and interfaces for information tasks.
18 pages, 14 figures, Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST '23), San Francisco, CA, USA
References in corpus (3)
Cited by in corpus (37)
- Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation
- DirectGPT: A Direct Manipulation Interface to Interact with Large Language Models
- A Taxonomy for Human-LLM Interaction Modes: An Initial Exploration
- Improving Steering and Verification in AI-Assisted Data Analysis with Interactive Task Decomposition
- WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualization
- Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking
- Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooM
- RELIC: Investigating Large Language Model Responses using Self-Consistency
- One vs. Many: Comprehending Accurate Information from Multiple Erroneous and Inconsistent AI Generations
- KNOWNET: Guided Health Information Seeking from LLMs via Knowledge Graph Integration
- Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualization
- Malleable Overview-Detail Interfaces
- AI-Instruments: Embodying Prompts as Instruments to Abstract & Reflect Graphical Interface Commands as General-Purpose Tools
- Generative AI in Knowledge Work: Design Implications for Data Navigation and Decision-Making
- VeriPlan: Integrating Formal Verification and LLMs into End-User Planning
- User Experience with LLM-powered Conversational Recommendation Systems: A Case of Music Recommendation
- VideoDiff: Human-AI Video Co-Creation with Alternatives
- JailbreakLens: Visual Analysis of Jailbreak Attacks Against Large Language Models
- SPROUT: an Interactive Authoring Tool for Generating Programming Tutorials with the Visualization of Large Language Models
- NeuroSync: Intent-Aware Code-Based Problem Solving via Direct LLM Understanding Modification
- Intent Tagging: Exploring Micro-Prompting Interactions for Supporting Granular Human-GenAI Co-Creation Workflows
- Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgets
- ScholarMate: A Mixed-Initiative Tool for Qualitative Knowledge Work and Information Sensemaking
- GenPara: Enhancing the 3D Design Editing Process by Inferring Users' Regions of Interest with Text-Conditional Shape Parameters
- No Evidence for LLMs Being Useful in Problem Reframing
- OnGoal: Tracking and Visualizing Conversational Goals in Multi-Turn Dialogue with Large Language Models
- GazeNoter: Co-Piloted AR Note-Taking via Gaze Selection of LLM Suggestions to Match Users' Intentions
- StoryEnsemble: Enabling Dynamic Exploration & Iteration in the Design Process with AI and Forward-Backward Propagation
- Surfacing Variations to Calibrate Perceived Reliability of MLLM-generated Image Descriptions
- Assembling the Puzzle: Exploring Collaboration and Data Sensemaking in Nursing Practices for Remote Patient Monitoring
- ReSpark: Leveraging Previous Data Reports as References to Generate New Reports with LLMs
- Vipera: Towards systematic auditing of generative text-to-image models at scale
- BizChat: Scaffolding AI-Powered Business Planning for Small Business Owners Across Digital Skill Levels
- Feedstack: Layering Structured Representations over Unstructured Feedback to Scaffold Human AI Conversation
- Crystallizing Schemas with Teleoscope: Thematic Curation of Large Text Corpora on Reddit
- OOPrompt: Reifying Intents into Structured Artifacts for Modular and Iterative Prompting
- TimeCapsule: Generative Hallucination as a Method for Historical Sensemaking