Selenite: Scaffolding Online Sensemaking with Comprehensive Overviews Elicited from Large Language Models
arXiv:2310.02161 · doi:10.1145/3613904.3642149
Abstract
Sensemaking in unfamiliar domains can be challenging, demanding considerable user effort to compare different options with respect to various criteria. Prior research and our formative study found that people would benefit from reading an overview of an information space upfront, including the criteria others previously found useful. However, existing sensemaking tools struggle with the "cold-start" problem -- it not only requires significant input from previous users to generate and share these overviews, but such overviews may also turn out to be biased and incomplete. In this work, we introduce a novel system, Selenite, which leverages Large Language Models (LLMs) as reasoning machines and knowledge retrievers to automatically produce a comprehensive overview of options and criteria to jumpstart users' sensemaking processes. Subsequently, Selenite also adapts as people use it, helping users find, read, and navigate unfamiliar information in a systematic yet personalized manner. Through three studies, we found that Selenite produced accurate and high-quality overviews reliably, significantly accelerated users' information processing, and effectively improved their overall comprehension and sensemaking experience.
Accepted to CHI 2024
References in corpus (18)
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- PaLM: Scaling Language Modeling with Pathways
- Sparks of Artificial General Intelligence: Early experiments with GPT-4
- A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity
- Self-Refine: Iterative Refinement with Self-Feedback
- "What It Wants Me To Say": Bridging the Abstraction Gap Between End-User Programmers and Code-Generating Large Language Models
- A Review on Language Models as Knowledge Bases
- Wigglite: Low-cost Information Collection and Triage
- Threddy: An Interactive System for Personalized Thread-based Exploration and Organization of Scientific Literature
- Scim: Intelligent Skimming Support for Scientific Papers
- Crystalline: Lowering the Cost for Developers to Collect and Organize Information for Decision Making
- Fuse: In-Situ Sensemaking Support in the Browser
- Interactive AI Alignment: Specification, Process, and Evaluation Alignment
- Evaluating Verifiability in Generative Search Engines
- How does AI chat change search behaviors?
- SUMMIT: Scaffolding OSS Issue Discussion Through Summarization
- Co-audit: tools to help humans double-check AI-generated content
- Crawling the Internal Knowledge-Base of Language Models
Cited by in corpus (7)
- Are We On Track? AI-Assisted Active and Passive Goal Reflection During Meetings
- VideoDiff: Human-AI Video Co-Creation with Alternatives
- A Recipe for Success? Exploring Strategies for Improving Non-Visual Access to Cooking Instructions
- Intent Tagging: Exploring Micro-Prompting Interactions for Supporting Granular Human-GenAI Co-Creation Workflows
- Gensors: Authoring Personalized Visual Sensors with Multimodal Foundation Models and Reasoning
- Exploring the Innovation Opportunities for Pre-trained Models
- The News Says, the Bot Says: How Immigrants and Locals Differ in Chatbot-Facilitated News Reading