KNOWNET: Guided Health Information Seeking from LLMs via Knowledge Graph Integration
arXiv:2407.13598 · doi:10.1109/TVCG.2024.3456364
Abstract
The increasing reliance on Large Language Models (LLMs) for health information seeking can pose severe risks due to the potential for misinformation and the complexity of these topics. This paper introduces KNOWNET a visualization system that integrates LLMs with Knowledge Graphs (KG) to provide enhanced accuracy and structured exploration. Specifically, for enhanced accuracy, KNOWNET extracts triples (e.g., entities and their relations) from LLM outputs and maps them into the validated information and supported evidence in external KGs. For structured exploration, KNOWNET provides next-step recommendations based on the neighborhood of the currently explored entities in KGs, aiming to guide a comprehensive understanding without overlooking critical aspects. To enable reasoning with both the structured data in KGs and the unstructured outputs from LLMs, KNOWNET conceptualizes the understanding of a subject as the gradual construction of graph visualization. A progressive graph visualization is introduced to monitor past inquiries, and bridge the current query with the exploration history and next-step recommendations. We demonstrate the effectiveness of our system via use cases and expert interviews.
9 pages, 9 figures, accepted by IEEE VIS 2024
References in corpus (14)
- Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- Unifying Large Language Models and Knowledge Graphs: A Roadmap
- CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities
- Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models
- Challenges and Applications of Large Language Models
- Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Models
- Graphologue: Exploring Large Language Model Responses with Interactive Diagrams
- PromptMagician: Interactive Prompt Engineering for Text-to-Image Creation
- VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping
- Spellburst: A Node-based Interface for Exploratory Creative Coding with Natural Language Prompts
- Visual Analysis of Discrimination in Machine Learning
- Narvis: Authoring Narrative Slideshows for Introducing Data Visualization Designs
- NetworkNarratives: Data Tours for Visual Network Exploration and Analysis
- StorySparkQA: Expert-Annotated QA Pairs with Real-World Knowledge for Children's Story-Based Learning