A Survey of Hallucination in Large Foundation Models

Abstract

Hallucination in a foundation model (FM) refers to the generation of content that strays from factual reality or includes fabricated information. This survey paper provides an extensive overview of recent efforts that aim to identify, elucidate, and tackle the problem of hallucination, with a particular focus on ``Large'' Foundation Models (LFMs). The paper classifies various types of hallucination phenomena that are specific to LFMs and establishes evaluation criteria for assessing the extent of hallucination. It also examines existing strategies for mitigating hallucination in LFMs and discusses potential directions for future research in this area. Essentially, the paper offers a comprehensive examination of the challenges and solutions related to hallucination in LFMs.

Cited by in corpus (6)

• A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine
• Towards Reliable Generative AI-Driven Scaffolding: Reducing Hallucinations and Enhancing Quality in Self-Regulated Learning Support
• Type-Constrained Code Generation with Language Models
• Getting Inspiration for Feature Elicitation: App Store- vs. LLM-based Approach
• Foundation Models for the Digital Twin Creation of Cyber-Physical Systems
• Hallucinations in LLMs: A Lifecycle-Based Survey of Causes, Detection, Mitigation, and Prevention