A Comprehensive Survey on Integrating Large Language Models with Knowledge-Based Methods

Abstract

The rapid development of artificial intelligence has led to marked progress in the field. One interesting direction for research is whether Large Language Models (LLMs) can be integrated with structured knowledge-based systems. This approach aims to combine the generative language understanding of LLMs and the precise knowledge representation systems by which they are integrated. This article surveys the relationship between LLMs and knowledge bases, looks at how they can be applied in practice, and discusses related technical, operational, and ethical challenges. Utilizing a comprehensive examination of the literature, the study both identifies important issues and assesses existing solutions. It demonstrates the merits of incorporating generative AI into structured knowledge-base systems concerning data contextualization, model accuracy, and utilization of knowledge resources. The findings give a full list of the current situation of research, point out the main gaps, and propose helpful paths to take. These insights contribute to advancing AI technologies and support their practical deployment across various sectors.

References in corpus (79)

• Auto-Encoding Variational Bayes
• Generative Adversarial Networks
• Training language models to follow instructions with human feedback
• HuggingFace's Transformers: State-of-the-art Natural Language Processing
• Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
• A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions
• Knowledge Graphs
• Sparks of Artificial General Intelligence: Early experiments with GPT-4
• A Survey of Large Language Models
• Unifying Large Language Models and Knowledge Graphs: A Roadmap
• Retrieval-Augmented Generation for Large Language Models: A Survey
• Training Compute-Optimal Large Language Models
• ReAct: Synergizing Reasoning and Acting in Language Models
• GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models
• ChatGPT is not all you need. A State of the Art Review of large Generative AI models
• Large Language Models: A Survey
• Retrieval-Augmented Generation with Knowledge Graphs for Customer Service Question Answering
• DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence
• The Prompt Report: A Systematic Survey of Prompt Engineering Techniques
• DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
• Leveraging Medical Knowledge Graphs Into Large Language Models for Diagnosis Prediction: Design and Application Study
• A Performance Study of LLM-Generated Code on Leetcode
• A Survey of Large Language Models in Finance (FinLLMs)
• A Comprehensive Survey on Integrating Large Language Models with Knowledge-Based Methods
• Automating Research Synthesis with Domain-Specific Large Language Model Fine-Tuning
• Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph
• Knowledge Graphs as Context Sources for LLM-Based Explanations of Learning Recommendations
• DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders
• Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning
• A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challenges
• Medical Graph RAG: Towards Safe Medical Large Language Model via Graph Retrieval-Augmented Generation
• Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference
• Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey
• Evaluation of OpenAI o1: Opportunities and Challenges of AGI
• Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory
• ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving
• Unveiling LLM Evaluation Focused on Metrics: Challenges and Solutions
• A Survey on Large Language Models with some Insights on their Capabilities and Limitations
• A Systematic Literature Review on Large Language Models for Automated Program Repair
• The Chronicles of RAG: The Retriever, the Chunk and the Generator
• LLM Agents can Autonomously Exploit One-day Vulnerabilities
• A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models
• KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph
• BioRAG: A RAG-LLM Framework for Biological Question Reasoning
• Sentiment Analysis through LLM Negotiations
• Medical mT5: An Open-Source Multilingual Text-to-Text LLM for The Medical Domain
• Focus Agent: LLM-Powered Virtual Focus Group
• REALM: RAG-Driven Enhancement of Multimodal Electronic Health Records Analysis via Large Language Models
• Combining Knowledge Graphs and Large Language Models
• Synthetic Query Generation using Large Language Models for Virtual Assistants
• Think-on-Graph 2.0: Deep and Faithful Large Language Model Reasoning with Knowledge-guided Retrieval Augmented Generation
• T-RAG: Lessons from the LLM Trenches
• Integrating UMLS Knowledge into Large Language Models for Medical Question Answering
• Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models
• WeKnow-RAG: An Adaptive Approach for Retrieval-Augmented Generation Integrating Web Search and Knowledge Graphs
• RAG Does Not Work for Enterprises
• Don't Forget to Connect! Improving RAG with Graph-based Reranking
• Graph-Based Retriever Captures the Long Tail of Biomedical Knowledge
• A View of How Language Models Will Transform Law
• Language Models for Code Optimization: Survey, Challenges and Future Directions
• KAG: Boosting LLMs in Professional Domains via Knowledge Augmented Generation
• Strategic Chain-of-Thought: Guiding Accurate Reasoning in LLMs through Strategy Elicitation
• Pinning "Reflection" on the Agenda: Investigating Reflection in Human-LLM Co-Creation for Creative Coding
• Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs
• Chain-of-Knowledge: Integrating Knowledge Reasoning into Large Language Models by Learning from Knowledge Graphs
• SAC-KG: Exploiting Large Language Models as Skilled Automatic Constructors for Domain Knowledge Graphs
• Aligning with Logic: Measuring, Evaluating and Improving Logical Preference Consistency in Large Language Models
• Large Language Models for Anomaly and Out-of-Distribution Detection: A Survey
• Papers-to-Posts: Supporting Detailed Long-Document Summarization with an Interactive LLM-Powered Source Outline
• Towards Efficient Large Language Models for Scientific Text: A Review
• Coarse-to-Fine Highlighting: Reducing Knowledge Hallucination in Large Language Models
• LLMs Meet Multimodal Generation and Editing: A Survey
• Topological or not? A unified pattern description in the one-dimensional anisotropic quantum XY model with a transverse field
• Knowledge Graph-based Retrieval-Augmented Generation for Schema Matching
• Meta Reasoning for Large Language Models
• PAS: Data-Efficient Plug-and-Play Prompt Augmentation System
• Boosting of Thoughts: Trial-and-Error Problem Solving with Large Language Models
• FunnelRAG: A Coarse-to-Fine Progressive Retrieval Paradigm for RAG
• Unveiling the Statistical Foundations of Chain-of-Thought Prompting Methods

Cited by in corpus (1)

• A Comprehensive Survey on Integrating Large Language Models with Knowledge-Based Methods