27 citations · 28 across the 13 of their papers we have counts for
8 papers · 1 filter
GraphGhost: Tracing Structures Behind Large Language Models
Xinnan Dai, Xianxuan Long, Chung-Hsiang Lo +4
Large Language Models (LLMs) exhibit strong reasoning capabilities on structured tasks, yet the internal mechanisms underlying such behaviors remain poorly understood. Existing int…
Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphs
Haoyu Han, Kai Guo, Harry Shomer +5
Reasoning over structured graphs remains a fundamental challenge for Large Language Models (LLMs), particularly when scaling to large graphs. Existing approaches typically follow t…
Beyond Static Retrieval: Opportunities and Pitfalls of Iterative Retrieval in GraphRAG
Kai Guo, Xinnan Dai, Shenglai Zeng +4
Retrieval-augmented generation (RAG) is a powerful paradigm for improving large language models (LLMs) on knowledge-intensive question answering. Graph-based RAG (GraphRAG) leverag…
Uncovering Graph Reasoning in Decoder-only Transformers with Circuit Tracing
Xinnan Dai, Chung-Hsiang Lo, Kai Guo +3
Transformer-based LLMs demonstrate strong performance on graph reasoning tasks, yet their internal mechanisms remain underexplored. To uncover these reasoning process mechanisms in…
From Sequence to Structure: Uncovering Substructure Reasoning in Transformers
Xinnan Dai, Kai Yang, Jay Revolinsky +4
Recent studies suggest that large language models (LLMs) possess the capability to solve graph reasoning tasks. Notably, even when graph structures are embedded within textual desc…
Empowering GraphRAG with Knowledge Filtering and Integration
Kai Guo, Harry Shomer, Shenglai Zeng +3
In recent years, large language models (LLMs) have revolutionized the field of natural language processing. However, they often suffer from knowledge gaps and hallucinations. Graph…
RAG vs. GraphRAG: A Systematic Evaluation and Key Insights
Haoyu Han, Li Ma, Yu Wang +9
Retrieval-Augmented Generation (RAG) improves large language models (LLMs) by retrieving relevant information from external sources and has been widely adopted for text-based tasks…
Retrieval-Augmented Generation with Graphs (GraphRAG)
Haoyu Han, Yu Wang, Harry Shomer +15
Retrieval-augmented generation (RAG) is a powerful technique that enhances downstream task execution by retrieving additional information, such as knowledge, skills, and tools from…