Knowledge Graph Based Repository-Level Code Generation
arXiv:2505.14394 · doi:10.1109/LLM4Code66737.2025.00026
Abstract
Recent advancements in Large Language Models (LLMs) have transformed code generation from natural language queries. However, despite their extensive knowledge and ability to produce high-quality code, LLMs often struggle with contextual accuracy, particularly in evolving codebases. Current code search and retrieval methods frequently lack robustness in both the quality and contextual relevance of retrieved results, leading to suboptimal code generation. This paper introduces a novel knowledge graph-based approach to improve code search and retrieval leading to better quality of code generation in the context of repository-level tasks. The proposed approach represents code repositories as graphs, capturing structural and relational information for enhanced context-aware code generation. Our framework employs a hybrid approach for code retrieval to improve contextual relevance, track inter-file modular dependencies, generate more robust code and ensure consistency with the existing codebase. We benchmark the proposed approach on the Evolutionary Code Benchmark (EvoCodeBench) dataset, a repository-level code generation benchmark, and demonstrate that our method significantly outperforms the baseline approach. These findings suggest that knowledge graph based code generation could advance robust, context-sensitive coding assistance tools.
8 pages, 3 figures
References in corpus (7)
- Evaluating Large Language Models Trained on Code
- Scaling Instruction-Finetuned Language Models
- The Rise and Potential of Large Language Model Based Agents: A Survey
- AgentCoder: Multi-Agent-based Code Generation with Iterative Testing and Optimisation
- EvoCodeBench: An Evolving Code Generation Benchmark Aligned with Real-World Code Repositories
- What's Wrong with Your Code Generated by Large Language Models? An Extensive Study
- CATCODER: Repository-Level Code Generation with Relevant Code and Type Context