6 citations · 16 across the 9 of their papers we have counts for
9 papers
Scaling LLM Knowledge Boundaries via Distribution-Optimized Synthesis
Songze Li, Yarong Lan, Zhongpu Bo +16
Knowledge injection via synthetic data is crucial for enhancing Large Language Models (LLMs). However, current synthesis methods simply stop at preset token counts or fixed data ra…
Thinker: Training LLMs in Hierarchical Thinking for Deep Search via Multi-Turn Interaction
Jun Xu, Xinkai Du, Yu Ao +17
Efficient retrieval of external knowledge bases and web pages is crucial for enhancing the reasoning abilities of LLMs. Previous works on training LLMs to leverage external retriev…
Last Layer Logits to Logic: Empowering LLMs with Logic-Consistent Structured Knowledge Reasoning
Songze Li, Zhiqiang Liu, Zhaoyan Gong +6
Large Language Models (LLMs) achieve excellent performance in natural language reasoning tasks through pre-training on vast unstructured text, enabling them to understand the logic…
KAG-Thinker: Interactive Thinking and Deep Reasoning in LLMs via Knowledge-Augmented Generation
Dalong Zhang, Jun Xu, Jun Zhou +16
In this paper, we introduce KAG-Thinker, which upgrade KAG to a multi-turn interactive thinking and deep reasoning framework powered by a dedicated parameter-light large language m…
K-ON: Stacking Knowledge On the Head Layer of Large Language Model
Lingbing Guo, Yichi Zhang, Zhongpu Bo +5
Recent advancements in large language models (LLMs) have significantly improved various natural language processing (NLP) tasks. Typically, LLMs are trained to predict the next tok…
OntoTune: Ontology-Driven Self-training for Aligning Large Language Models
Zhiqiang Liu, Chengtao Gan, Junjie Wang +5
Existing domain-specific Large Language Models (LLMs) are typically developed by fine-tuning general-purposed LLMs with large-scale domain-specific corpora. However, training on la…
MKGL: Mastery of a Three-Word Language
Lingbing Guo, Zhongpu Bo, Zhuo Chen +10
Large language models (LLMs) have significantly advanced performance across a spectrum of natural language processing (NLP) tasks. Yet, their application to knowledge graphs (KGs),…
KAG: Boosting LLMs in Professional Domains via Knowledge Augmented Generation
Lei Liang, Mengshu Sun, Zhengke Gui +16
The recently developed retrieval-augmented generation (RAG) technology has enabled the efficient construction of domain-specific applications. However, it also has limitations, inc…
Distributed Representations of Entities in Open-World Knowledge Graphs
Lingbing Guo, Zhuo Chen, Jiaoyan Chen +7
Graph neural network (GNN)-based methods have demonstrated remarkable performance in various knowledge graph (KG) tasks. However, most existing approaches rely on observing all ent…