3 papers
cs.CL2025
PowerAttention: Exponentially Scaling of Receptive Fields for Effective Sparse Attention
Lida Chen, Dong Xu, Chenxin An +8
Large Language Models (LLMs) face efficiency bottlenecks due to the quadratic complexity of the attention mechanism when processing long contexts. Sparse attention methods offer a…
cs.CL2024★ 4 cited
Chain-of-Knowledge: Integrating Knowledge Reasoning into Large Language Models by Learning from Knowledge Graphs
Yifei Zhang, Xintao Wang, Jiaqing Liang +3
Large Language Models (LLMs) have exhibited impressive proficiency in various natural language processing (NLP) tasks, which involve increasingly complex reasoning. Knowledge reaso…
cs.CL2024★ 1 cited
Teaching Large Language Models to Express Knowledge Boundary from Their Own Signals
Lida Chen, Zujie Liang, Xintao Wang +7
Large language models (LLMs) have achieved great success, but their occasional content fabrication, or hallucination, limits their practical application. Hallucination arises becau…