187 citations · 392 across the 26 of their papers we have counts for
11 papers · 1 filter
Towards Understanding Continual Factual Knowledge Acquisition of Language Models: From Theory to Algorithm
Haoyu Wang, Yifan Shang, Zhongxiang Sun +3
Continual Pre-Training (CPT) is essential for enabling Language Models (LMs) to integrate new knowledge without erasing old. While classical CPT techniques like data replay have be…
When Personalization Misleads: Understanding and Mitigating Hallucinations in Personalized LLMs
Zhongxiang Sun, Yi Zhan, Chenglei Shen +4
Personalized large language models (LLMs) adapt model behavior to individual users to enhance user satisfaction, yet personalization can inadvertently distort factual reasoning. We…
Memory in the Age of AI Agents
Yuyang Hu, Shichun Liu, Yanwei Yue +44
Memory has emerged, and will continue to remain, a core capability of foundation model-based agents. As research on agent memory rapidly expands and attracts unprecedented attentio…
Balancing Stylization and Truth via Disentangled Representation Steering
Chenglei Shen, Zhongxiang Sun, Teng Shi +2
Generating stylized large language model (LLM) responses via representation editing is a promising way for fine-grained output control. However, there exists an inherent trade-off:…
An Explicit Syllogistic Legal Reasoning Framework for Large Language Models
Kepu Zhang, Weijie Yu, Zhongxiang Sun +1
Syllogistic reasoning is crucial for sound legal decision-making, allowing legal professionals to draw logical conclusions by applying general principles to specific case facts. Wh…
ReARTeR: Retrieval-Augmented Reasoning with Trustworthy Process Rewarding
Zhongxiang Sun, Qipeng Wang, Weijie Yu +6
Retrieval-Augmented Generation (RAG) systems for Large Language Models (LLMs) hold promise in knowledge-intensive tasks but face limitations in complex multi-step reasoning. While…
Trigger: Refining Query Correction via Adaptive Model Selector
Kepu Zhang, Zhongxiang Sun, Xiao Zhang +4
In search scenarios, user experience can be hindered by erroneous queries due to typos, voice errors, or knowledge gaps. Therefore, query correction is crucial for search engines.…
LargePiG: Your Large Language Model is Secretly a Pointer Generator
Zhongxiang Sun, Zihua Si, Xiaoxue Zang +4
Recent research on query generation has focused on using Large Language Models (LLMs), which despite bringing state-of-the-art performance, also introduce issues with hallucination…
ReDeEP: Detecting Hallucination in Retrieval-Augmented Generation via Mechanistic Interpretability
Zhongxiang Sun, Xiaoxue Zang, Kai Zheng +5
Retrieval-Augmented Generation (RAG) models are designed to incorporate external knowledge, reducing hallucinations caused by insufficient parametric (internal) knowledge. However,…
Effective In-Context Example Selection through Data Compression
Zhongxiang Sun, Kepu Zhang, Haoyu Wang +2
In-context learning has been extensively validated in large language models. However, the mechanism and selection strategy for in-context example selection, which is a crucial ingr…
A Short Survey of Viewing Large Language Models in Legal Aspect
Zhongxiang Sun
Large language models (LLMs) have transformed many fields, including natural language processing, computer vision, and reinforcement learning. These models have also made a signifi…