4 papers · 1 filter
HiEdit: Lifelong Model Editing with Hierarchical Reinforcement Learning
Yangfan Wang, Tianyang Sun, Chen Tang +3
Lifelong model editing (LME) aims to sequentially rectify outdated or inaccurate knowledge in deployed LLMs while minimizing side effects on unrelated inputs. However, existing app…
KA2L: A Knowledge-Aware Active Learning Framework for LLMs
Haoxuan Yin, Chen Tang, Yangfan Wang +2
Fine-tuning large language models (LLMs) with high-quality knowledge has been shown to enhance their performance effectively. However, there is a paucity of research on the depth o…
KCS: Diversify Multi-hop Question Generation with Knowledge Composition Sampling
Yangfan Wang, Jie Liu, Chen Tang +2
Multi-hop question answering faces substantial challenges due to data sparsity, which increases the likelihood of language models learning spurious patterns. To address this issue,…
GRAPHMOE: Amplifying Cognitive Depth of Mixture-of-Experts Network via Introducing Self-Rethinking Mechanism
Bo Lv, Chen Tang, Zifan Zheng +8
Traditional Mixture-of-Experts (MoE) networks benefit from utilizing multiple smaller expert models as opposed to a single large network. However, these experts typically operate i…