2 papers
cs.CL2024
Grimoire is All You Need for Enhancing Large Language Models
Ding Chen, Shichao Song, Qingchen Yu +4
In-context Learning (ICL) is one of the key methods for enhancing the performance of large language models on specific tasks by providing a set of few-shot examples. However, the I…
cs.LG2023
Task Difficulty Aware Parameter Allocation & Regularization for Lifelong Learning
Wenjin Wang, Yunqing Hu, Qianglong Chen +1
Parameter regularization or allocation methods are effective in overcoming catastrophic forgetting in lifelong learning. However, they solve all tasks in a sequence uniformly and i…