Ranking and Partitioning of Attention Heads for Sparse and Continual Reinforcement Learning Fine-tuning

Ruizhe Shi, Zaiwen Yang, Qiubo Wang +2

We study sparse and continual reinforcement learning fine-tuning of language models through attention-head ranking and partitioning. For sparse learning, we rank attention heads by…