5 citations · 11 across the 6 of their papers we have counts for
1 paper · 1 filter
Ruizhe Shi, Zaiwen Yang, Qiubo Wang +2
We study sparse and continual reinforcement learning fine-tuning of language models through attention-head ranking and partitioning. For sparse learning, we rank attention heads by…