Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
How Language Models Differ in Redistributing Attention-Head Activity Under Serial Demand
Johnny Jingze Li, Abdulla Kuleib, Kalyan Basu +1
The way a model distributes activity over each layer's attention heads offers a coarse view of how it routes information through depth; how this changes with the task is part of wh…
cs.LG2024
Premier-TACO is a Few-Shot Policy Learner: Pretraining Multitask Representation via Temporal Action-Driven Contrastive Loss
Ruijie Zheng, Yongyuan Liang, Xiyao Wang +7
We present Premier-TACO, a multitask feature representation learning approach designed to improve few-shot policy learning efficiency in sequential decision-making tasks. Premier-T…