Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Decomposing the Depth Profile of Fine-Tuning
Jayadev Billa
Fine-tuning adapts pretrained networks to new objectives. Whether the resulting depth profile of representational change reflects an intrinsic property of the model or the magnitud…
cs.LG2026
Predicting Where Steering Vectors Succeed
Jayadev Billa
Steering vectors work for some concepts and layers but fail for others, and practitioners have no way to predict which setting applies before running an intervention. We introduce…
cs.LG2026
The Geometric Anatomy of Capability Acquisition in Transformers
Jayadev Billa
Neural networks gain capabilities during training, but the internal changes that precede capability acquisition are not well understood. In particular, the relationship between geo…