16 citations · 26 across the 7 of their papers we have counts for
1 paper · 1 filter
Zhanpeng Zhou, Zijun Chen, Yilan Chen +2
The pretraining-finetuning paradigm has become the prevailing trend in modern deep learning. In this work, we discover an intriguing linear phenomenon in models that are initialize…