10 citations · 23 across the 9 of their papers we have counts for
1 paper · 1 filter
Yijin Liu, Xianfeng Zeng, Fandong Meng +1
Recently, DeepNorm scales Transformers into extremely deep (i.e., 1000 layers) and reveals the promising potential of deep scaling. To stabilize the training of deep models, DeepNo…