10 citations · 10 across the 2 of their papers we have counts for
2 papers
cs.SE2022★ 10 cited
Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Code
Changan Niu, Chuanyi Li, Bin Luo +1
Recent years have seen the successful application of deep learning to software engineering (SE). In particular, the development and use of pre-trained models of source code has ena…
cs.CV2021
Delving into Variance Transmission and Normalization: Shift of Average Gradient Makes the Network Collapse
Yuxiang Liu, Jidong Ge, Chuanyi Li +1
Normalization operations are essential for state-of-the-art neural networks and enable us to train a network from scratch with a large learning rate (LR). We attempt to explain the…