Explainable AI for Pre-Trained Code Models: What Do They Learn? When They Do Not Work?

Ahmad Haji Mohammadkhani, Chakkrit Tantithamthavorn, Hadi Hemmati

In recent years, there has been a wide interest in designing deep neural network-based models that automate downstream software engineering tasks on source code, such as code docum…