CSA-Trans: Code Structure Aware Transformer for AST

Saeyoon Oh, Shin Yoo

When applying the Transformer architecture to source code, designing a good self-attention mechanism is critical as it affects how node relationship is extracted from the Abstract…