CodeT5-RNN: Reinforcing Contextual Embeddings for Enhanced Code Comprehension

Md Mostafizer Rahman, Ariful Islam Shiplu, Yutaka Watanobe +3

Contextual embeddings generated by LLMs exhibit strong positional inductive biases, which can limit their ability to fully capture long-range, order-sensitive dependencies in highl…