12 citations · 12 across the 6 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.SE2024
Does the Order of Fine-tuning Matter and Why?
Qihong Chen, Jiawei Li, Hyunjae Suh +5
To improve the performance on a target task, researchers have fine-tuned language models with an intermediate task before the target task of interest. However, previous works have…
cs.SE2024
Beyond Self-learned Attention: Mitigating Attention Bias in Transformer-based Models Using Attention Guidance
Jiri Gesi, Iftekhar Ahmed
Transformer-based models have demonstrated considerable potential for source code modeling tasks in software engineering. However, they are limited by their dependence solely on au…