5 papers
Stronger Alignment between Brain Activity and LLM Embeddings during Code Writing compared to Prose Writing
Zachary Karas, Catie Chang, Kevin Leach +1
Programming is a critical skill underlying modern software systems, yet the cognitive processes supporting code writing are only beginning to be understood, limiting educational pr…
Enhancing Code LLM Training with Programmer Attention
Yifan Zhang, Chen Huang, Zachary Karas +3
Human attention provides valuable yet underexploited signals for code LLM training, offering a perspective beyond purely machine-driven attention. Despite the complexity and cost o…
Programmer Visual Attention During Context-Aware Code Summarization
Robert Wallace, Aakash Bansal, Zachary Karas +4
Abridged: Programmer attention represents the visual focus of programmers on parts of the source code in pursuit of programming tasks. We conducted an in-depth human study with 10…
EyeTrans: Merging Human and Machine Attention for Neural Code Summarization
Yifan Zhang, Jiliang Li, Zachary Karas +5
Neural code summarization leverages deep learning models to automatically generate brief natural language summaries of code snippets. The development of Transformer models has led…
Do Machines and Humans Focus on Similar Code? Exploring Explainability of Large Language Models in Code Summarization
Jiliang Li, Yifan Zhang, Zachary Karas +3
Recent language models have demonstrated proficiency in summarizing source code. However, as in many other domains of machine learning, language models of code lack sufficient expl…