140 citations · 155 across the 8 of their papers we have counts for
8 papers
Teaching Language Models How to Code Like Learners: Conversational Serialization for Student Simulation
Charles Koutcheme, Juho Leinonen, Arto Hellas
Artificial students -- models that simulate how learners act and respond within educational systems -- are a promising tool for evaluating tutoring strategies and feedback mechanis…
Narrowing the Gap: Supervised Fine-Tuning of Open-Source LLMs as a Viable Alternative to Proprietary Models for Pedagogical Tools
Lorenzo Lee Solano, Charles Koutcheme, Juho Leinonen +2
Frontier Large language models (LLMs) like ChatGPT and Gemini can decipher cryptic compiler errors for novice programmers, but their computational scale, cost, and tendency to over…
Comparing the Utility, Preference, and Performance of Course Material Search Functionality and Retrieval-Augmented Generation Large Language Model (RAG-LLM) AI Chatbots in Information-Seeking Tasks
Leonardo Pasquarelli, Charles Koutcheme, Arto Hellas
Providing sufficient support for students requires substantial resources, especially considering the growing enrollment numbers. Students need help in a variety of tasks, ranging f…
Evaluating Language Models for Generating and Judging Programming Feedback
Charles Koutcheme, Nicola Dainese, Arto Hellas +4
The emergence of large language models (LLMs) has transformed research and practice across a wide range of domains. Within the computing education research (CER) domain, LLMs have…
Benchmarking Educational Program Repair
Charles Koutcheme, Nicola Dainese, Sami Sarsa +3
The emergence of large language models (LLMs) has sparked enormous interest due to their potential application across a range of educational tasks. For example, recent work in prog…
Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge
Charles Koutcheme, Nicola Dainese, Sami Sarsa +3
Large language models (LLMs) have shown great potential for the automatic generation of feedback in a wide range of computing contexts. However, concerns have been voiced around th…
Let's Ask AI About Their Programs: Exploring ChatGPT's Answers To Program Comprehension Questions
Teemu Lehtinen, Charles Koutcheme, Arto Hellas
Recent research has explored the creation of questions from code submitted by students. These Questions about Learners' Code (QLCs) are created through program analysis, exploring…
Exploring the Responses of Large Language Models to Beginner Programmers' Help Requests
Arto Hellas, Juho Leinonen, Sami Sarsa +3
Background and Context: Over the past year, large language models (LLMs) have taken the world by storm. In computing education, like in other walks of life, many opportunities and…