140 citations · 563 across the 18 of their papers we have counts for
5 papers · 1 filter
AI Literacy Assessment Revisited: A Task-Oriented Approach Aligned with Real-world Occupations
Christopher Bogart, Aparna Warrier, Arav Agarwal +6
As artificial intelligence (AI) systems become ubiquitous in professional contexts, there is an urgent need to equip workers, often with backgrounds outside of STEM, with the skill…
AI Technicians: Developing Rapid Occupational Training Methods for a Competitive AI Workforce
Jaromir Savelka, Can Kultur, Arav Agarwal +4
The accelerating pace of developments in Artificial Intelligence~(AI) and the increasing role that technology plays in society necessitates substantial changes in the structure of…
A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Education
Jacob Doughty, Zipiao Wan, Anishka Bompelli +12
There is a constant need for educators to develop and maintain effective up-to-date assessments. While there is a growing body of research in computing education on utilizing large…
From GPT-3 to GPT-4: On the Evolving Efficacy of LLMs to Answer Multiple-choice Questions for Programming Classes in Higher Education
Jaromir Savelka, Arav Agarwal, Christopher Bogart +1
We explore the evolving efficacy of three generative pre-trained transformer (GPT) models in generating answers for multiple-choice questions (MCQ) from introductory and intermedia…
Thrilled by Your Progress! Large Language Models (GPT-4) No Longer Struggle to Pass Assessments in Higher Education Programming Courses
Jaromir Savelka, Arav Agarwal, Marshall An +2
This paper studies recent developments in large language models' (LLM) abilities to pass assessments in introductory and intermediate Python programming courses at the postsecondar…