activity
20122026
most citedThrilled by Your Progress! Large Language Models (GPT-4) No Longer Struggle to Pass Assessments in Higher Education Programming Courses

140 citations · 563 across the 18 of their papers we have counts for

collaborators
Showing cs.CLShow all

5 papers · 1 filter

cs.CL2024★ 13 cited

Understanding the Role of Temperature in Diverse Question Generation by GPT-4

Arav Agarwal, Karthik Mittal, Aidan Doyle +5

We conduct a preliminary study of the effect of GPT's temperature parameter on the diversity of GPT4-generated questions. We find that using higher temperature values leads to sign…

cs.CL2023★ 108 cited

Can GPT-4 Support Analysis of Textual Data in Tasks Requiring Highly Specialized Domain Expertise?

Jaromir Savelka, Kevin D. Ashley, Morgan A Gray +2

We evaluated the capability of generative pre-trained transformers~(GPT-4) in analysis of textual data in tasks that require highly specialized domain expertise. Specifically, we f…

cs.CL2023★ 4 cited

Large Language Models (GPT) Struggle to Answer Multiple-Choice Questions about Code

Jaromir Savelka, Arav Agarwal, Christopher Bogart +1

We analyzed effectiveness of three generative pre-trained transformer (GPT) models in answering multiple-choice question (MCQ) assessments, often involving short snippets of code,…

cs.CL2013★ 27 cited

Expressing Ethnicity through Behaviors of a Robot Character

Maxim Makatchev, Reid Simmons, Majd Sakr +1

Achieving homophily, or association based on similarity, between a human user and a robot holds a promise of improved perception and task performance. However, no previous studies…

cs.CL2012★ 4 cited

A Cross-cultural Corpus of Annotated Verbal and Nonverbal Behaviors in Receptionist Encounters

Maxim Makatchev, Reid Simmons, Majd Sakr

We present the first annotated corpus of nonverbal behaviors in receptionist interactions, and the first nonverbal corpus (excluding the original video and audio data) of service e…