13 citations · 23 across the 7 of their papers we have counts for
3 papers · 1 filter
Understanding the Role of Temperature in Diverse Question Generation by GPT-4
Arav Agarwal, Karthik Mittal, Aidan Doyle +5
We conduct a preliminary study of the effect of GPT's temperature parameter on the diversity of GPT4-generated questions. We find that using higher temperature values leads to sign…
Can GPT-4 Support Analysis of Textual Data in Tasks Requiring Highly Specialized Domain Expertise?
Jaromir Savelka, Kevin D. Ashley, Morgan A Gray +2
We evaluated the capability of generative pre-trained transformers~(GPT-4) in analysis of textual data in tasks that require highly specialized domain expertise. Specifically, we f…
Large Language Models (GPT) Struggle to Answer Multiple-Choice Questions about Code
Jaromir Savelka, Arav Agarwal, Christopher Bogart +1
We analyzed effectiveness of three generative pre-trained transformer (GPT) models in answering multiple-choice question (MCQ) assessments, often involving short snippets of code,…