activity
20212024
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 594 across the 6 of their papers we have counts for

collaborators

6 papers

cs.CY2024

Can LLMs Identify Gaps and Misconceptions in Students' Code Explanations?

Priti Oli, Rabin Banjade, Andrew M. Olney +1

This paper investigates various approaches using Large Language Models (LLMs) to identify gaps and misconceptions in students' self-explanations of specific instructional material,…

cs.CY2024

Explaining Code Examples in Introductory Programming Courses: LLM vs Humans

Arun-Balajiee Lekshmi-Narayanan, Priti Oli, Jeevan Chapagain +4

Worked examples, which present an explained code for solving typical programming problems are among the most popular types of learning content in programming classes. Most approach…

cs.CY2023★ 3 cited

Automated Assessment of Students' Code Comprehension using LLMs

Priti Oli, Rabin Banjade, Jeevan Chapagain +1

Assessing student's answers and in particular natural language answers is a crucial challenge in the field of education. Advances in machine learning, including transformer-based m…

cs.SE2023★ 1 cited

The Behavior of Large Language Models When Prompted to Generate Code Explanations

Priti Oli, Rabin Banjade, Jeevan Chapagain +1

This paper systematically investigates the generation of code explanations by Large Language Models (LLMs) for code examples commonly encountered in introductory programming course…

cs.CL2022★ 565 cited

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448

Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…

cs.CL2021★ 25 cited

NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation

Kaustubh D. Dhole, Varun Gangal, Sebastian Gehrmann +122

Data augmentation is an important component in the robustness evaluation of models in natural language processing (NLP) and in enhancing the diversity of the data they are trained…