37 citations · 38 across the 6 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2023★ 1 cited
Diversity Measures: Domain-Independent Proxies for Failure in Language Model Queries
Noel Ngu, Nathaniel Lee, Paulo Shakarian
Error prediction in large language models often relies on domain-specific information. In this paper, we present measures for quantification of error in the response of a large lan…
cs.CL2023★ 37 cited
An Independent Evaluation of ChatGPT on Mathematical Word Problems (MWP)
Paulo Shakarian, Abhinav Koyyalamudi, Noel Ngu +1
We study the performance of a commercially available large language model (LLM) known as ChatGPT on math word problems (MWPs) from the dataset DRAW-1K. To our knowledge, this is th…