3 papers
cs.CL2024
SelECT-SQL: Self-correcting ensemble Chain-of-Thought for Text-to-SQL
Ke Shen, Mayank Kejriwal
In recent years,Text-to-SQL, the problem of automatically converting questions posed in natural language to formal SQL queries, has emerged as an important problem at the intersect…
cs.CL2024
Defining and Evaluating Decision and Composite Risk in Language Models Applied to Natural Language Inference
Ke Shen, Mayank Kejriwal
Despite their impressive performance, large language models (LLMs) such as ChatGPT are known to pose important risks. One such set of risks arises from misplaced confidence, whethe…
cs.CL2024
An Evaluation of Estimative Uncertainty in Large Language Models
Zhisheng Tang, Ke Shen, Mayank Kejriwal
Words of estimative probability (WEPs), such as ''maybe'' or ''probably not'' are ubiquitous in natural language for communicating estimative uncertainty, compared with direct stat…