27 citations · 109 across the 23 of their papers we have counts for
5 papers · 1 filter
Self-Assessment Tests are Unreliable Measures of LLM Personality
Akshat Gupta, Xiaoyang Song, Gopala Anumanchipalli
As large language models (LLM) evolve in their capabilities, various recent studies have tried to quantify their behavior using psychological tools created to study human behavior.…
Are ChatGPT and GPT-4 Good Poker Players? -- A Pre-Flop Analysis
Akshat Gupta
Since the introduction of ChatGPT and GPT-4, these models have been tested across a large number of tasks. Their adeptness across domains is evident, but their aptitude in playing…
Probing Quantifier Comprehension in Large Language Models: Another Example of Inverse Scaling
Akshat Gupta
With their increasing size, large language models (LLMs) are becoming increasingly good at language understanding tasks. But even with high performance on specific downstream task,…
Have Large Language Models Developed a Personality?: Applicability of Self-Assessment Tests in Measuring Personality in LLMs
Xiaoyang Song, Akshat Gupta, Kiyan Mohebbizadeh +2
Have Large Language Models (LLMs) developed a personality? The short answer is a resounding "We Don't Know!". In this paper, we show that we do not yet have the right tools to meas…
REFinD: Relation Extraction Financial Dataset
Simerjot Kaur, Charese Smiley, Akshat Gupta +5
A number of datasets for Relation Extraction (RE) have been created to aide downstream tasks such as information retrieval, semantic search, question answering and textual entailme…