most citedDo LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmark

36 citations · 36 across the 4 of their papers we have counts for

collaborators
Showing cs.CLShow all

2 papers · 1 filter

cs.CL2026

Failure of contextual invariance in large language models

Sagar Kumar, Ariel Flint, Luca Maria Aiello +1

Standard evaluation practices assume that large language model (LLM) outputs are stable when prompts are embedded in contextually equivalent discourses. Here, we test this assumpti…

cs.CL2023★ 36 cited

Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmark

Minje Choi, Jiaxin Pei, Sagar Kumar +2

Large language models (LLMs) have been shown to perform well at a variety of syntactic, discourse, and reasoning tasks. While LLMs are increasingly deployed in many forms including…