3 papers
cs.CL2025
Can Vision-Language Models Infer Speaker's Ignorance? The Role of Visual and Linguistic Cues
Ye-eun Cho, Yunho Maeng
This study investigates whether vision-language models (VLMs) can perform pragmatic inference, focusing on ignorance implicatures, utterances that imply the speaker's lack of preci…
cs.CL2025
The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models
Seungone Kim, Juyoung Suk, Ji Yong Cho +29
As language models (LMs) become capable of handling a wide range of tasks, their evaluation is becoming as challenging as their development. Most generation benchmarks currently as…
cs.CL2024
Pragmatic inference of scalar implicature by LLMs
Ye-eun Cho, Seong mook Kim
This study investigates how Large Language Models (LLMs), particularly BERT (Devlin et al., 2019) and GPT-2 (Radford et al., 2019), engage in pragmatic inference of scalar implicat…