3 papers
cs.CL2025
Evaluating Large language models on Understanding Korean indirect Speech acts
Youngeun Koo, Jiwoo Lee, Dojun Park +2
To accurately understand the intention of an utterance is crucial in conversational communication. As conversational artificial intelligence models are rapidly being developed and…
cs.CL2024
Pragmatic Competence Evaluation of Large Language Models for the Korean Language
Dojun Park, Jiwoo Lee, Hyeyun Jeong +2
Benchmarks play a significant role in the current evaluation of Large Language Models (LLMs), yet they often overlook the models' abilities to capture the nuances of human language…
cs.CL2024
MultiPragEval: Multilingual Pragmatic Evaluation of Large Language Models
Dojun Park, Jiwoo Lee, Seohyun Park +5
As the capabilities of Large Language Models (LLMs) expand, it becomes increasingly important to evaluate them beyond basic knowledge assessment, focusing on higher-level language…