4 papers
Exploring Multimodal Perception in Large Language Models Through Perceptual Strength Ratings
Jonghyun Lee, Dojun Park, Jiwoo Lee +2
This study investigated whether multimodal large language models can achieve human-like sensory grounding by examining their ability to capture perceptual strength ratings across s…
Evaluating Large language models on Understanding Korean indirect Speech acts
Youngeun Koo, Jiwoo Lee, Dojun Park +2
To accurately understand the intention of an utterance is crucial in conversational communication. As conversational artificial intelligence models are rapidly being developed and…
Pragmatic Competence Evaluation of Large Language Models for the Korean Language
Dojun Park, Jiwoo Lee, Hyeyun Jeong +2
Benchmarks play a significant role in the current evaluation of Large Language Models (LLMs), yet they often overlook the models' abilities to capture the nuances of human language…
MultiPragEval: Multilingual Pragmatic Evaluation of Large Language Models
Dojun Park, Jiwoo Lee, Seohyun Park +5
As the capabilities of Large Language Models (LLMs) expand, it becomes increasingly important to evaluate them beyond basic knowledge assessment, focusing on higher-level language…