3 papers
cs.CL2025
Evaluating Cultural Knowledge Processing in Large Language Models: A Cognitive Benchmarking Framework Integrating Retrieval-Augmented Generation
Hung-Shin Lee, Chen-Chi Chang, Ching-Yuan Chen +1
This study proposes a cognitive benchmarking framework to evaluate how large language models (LLMs) process and apply culturally specific knowledge. The framework integrates Bloom'…
cs.CL2025
Analyzing Information-Seeking Behaviors in a Hakka AI Chatbot: A Cognitive-Pragmatic Study
Chu-Hsuan Lee, Chen-Chi Chang, Hung-Shin Lee +2
With many endangered languages at risk of disappearing, efforts to preserve them now rely more than ever on using technology alongside culturally informed teaching strategies. This…
cs.CL2024
Benchmarking Cognitive Domains for LLMs: Insights from Taiwanese Hakka Culture
Chen-Chi Chang, Ching-Yuan Chen, Hung-Shin Lee +1
This study introduces a comprehensive benchmark designed to evaluate the performance of large language models (LLMs) in understanding and processing cultural knowledge, with a spec…