4 papers
SCRIPT: A Subcharacter Compositional Representation Injection Module for Korean Pre-Trained Language Models
SungHo Kim, Juhyeong Park, Eda Atalay +1
Korean is a morphologically rich language with a featural writing system in which each character is systematically composed of subcharacter units known as Jamo. These subcharacters…
Handling Korean Out-of-Vocabulary Words with Phoneme Representation Learning
Nayeon Kim, Eojin Jeon, Jun-Hyung Park +1
In this study, we introduce KOPL, a novel framework for handling Korean OOV words with Phoneme representation Learning. Our work is based on the linguistic property of Korean as a…
Incorporating Domain Knowledge into Materials Tokenization
Yerim Oh, Jun-Hyung Park, Junho Kim +2
While language models are increasingly utilized in materials science, typical models rely on frequency-centric tokenization methods originally developed for natural language proces…
Polishing Every Facet of the GEM: Testing Linguistic Competence of LLMs and Humans in Korean
SungHo Kim, Nayeon Kim, Taehee Jeon +1
We introduce the , designed to assess the linguistic competence of LLMs and humans in K…