21 citations · 80 across the 10 of their papers we have counts for
9 papers · 1 filter
A Technical Report for Polyglot-Ko: Open-Source Large-Scale Korean Language Models
Hyunwoong Ko, Kichang Yang, Minho Ryu +5
Polyglot is a pioneering project aimed at enhancing the non-English language performance of multilingual language models. Despite the availability of various multilingual models su…
An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks
Kyubyong Park, Joohong Lee, Seongbo Jang +1
Typically, tokenization is the very first step in most text processing works. As a token serves as an atomic unit that embeds the contextual information of text, how to define a to…
KoParadigm: A Korean Conjugation Paradigm Generator
Kyubyong Park
Korean is a morphologically rich language. Korean verbs change their forms in a fickle manner depending on tense, mood, speech level, meaning, etc. Therefore, it is challenging to…
KorNLI and KorSTS: New Benchmark Datasets for Korean Natural Language Understanding
Jiyeon Ham, Yo Joong Choe, Kyubyong Park +2
Natural language inference (NLI) and semantic textual similarity (STS) are key tasks in natural language understanding (NLU). Although several benchmark datasets for those tasks ha…
g2pM: A Neural Grapheme-to-Phoneme Conversion Package for Mandarin Chinese Based on a New Open Benchmark Dataset
Kyubyong Park, Seanie Lee
Conversion of Chinese graphemes to phonemes (G2P) is an essential component in Mandarin Chinese Text-To-Speech (TTS) systems. One of the biggest challenges in Chinese G2P conversio…
Jejueo Datasets for Machine Translation and Speech Synthesis
Kyubyong Park, Yo Joong Choe, Jiyeon Ham
Jejueo was classified as critically endangered by UNESCO in 2010. Although diverse efforts to revitalize it have been made, there have been few computational approaches. Motivated…
word2word: A Collection of Bilingual Lexicons for 3,564 Language Pairs
Yo Joong Choe, Kyubyong Park, Dongwoo Kim
We present word2word, a publicly available dataset and an open-source Python package for cross-lingual word translations extracted from sentence-level parallel corpora. Our dataset…
A Neural Grammatical Error Correction System Built On Better Pre-training and Sequential Transfer Learning
Yo Joong Choe, Jiyeon Ham, Kyubyong Park +1
Grammatical error correction can be viewed as a low-resource sequence-to-sequence task, because publicly available parallel corpora are limited. To tackle this challenge, we first…
CSS10: A Collection of Single Speaker Speech Datasets for 10 Languages
Kyubyong Park, Thomas Mulc
We describe our development of CSS10, a collection of single speaker speech datasets for ten languages. It is composed of short audio clips from LibriVox audiobooks and their align…