8 citations · 20 across the 12 of their papers we have counts for
6 papers · 1 filter
Sentence Curve Language Models
DongNyeong Heo, Taehwan Kim, Heeyoul Choi
Language models (LMs) are a central component of modern AI systems, and diffusion language models (DLMs) have recently emerged as a competitive alternative. Both paradigms rely on…
Data Augmentation With Back translation for Low Resource languages: A case of English and Luganda
Richard Kimera, Dongnyeong Heo, Daniela N. Rim +1
In this paper,we explore the application of Back translation (BT) as a semi-supervised technique to enhance Neural Machine Translation(NMT) models for the English-Luganda language…
N-gram Prediction and Word Difference Representations for Language Modeling
DongNyeong Heo, Daniela Noemi Rim, Heeyoul Choi
Causal language modeling (CLM) serves as the foundational framework underpinning remarkable successes of recent large language models (LLMs). Despite its success, the training appr…
Shared Latent Space by Both Languages in Non-Autoregressive Neural Machine Translation
DongNyeong Heo, Heeyoul Choi
Non-autoregressive neural machine translation (NAT) offers substantial translation speed up compared to autoregressive neural machine translation (AT) at the cost of translation qu…
End-to-End Training for Back-Translation with Categorical Reparameterization Trick
DongNyeong Heo, Heeyoul Choi
Back-translation (BT) is an effective semi-supervised learning framework in neural machine translation (NMT). A pre-trained NMT model translates monolingual sentences and makes syn…
Adversarial Training with Contrastive Learning in NLP
Daniela N. Rim, DongNyeong Heo, Heeyoul Choi
For years, adversarial training has been extensively studied in natural language processing (NLP) settings. The main goal is to make models robust so that similar inputs derive in…