8 citations · 20 across the 12 of their papers we have counts for
12 papers
Sentence Curve Language Models
DongNyeong Heo, Taehwan Kim, Heeyoul Choi
Language models (LMs) are a central component of modern AI systems, and diffusion language models (DLMs) have recently emerged as a competitive alternative. Both paradigms rely on…
Dynamic Preference Multi-Objective Reinforcement Learning for Internet Network Management
DongNyeong Heo, Daniela Noemi Rim, Heeyoul Choi
An internet network service provider manages its network with multiple objectives, such as high quality of service (QoS) and minimum computing resource usage. To achieve these obje…
Data Augmentation With Back translation for Low Resource languages: A case of English and Luganda
Richard Kimera, Dongnyeong Heo, Daniela N. Rim +1
In this paper,we explore the application of Back translation (BT) as a semi-supervised technique to enhance Neural Machine Translation(NMT) models for the English-Luganda language…
Generalized Probabilistic Attention Mechanism in Transformers
DongNyeong Heo, Heeyoul Choi
The Transformer architecture has become widely adopted due to its demonstrated success, attributed to the attention mechanism at its core. Despite these successes, the attention me…
N-gram Prediction and Word Difference Representations for Language Modeling
DongNyeong Heo, Daniela Noemi Rim, Heeyoul Choi
Causal language modeling (CLM) serves as the foundational framework underpinning remarkable successes of recent large language models (LLMs). Despite its success, the training appr…
Shared Latent Space by Both Languages in Non-Autoregressive Neural Machine Translation
DongNyeong Heo, Heeyoul Choi
Non-autoregressive neural machine translation (NAT) offers substantial translation speed up compared to autoregressive neural machine translation (AT) at the cost of translation qu…
Advanced Scaling Methods for VNF deployment with Reinforcement Learning
Namjin Seo, DongNyeong Heo, Heeyoul Choi
Network function virtualization (NFV) and software-defined network (SDN) have become emerging network paradigms, allowing virtualized network function (VNF) deployment at a low cos…
End-to-End Training for Back-Translation with Categorical Reparameterization Trick
DongNyeong Heo, Heeyoul Choi
Back-translation (BT) is an effective semi-supervised learning framework in neural machine translation (NMT). A pre-trained NMT model translates monolingual sentences and makes syn…
Sequential Deep Learning Architectures for Anomaly Detection in Virtual Network Function Chains
Chungjun Lee, Jibum Hong, DongNyeong Heo +1
Software-defined networking (SDN) and network function virtualization (NFV) have enabled the efficient provision of network service. However, they also raised new tasks to monitor…
Adversarial Training with Contrastive Learning in NLP
Daniela N. Rim, DongNyeong Heo, Heeyoul Choi
For years, adversarial training has been extensively studied in natural language processing (NLP) settings. The main goal is to make models robust so that similar inputs derive in…
Reinforcement Learning of Graph Neural Networks for Service Function Chaining
DongNyeong Heo, Doyoung Lee, Hee-Gon Kim +2
In the management of computer network systems, the service function chaining (SFC) modules play an important role by generating efficient paths for network traffic through physical…
Graph Neural Network based Service Function Chaining for Automatic Network Control
DongNyeong Heo, Stanislav Lange, Hee-Gon Kim +1
Software-defined networking (SDN) and the network function virtualization (NFV) led to great developments in software based control technology by decreasing expenditures. Service f…