5 papers
Missing Pattern Recognized Diffusion Imputation Model for Missing Not At Random
Gyuwon Sim, Sumin Lee, Heesun Bae +5
Missing data frequently arises across diverse domains, including time-series and image domains. In the real world, missing occurrences often depend on the unobservable values thems…
Semantic-aware Wasserstein Policy Regularization for Large Language Model Alignment
Byeonghu Na, Hyungho Na, Yeongmin Kim +4
Large language models (LLMs) are commonly aligned with human preferences using reinforcement learning from human feedback (RLHF). In this method, LLM policies are generally optimiz…
Diffusion Adaptive Text Embedding for Text-to-Image Diffusion Models
Byeonghu Na, Minsang Park, Gyuwon Sim +6
Text-to-image diffusion models rely on text embeddings from a pre-trained text encoder, but these embeddings remain fixed across all diffusion timesteps, limiting their adaptabilit…
Preference Optimization by Estimating the Ratio of the Data Distribution
Yeongmin Kim, Heesun Bae, Byeonghu Na +1
Direct preference optimization (DPO) is widely used as a simple and stable method for aligning large language models (LLMs) with human preferences. This paper investigates a genera…
Distilling Dataset into Neural Field
Donghyeok Shin, HeeSun Bae, Gyuwon Sim +2
Utilizing a large-scale dataset is essential for training high-performance deep learning models, but it also comes with substantial computation and storage costs. To overcome these…