5 papers
K-EXAONE Technical Report
Eunbi Choi, Kibong Choi, Seokhee Hong +62
This technical report presents K-EXAONE, a large-scale multilingual language model developed by LG AI Research. K-EXAONE is built on a Mixture-of-Experts architecture with 236B tot…
EXAONE 4.0: Unified Large Language Models Integrating Non-reasoning and Reasoning Modes
Kyunghoon Bae, Eunbi Choi, Kibong Choi +37
This technical report introduces EXAONE 4.0, which integrates a Non-reasoning mode and a Reasoning mode to achieve both the excellent usability of EXAONE 3.5 and the advanced reaso…
LGAI-EMBEDDING-Preview Technical Report
Jooyoung Choi, Hyun Kim, Hansol Jang +6
This report presents a unified instruction-based framework for learning generalized text embeddings optimized for both information retrieval (IR) and non-IR tasks. Built upon a dec…
EXAONE Deep: Reasoning Enhanced Language Models
Kyunghoon Bae, Eunbi Choi, Kibong Choi +28
We present EXAONE Deep series, which exhibits superior capabilities in various reasoning tasks, including math and coding benchmarks. We train our models mainly on the reasoning-sp…
KL Penalty Control via Perturbation for Direct Preference Optimization
Sangkyu Lee, Janghoon Han, Hosung Song +3
Direct Preference Optimization (DPO) demonstrates the advantage of aligning a large language model with human preference using only an offline dataset. However, DPO has the limitat…