5 citations · 8 across the 8 of their papers we have counts for
8 papers
A.X K2 Technical Report
Cheolseung Baek, Dhammiko Arya, Eunki Kim +40
We introduce A.X K2, a 688B-parameter Mixture-of-Experts (MoE) language model trained from scratch as a high-performance foundation for \emph{agentic} applications. Trained on appr…
Explain in Your Own Words: Improving Reasoning via Token-Selective Dual Knowledge Distillation
Minsang Kim, Seung Jun Baek
Knowledge Distillation (KD) can transfer the reasoning abilities of large models to smaller ones, which can reduce the costs to generate Chain-of-Thoughts for reasoning tasks. KD m…
Syntriever: How to Train Your Retriever with Synthetic Data from LLMs
Minsang Kim, Seungjun Baek
LLMs have boosted progress in many AI applications. Recently, there were attempts to distill the vast knowledge of LLMs into information retrieval systems. Those distillation metho…
Exploring Large Language Models on Cross-Cultural Values in Connection with Training Methodology
Minsang Kim, Seungjun Baek
Large language models (LLMs) closely interact with humans, and thus need an intimate understanding of the cultural values of human society. In this paper, we explore how open-sourc…
QPaug: Question and Passage Augmentation for Open-Domain Question Answering of LLMs
Minsang Kim, Cheoneum Park, Seungjun Baek
Retrieval-augmented generation (RAG) has received much attention for Open-domain question-answering (ODQA) tasks as a means to compensate for the parametric knowledge of large lang…
Measuring Sample Importance in Data Pruning for Language Models based on Information Entropy
Minsang Kim, Seungjun Baek
Compute-efficient training of language models has become an important issue. We consider data pruning for data-efficient training of LLMs. In this work, we consider a data pruning…
Hierarchical Position Embedding of Graphs with Landmarks and Clustering for Link Prediction
Minsang Kim, Seungjun Baek
Learning positional information of nodes in a graph is important for link prediction tasks. We propose a representation of positional information using representative nodes called…
Persona-Knowledge Dialogue Multi-Context Retrieval and Enhanced Decoding Methods
Min Sik Oh, Min Sang Kim
Persona and Knowledge dual context open-domain chat is a novel dialogue generation task introduced recently. While Persona and Knowledge is each interesting context of open-domain…