3 citations · 8 across the 7 of their papers we have counts for
7 papers
Kanana: Compute-efficient Bilingual Language Models
Kanana LLM Team, Yunju Bak, Hojin Lee +26
We introduce Kanana, a series of bilingual language models that demonstrate exceeding performance in Korean and competitive performance in English. The computational cost of Kanana…
TLCR: Token-Level Continuous Reward for Fine-grained Reinforcement Learning from Human Feedback
Eunseop Yoon, Hee Suk Yoon, SooHwan Eom +7
Reinforcement Learning from Human Feedback (RLHF) leverages human preference data to train language models to align more closely with human essence. These human preference data, ho…
Binary Classifier Optimization for Large Language Model Alignment
Seungjae Jung, Gunsoo Han, Daniel Wontae Nam +1
In real-world services such as ChatGPT, aligning models based on user feedback is crucial for improving model performance. However, due to the simplicity and convenience of providi…
Hexa: Self-Improving for Knowledge-Grounded Dialogue System
Daejin Jo, Daniel Wontae Nam, Gunsoo Han +4
A common practice in knowledge-grounded dialogue generation is to explicitly utilize intermediate steps (e.g., web-search, memory retrieval) with modular approaches. However, data…
Effortless Integration of Memory Management into Open-Domain Conversation Systems
Eunbi Choi, Kyoung-Woon On, Gunsoo Han +6
Open-domain conversation systems integrate multiple conversation skills into a single system through a modular approach. One of the limitations of the system, however, is the absen…
LECO: Learnable Episodic Count for Task-Specific Intrinsic Reward
Daejin Jo, Sungwoong Kim, Daniel Wontae Nam +4
Episodic count has been widely used to design a simple yet effective intrinsic motivation for reinforcement learning with a sparse reward. However, the use of episodic count in a h…
GMAC: A Distributional Perspective on Actor-Critic Framework
Daniel Wontae Nam, Younghoon Kim, Chan Y. Park
In this paper, we devise a distributional framework on actor-critic as a solution to distributional instability, action type restriction, and conflation between samples and statist…