activity
20182025
most citedExploring the Benefits of Training Expert Language Models over Instruction Tuning

20 citations · 29 across the 12 of their papers we have counts for

collaborators

12 papers

cs.AI2025

Hybrid Deep Searcher: Scalable Parallel and Sequential Search Reasoning

Dayoon Ko, Jihyuk Kim, Haeju Park +6

Large reasoning models (LRMs) combined with retrieval-augmented generation (RAG) have enabled deep research agents capable of multi-step reasoning with external knowledge retrieval…

cs.CL2024

The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models

Seungone Kim, Juyoung Suk, Ji Yong Cho +29

As language models (LMs) become capable of handling a wide range of tasks, their evaluation is becoming as challenging as their development. Most generation benchmarks currently as…

cs.CL2024★ 7 cited

Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models

Seungone Kim, Juyoung Suk, Shayne Longpre +7

Proprietary LMs such as GPT-4 are often employed to assess the quality of responses from various LMs. However, concerns including transparency, controllability, and affordability s…

cs.CL2024★ 1 cited

Reinforcement Learning from Reflective Feedback (RLRF): Aligning and Improving LLMs via Fine-Grained Self-Reflection

Kyungjae Lee, Dasol Hwang, Sunghyun Park +2

Despite the promise of RLHF in aligning LLMs with human preferences, it often leads to superficial alignment, prioritizing stylistic changes over improving downstream performance o…

cs.CL2023

On Monotonic Aggregation for Open-domain QA

Sang-eun Han, Yeonseok Jeong, Seung-won Hwang +1

Question answering (QA) is a critical task for speech-based retrieval from knowledge sources, by sifting only the answers without requiring to read supporting documents. Specifical…

cs.CL2023

When to Read Documents or QA History: On Unified and Selective Open-domain QA

Kyungjae Lee, Sang-eun Han, Seung-won Hwang +1

This paper studies the problem of open-domain question answering, with the aim of answering a diverse range of questions leveraging knowledge resources. Two types of sources, QA-pa…

cs.AI2023

Evidentiality-aware Retrieval for Overcoming Abstractiveness in Open-Domain Question Answering

Yongho Song, Dahyun Lee, Myungha Jang +4

The long-standing goal of dense retrievers in abtractive open-domain question answering (ODQA) tasks is to learn to capture evidence passages among relevant passages for any given…

cs.CL2023★ 20 cited

Exploring the Benefits of Training Expert Language Models over Instruction Tuning

Joel Jang, Seungone Kim, Seonghyeon Ye +5

Recently, Language Models (LMs) instruction-tuned on multiple tasks, also known as multitask-prompted fine-tuning (MT), have shown the capability to generalize to unseen tasks. Pre…

cs.CL2022

Plug-and-Play Adaptation for Continuously-updated QA

Kyungjae Lee, Wookje Han, Seung-won Hwang +3

Language models (LMs) have shown great potential as implicit knowledge bases (KBs). And for their practical use, knowledge in LMs need to be updated periodically. However, existing…

cs.CL2021

Robustifying Multi-hop QA through Pseudo-Evidentiality Training

Kyungjae Lee, Seung-won Hwang, Sang-eun Han +1

This paper studies the bias problem of multi-hop question answering models, of answering correctly without correct reasoning. One way to robustify these models is by supervising to…

cs.CL2019

Categorical Metadata Representation for Customized Text Classification

Jihyeok Kim, Reinald Kim Amplayo, Kyungjae Lee +3

The performance of text classification has improved tremendously using intelligently engineered neural-based models, especially those injecting categorical metadata as additional i…

cs.CL2018★ 1 cited

Translations as Additional Contexts for Sentence Classification

Reinald Kim Amplayo, Kyungjae Lee, Jinyeong Yeo +1

In sentence classification tasks, additional contexts, such as the neighboring sentences, may improve the accuracy of the classifier. However, such contexts are domain-dependent an…