277 citations · 625 across the 29 of their papers we have counts for
9 papers · 2 filters
Prompt-Augmented Linear Probing: Scaling beyond the Limit of Few-shot In-Context Learners
Hyunsoo Cho, Hyuhng Joon Kim, Junyeob Kim +4
Through in-context learning (ICL), large-scale language models are effective few-shot learners without additional model fine-tuning. However, the ICL performance does not scale wel…
Can Current Task-oriented Dialogue Models Automate Real-world Scenarios in the Wild?
Sang-Woo Lee, Sungdong Kim, Donghyeon Ko +9
Task-oriented dialogue (TOD) systems are mainly based on the slot-filling-based TOD (SF-TOD) framework, in which dialogues are broken down into smaller, controllable units (i.e., s…
Keep Me Updated! Memory Management in Long-term Conversations
Sanghwan Bae, Donghyun Kwak, Soyoung Kang +7
Remembering important information from the past and continuing to talk about it in the present are crucial in long-term conversations. However, previous literature does not deal wi…
Continuous Decomposition of Granularity for Neural Paraphrase Generation
Xiaodong Gu, Zhaowei Zhang, Sang-Woo Lee +2
While Transformers have had significant success in paragraph generation, they treat sentences as linear sequences of tokens and often neglect their hierarchical information. Prior…
Leveraging Pre-Trained Language Models to Streamline Natural Language Interaction for Self-Tracking
Young-Ho Kim, Sungdong Kim, Minsuk Chang +1
Current natural language interaction for self-tracking tools largely depends on bespoke implementation optimized for a specific tracking theme and data format, which is neither gen…
Two-Step Question Retrieval for Open-Domain QA
Yeon Seonwoo, Juhee Son, Jiho Jin +4
The retriever-reader pipeline has shown promising performance in open-domain QA but suffers from a very slow inference speed. Recently proposed question retrieval models tackle thi…
On the Effect of Pretraining Corpora on In-context Learning by a Large-scale Language Model
Seongjin Shin, Sang-Woo Lee, Hwijeen Ahn +8
Many recent studies on large-scale language models have reported successful in-context zero- and few-shot learning ability. However, the in-depth analysis of when in-context learni…
Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Models
Sanghwan Bae, Donghyun Kwak, Sungdong Kim +4
Recent open-domain dialogue models have brought numerous breakthroughs. However, building a chat system is not scalable since it often requires a considerable volume of human-human…
Plug-and-Play Adaptation for Continuously-updated QA
Kyungjae Lee, Wookje Han, Seung-won Hwang +3
Language models (LMs) have shown great potential as implicit knowledge bases (KBs). And for their practical use, knowledge in LMs need to be updated periodically. However, existing…