5 papers
Dual Path Attribution: Efficient Attribution for SwiGLU-Transformers through Layer-Wise Target Propagation
Lasse Marten Jantsch, Dong-Jae Koh, Seonghyeon Lee +1
Understanding the internal mechanisms of transformer-based large language models (LLMs) is crucial for their reliable deployment and effective operation. While recent efforts have…
On the Effectiveness of Integration Methods for Multimodal Dialogue Response Retrieval
Seongbo Jang, Seonghyeon Lee, Dongha Lee +1
Multimodal chatbots have become one of the major topics for dialogue systems in both research community and industry. Recently, researchers have shed light on the multimodality of…
From What to Respond to When to Respond: Timely Response Generation for Open-domain Dialogue Agents
Seongbo Jang, Minjin Jeon, Jaehoon Lee +3
While research on dialogue response generation has primarily focused on generating coherent responses conditioning on textual context, the critical question of when to respond grou…
Verbosity-Aware Rationale Reduction: Effective Reduction of Redundant Rationale via Principled Criteria
Joonwon Jang, Jaehee Kim, Wonbin Kweon +2
Large Language Models (LLMs) rely on generating extensive intermediate reasoning units (e.g., tokens, sentences) to enhance final answer quality across a wide range of complex task…
How Diversely Can Language Models Solve Problems? Exploring the Algorithmic Diversity of Model-Generated Code
Seonghyeon Lee, Heejae Chon, Joonwon Jang +2
Language models (LMs) have exhibited impressive abilities in generating code from natural language requirements. In this work, we highlight the diversity of code generated by LMs a…