16 citations · 19 across the 6 of their papers we have counts for
7 papers
Latent Reasoning via Sentence Embedding Prediction
Hyeonbin Hwang, Byeongguk Jeon, Seungone Kim +7
Autoregressive language models (LMs) generate one token at a time, yet human reasoning operates over higher-level abstractions - sentences, propositions, and concepts. This contras…
Characterizing Pattern Matching and Its Limits on Compositional Task Structures
Hoyeon Chang, Jinho Park, Hanseul Cho +7
Despite impressive capabilities, LLMs' successes often rely on pattern-matching behaviors, yet these are also linked to OOD generalization failures in compositional tasks. However,…
Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition
Jiyeon Kim, Hyunji Lee, Hyowon Cho +6
In this work, we investigate how a model's tendency to broadly integrate its parametric knowledge evolves throughout pretraining, and how this behavior affects overall performance,…
CrossAug: A Contrastive Data Augmentation Method for Debiasing Fact Verification Models
Minwoo Lee, Seungpil Won, Juae Kim +3
Fact verification datasets are typically constructed using crowdsourcing techniques due to the lack of text sources with veracity labels. However, the crowdsourcing process often p…
Collaborative Training of GANs in Continuous and Discrete Spaces for Text Generation
Yanghoon Kim, Seungpil Won, Seunghyun Yoon +1
Applying generative adversarial networks (GANs) to text-related tasks is challenging due to the discrete nature of language. One line of research resolves this issue by employing r…
Detecting Incongruity Between News Headline and Body Text via a Deep Hierarchical Encoder
Seunghyun Yoon, Kunwoo Park, Joongbo Shin +4
Some news headlines mislead readers with overrated or false information, and identifying them in advance will better assist readers in choosing proper news stories to consume. This…
Partition-Merge: Distributed Inference and Modularity Optimization
Vincent Blondel, Kyomin Jung, Pushmeet Kohli +1
This paper presents a novel meta algorithm, Partition-Merge (PM), which takes existing centralized algorithms for graph computation and makes them distributed and faster. In a nuts…