3 citations · 3 across the 5 of their papers we have counts for
9 papers · 1 filter
Improving Instruct Models for Free: A Study on Partial Adaptation
Ozan İrsoy, Pengxiang Cheng, Jennifer L. Chen +3
Instruct models, obtained from various instruction tuning or post-training steps, are commonly deemed superior and more usable than their base counterpart. While the model gains in…
MixCE: Training Autoregressive Language Models by Mixing Forward and Reverse Cross-Entropies
Shiyue Zhang, Shijie Wu, Ozan Irsoy +4
Autoregressive language models are trained by minimizing the cross-entropy of the model distribution Q relative to the data distribution P -- that is, minimizing the forward cross-…
Disentangling Online Chats with DAG-Structured LSTMs
Duccio Pappadopulo, Lisa Bauer, Marco Farina +2
Many modern messaging systems allow fast and synchronous textual communication among many users. The resulting sequence of messages hides a more complicated structure in which inde…
Diversity-Aware Batch Active Learning for Dependency Parsing
Tianze Shi, Adrian Benton, Igor Malioutov +1
While the predictive performance of modern statistical dependency parsers relies heavily on the availability of expensive expert-annotated treebank data, not all annotations contri…
Learning Syntax from Naturally-Occurring Bracketings
Tianze Shi, Ozan İrsoy, Igor Malioutov +1
Naturally-occurring bracketings, such as answer fragments to natural language questions and hyperlinks on webpages, can reflect human syntactic intuition regarding phrasal boundari…
Corrected CBOW Performs as well as Skip-gram
Ozan İrsoy, Adrian Benton, Karl Stratos
Mikolov et al. (2013a) observed that continuous bag-of-words (CBOW) word embeddings tend to underperform Skip-gram (SG) embeddings, and this finding has been reported in subsequent…