242 citations · 1.5k across the 60 of their papers we have counts for
8 papers · 2 filters
Language Modeling with Latent Situations
Belinda Z. Li, Maxwell Nye, Jacob Andreas
Language models (LMs) often generate incoherent outputs: they refer to events and entity states that are incompatible with the state of the world described in their inputs. We intr…
Language Models as Agent Models
Jacob Andreas
Language models (LMs) are trained on collections of documents, written by individual human agents to achieve specific goals in an outside world. During training, LMs have access on…
PromptBoosting: Black-Box Text Classification with Ten Forward Passes
Bairu Hou, Joe O'Connor, Jacob Andreas +2
We describe PromptBoosting, a query-efficient procedure for building a text classifier from a neural language model (LM) without access to the LM's parameters, gradients, or hidden…
Hierarchical Phrase-based Sequence-to-Sequence Learning
Bailin Wang, Ivan Titov, Jacob Andreas +1
We describe a neural transducer that maintains the flexibility of standard sequence-to-sequence (seq2seq) models while incorporating hierarchical phrases as a source of inductive b…
The Whole Truth and Nothing But the Truth: Faithful and Controllable Dialogue Response Generation with Dataflow Transduction and Constrained Decoding
Hao Fang, Anusha Balakrishnan, Harsh Jhamtani +7
In a real-world dialogue system, generated text must be truthful and informative while remaining fluent and adhering to a prescribed style. Satisfying these constraints simultaneou…
Identifying concept libraries from language about object structure
Catherine Wong, William P. McCarthy, Gabriel Grand +5
Our understanding of the visual world goes beyond naming objects, encompassing our ability to parse objects into meaningful parts, attributes, and relations. In this work, we lever…
Towards Tracing Factual Knowledge in Language Models Back to the Training Data
Ekin Akyürek, Tolga Bolukbasi, Frederick Liu +4
Language models (LMs) have been shown to memorize a great deal of factual knowledge contained in their training data. But when an LM generates an assertion, it is often difficult t…
Compositionality as Lexical Symmetry
Ekin Akyürek, Jacob Andreas
In tasks like semantic parsing, instruction following, and question answering, standard deep networks fail to generalize compositionally from small datasets. Many existing approach…