activity
20182022
most citedWhat do you learn from context? Probing for sentence structure in contextualized word representations

139 citations · 239 across the 8 of their papers we have counts for

collaborators

21 papers

cs.AI20227 cited

Evaluation Beyond Task Performance: Analyzing Concepts in AlphaZero in Hex

Charles Lovering, Jessica Zosa Forde, George Konidaris +2

AlphaZero, an approach to reinforcement learning that couples neural networks and Monte Carlo tree search (MCTS), has produced state-of-the-art strategies for traditional board gam…

cs.CL20211 cited

Does Vision-and-Language Pretraining Improve Lexical Grounding?

Tian Yun, Chen Sun, Ellie Pavlick

Linguistic representations derived from text alone have been criticized for their lack of grounding, i.e., connecting words to their meanings in the physical world. Vision-and-Lang…

cs.CL2021

Frequency Effects on Syntactic Rule Learning in Transformers

Jason Wei, Dan Garrette, Tal Linzen +1

Pre-trained language models perform well on a variety of linguistic tasks that require symbolic reasoning, raising the question of whether such models implicitly represent abstract…

cs.CV20211 cited

Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color

Mostafa Abdou, Artur Kulmizev, Daniel Hershcovich +3

Pretrained language models have been shown to encode relational information, such as the relations between entities or concepts in knowledge-bases -- (Paris, Capital, France). Howe…

cs.CL2021

Which Linguist Invented the Lightbulb? Presupposition Verification for Question-Answering

Najoung Kim, Ellie Pavlick, Burcu Karagol Ayan +1

Many Question-Answering (QA) datasets contain unanswerable questions, but their treatment in QA systems remains primitive. Our analysis of the Natural Questions (Kwiatkowski et al.…

cs.RO2020

Spatial Language Understanding for Object Search in Partially Observed City-scale Environments

Kaiyu Zheng, Deniz Bayazit, Rebecca Mathew +2

Humans use spatial language to naturally describe object locations and their relations. Interpreting spatial language not only adds a perceptual modality for robots, but also reduc…