2 papers
cs.CL2021
The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Color
Cory Paik, Stéphane Aroca-Ouellette, Alessandro Roncone +1
Recent work has raised concerns about the inherent limitations of text-only pretraining. In this paper, we first demonstrate that reporting bias, the tendency of people to not stat…
cs.CL2021
PROST: Physical Reasoning of Objects through Space and Time
Stéphane Aroca-Ouellette, Cory Paik, Alessandro Roncone +1
We present a new probing dataset named PROST: Physical Reasoning about Objects Through Space and Time. This dataset contains 18,736 multiple-choice questions made from 14 manually…