27 citations · 40 across the 5 of their papers we have counts for
5 papers
GPQA: A Graduate-Level Google-Proof Q&A Benchmark
David Rein, Betty Li Hou, Asa Cooper Stickland +5
We present GPQA, a challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry. We ensure that the questions are high-quality…
Do Language Models Learn Position-Role Mappings?
Jackson Petty, Michael Wilson, Robert Frank
How is knowledge of position-role mappings in natural language learned? We explore this question in a computational setting, testing whether a variety of well-performing pertained…
Transformers Generalize Linearly
Jackson Petty, Robert Frank
Natural language exhibits patterns of hierarchically governed dependencies, in which relations between words are sensitive to syntactic structure rather than linear ordering. While…
Sequence-to-Sequence Networks Learn the Meaning of Reflexive Anaphora
Robert Frank, Jackson Petty
Reflexive anaphora present a challenge for semantic interpretation: their meaning varies depending on context in a way that appears to require abstract variables. Past work has rai…
Optimal monohedral tilings of hyperbolic surfaces
Leonardo Di Giosia, Jahangir Habib, Jack Hirsch +6
The hexagon is the least-perimeter tile in the Euclidean plane for any given area. On hyperbolic surfaces, this "isoperimetric" problem differs for every given area, as solutions d…