23 citations · 56 across the 19 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.CL2026
No More Free Lunch: Corpus Task Complexity Matters as Corpora Grow
Prasann Singhal, Amanda Bertsch, Jacob Steinhardt +1
Given a large corpus, the questions one might ask can vary -- from "When was the first human heart transplant?" to "What are all the contradictory claims in this literature?" -- bu…
cs.CL2026
Cracks in the Foundation: Seemingly Minor Architectural Choices Impact Long Context Extension
Amanda Bertsch, Luca Soldaini, Matthew R. Gormley +4
One might imagine that architectural variations within the dense transformer paradigm have a limited effect on accuracy. However, we demonstrate that this is not the case in the lo…