13 citations · 16 across the 8 of their papers we have counts for
Showing 2025Show all
2 papers · 1 filter
cs.CL2025
Facts in Stats: Impacts of Pretraining Diversity on Language Model Generalization
Tina Behnia, Puneesh Deora, Christos Thrampoulidis
Language models are pretrained on sequences that blend statistical regularities (making text fluent) with factual associations between specific tokens (knowledge of facts). While r…
cs.LG2025★ 1 cited
In-Context Occam's Razor: How Transformers Prefer Simpler Hypotheses on the Fly
Puneesh Deora, Bhavya Vasudeva, Tina Behnia +1
In-context learning (ICL) enables transformers to adapt to new tasks through contextual examples without parameter updates. While existing research has typically studied ICL in fix…