6 citations · 9 across the 10 of their papers we have counts for
3 papers · 1 filter
Lil-Bevo: Explorations of Strategies for Training Language Models in More Humanlike Ways
Venkata S Govindarajan, Juan Diego Rodriguez, Kaj Bostrom +1
We present Lil-Bevo, our submission to the BabyLM Challenge. We pretrained our masked language models with three ingredients: an initial pretraining with music data, training on sh…
MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning
Zayne Sprague, Xi Ye, Kaj Bostrom +2
While large language models (LLMs) equipped with techniques like chain-of-thought prompting have demonstrated impressive capabilities, they still fall short in their ability to rea…
Deductive Additivity for Planning of Natural Language Proofs
Zayne Sprague, Kaj Bostrom, Swarat Chaudhuri +1
Current natural language systems designed for multi-step claim validation typically operate in two phases: retrieve a set of relevant premise statements using heuristics (planning)…