2 papers
cs.LG2026
A Bitter Lesson for Data Filtering
Christopher Mohri, John Duchi, Tatsunori Hashimoto
We investigate data filtering for large model pretraining via new scaling studies that target the high compute, data-scarce regime. In spite of an apparently common belief that fil…
cs.LG2024
Language Models with Conformal Factuality Guarantees
Christopher Mohri, Tatsunori Hashimoto
Guaranteeing the correctness and factuality of language model (LM) outputs is a major open problem. In this work, we propose conformal factuality, a framework that can ensure high…