1 citations · 1 across the 3 of their papers we have counts for
4 papers
Tampered ML: Evaluating LLM Judgment of Machine Learning Research
Soroush Ebadian, Parand A. Alamdari, Joe Benton +1
One approach to accelerating progress on AI alignment is to automate parts of alignment research itself. Doing so requires systems that can perform reliably on hard-to-supervise re…
Excess Description Length of Learning Generalizable Predictors
Elizabeth Donoway, Hailey Joren, Fabien Roger +1
Understanding whether fine-tuning elicits latent capabilities or teaches new ones is a fundamental question for language model evaluation and safety. We develop a formal informatio…
Classification with Conceptual Safeguards
Hailey Joren, Charles Marx, Berk Ustun
We propose a new approach to promote safety in classification tasks with established concepts. Our approach -- called a conceptual safeguard -- acts as a verification layer for mod…
Sufficient Context: A New Lens on Retrieval Augmented Generation Systems
Hailey Joren, Jianyi Zhang, Chun-Sung Ferng +3
Augmenting LLMs with context leads to improved performance across many applications. Despite much research on Retrieval Augmented Generation (RAG) systems, an open question is whet…