4 papers
Chain-of-Thought Entropy as a Reliability Signal: A Preregistered Reproduction
Theodore O. Cochran
This empirical study is an independent reproduction of the dissociation Zhao reported in 2026. The shape of a large language model's chain-of-thought entropy trajectory predicts wh…
No Detectable Change in Side-Level WER from Prompt-Level Context: A Preregistered Ablation on a Production Oral-History Corpus
Theodore O. Cochran, Stephanie Dodson, Keith Nore
Supplying context at inference time to a large multimodal model is an inexpensive lever for adapting speech transcription to a domain, and earlier results on smaller models reporte…
Progressive Disclosure for LLM-Maintained Wiki Knowledge Bases: a Preregistered Ablation
Theodore O. Cochran
LLM agents now often answer questions from knowledge bases they help maintain. A common intuition says progressive disclosure should make this cheaper. Instead of loading one large…
Single-Round Vector RAG vs an LLM-Compiled Wiki: A Preregistered Comparison on a Small Multi-Domain Research Corpus
Theodore O. Cochran
We preregistered a comparison of two ways to help an LLM answer questions over a small research corpus: single-round Vector RAG and an LLM-compiled markdown wiki browsed by a tool-…