Characterize Then Distill: Mechanistic Reasoning in Large Output Spaces

Debjyoti Saha Roy, Byron C. Wallace, Javed A. Aslam

Reasoning-trained language models can select, zero-shot, a small set of relevant labels from thousands to hundreds of thousands of candidates. We ask how they do it mechanistically…