From Probabilities to Decisions: Search and Multi-Teacher Distillation with Jev

Mohamad Yazan Sadoun, Sarah Sharif, Yaser Mike Banad

Probability-only models, which TypeSafe calls System One models, return calibrated probabilities for fixed choices in milliseconds and generate no text. We study one such model, Je…