Big Reasoning with Small Models: Instruction Retrieval at Inference Time

Kenan Alkiek, David Jurgens, Vinod Vydiswaran

Small language models (SLMs) enable low-cost, private, on-device inference, but they often fail on problems that require specialized domain knowledge or multi-step reasoning. Exist…