When Less is Enough: Efficient Inference via Collaborative Reasoning

Yilei Chen, Sharut Gupta, Yannis Paschalidis +2

In this work, we introduce DUET (Dual-model Efficient Two-stage inference), a collaborative inference framework in which a capable model and a lightweight model work together to so…