A Multi-Model Adaptation of Speculative Decoding for Classification

Somnath Roy, Padharthi Sreekar, Srivatsa Narasimha +1

The current study introduces a novel adaptation of speculative decoding, repurposed from generation to classification tasks. We propose a multi-model framework employing up to thre…