Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
A Multi-Model Adaptation of Speculative Decoding for Classification
Somnath Roy, Padharthi Sreekar, Srivatsa Narasimha +1
The current study introduces a novel adaptation of speculative decoding, repurposed from generation to classification tasks. We propose a multi-model framework employing up to thre…
cs.CL2023
Understanding the Impact of Post-Training Quantization on Large Language Models
Somnath Roy
Large language models (LLMs) are rapidly increasing in size, with the number of parameters becoming a key factor in the success of many commercial models, such as ChatGPT, Claude,…