FiRST: Finetuning Router-Selective Transformers for Input-Adaptive Latency Reduction

Akriti Jain, Saransh Sharma, Koyel Mukherjee +1

Auto-regressive Large Language Models (LLMs) demonstrate remarkable performance across different domains such as vision and language processing. However, due to sequential processi…