1 citations · 1 across the 8 of their papers we have counts for
4 papers · 1 filter
Accelerated Test-Time Scaling with Model-Free Speculative Sampling
Woomin Song, Saket Dingliwal, Sai Muralidhar Jayanthi +4
Language models have demonstrated remarkable capabilities in reasoning tasks through test-time scaling techniques like best-of-N sampling and tree search. However, these approaches…
Mamba Drafters for Speculative Decoding
Daewon Choi, Seunghyuk Oh, Saket Dingliwal +9
Speculative decoding has emerged as a promising approach to accelerating large language model (LLM) generation using a fast drafter while maintaining alignment with the target mode…
Salient Information Prompting to Steer Content in Prompt-based Abstractive Summarization
Lei Xu, Mohammed Asad Karim, Saket Dingliwal +1
Large language models (LLMs) can generate fluent summaries across domains using prompting techniques, reducing the need to train models for summarization applications. However, cra…
Sequential Editing for Lifelong Training of Speech Recognition Models
Devang Kulshreshtha, Saket Dingliwal, Brady Houston +2
Automatic Speech Recognition (ASR) traditionally assumes known domains, but adding data from a new domain raises concerns about computational inefficiencies linked to retraining mo…