76 citations · 100 across the 8 of their papers we have counts for
4 papers · 1 filter
Depth through Recurrence: Towards Ultra-Efficient On-Device ASR
Chen Feng, Tianyi Xu, Ramchalam Kinattinkara Ramakrishnan +5
Modern automatic speech recognition (ASR) systems have achieved remarkable accuracy by scaling model depth and capacity, but at the cost of increased memory, energy, and computatio…
OmniDraft: A Cross-vocabulary, Online Adaptive Drafter for On-device Speculative Decoding
Ramchalam Kinattinkara Ramakrishnan, Zhaocong Yuan, Shaojie Zhuo +4
Speculative decoding generally dictates having a small, efficient draft model that is either pretrained or distilled offline to a particular target model series, for instance, Llam…
Stepping Forward on the Last Mile
Chen Feng, Shaojie Zhuo, Xiaopeng Zhang +3
Continuously adapting pre-trained models to local data on resource constrained edge devices is the for model deployment. However, as models increase in size and…
An Empirical Study of Low Precision Quantization for TinyML
Shaojie Zhuo, Hongyu Chen, Ramchalam Kinattinkara Ramakrishnan +5
Tiny machine learning (tinyML) has emerged during the past few years aiming to deploy machine learning models to embedded AI processors with highly constrained memory and computati…