12 citations · 12 across the 4 of their papers we have counts for
1 paper · 1 filter
Hanbin Bae, Heejin Choi, Joohyung Lee +3
Device-cloud speculative decoding reduces server computation, but growing a deep draft tree with a small language model (SLM) requires repeated passes on a mobile neural processing…