2 papers
cs.AR2026
SPECTRA: Adaptive Execution of Speculative Decoding on a Runtime-Reconfigurable Tiled Architecture
Gabriele Tombesi, William Baisi, Je Yang +5
LLM inference on edge devices is constrained by computational and memory resources, making efficient autoregressive decoding challenging. Speculative decoding alleviates this bottl…
cs.AR2024
Towards Generalized On-Chip Communication for Programmable Accelerators in Heterogeneous Architectures
Joseph Zuckerman, John-David Wellman, Ajay Vanamali +8
We present several enhancements to the open-source ESP platform to support flexible and efficient on-chip communication for programmable accelerators in heterogeneous SoCs. These e…