1 citations · 2 across the 5 of their papers we have counts for
3 papers · 1 filter
MultiTASC++: A Continuously Adaptive Scheduler for Edge-Based Multi-Device Cascade Inference
Sokratis Nikolaidis, Stylianos I. Venieris, Iakovos S. Venieris
Cascade systems, consisting of a lightweight model processing all samples and a heavier, high-accuracy model refining challenging samples, have become a widely-adopted distributed…
MultiTASC: A Multi-Tenancy-Aware Scheduler for Cascaded DNN Inference at the Consumer Edge
Sokratis Nikolaidis, Stylianos I. Venieris, Iakovos S. Venieris
Cascade systems comprise a two-model sequence, with a lightweight model processing all samples and a heavier, higher-accuracy model conditionally refining harder samples to improve…
Exploring the Performance and Efficiency of Transformer Models for NLP on Mobile Devices
Ioannis Panopoulos, Sokratis Nikolaidis, Stylianos I. Venieris +1
Deep learning (DL) is characterised by its dynamic nature, with new deep neural network (DNN) architectures and approaches emerging every few years, driving the field's advancement…