Exploring the Boundaries of On-Device Inference: When Tiny Falls Short, Go Hierarchical

Adarsh Prasad Behera, Paulius Daubaris, Iñaki Bravo +4

On-device inference holds great potential for increased energy efficiency, responsiveness, and privacy in edge ML systems. However, due to less capable ML models that can be embedd…