17 papers
SEAL: Searching Expandable Architectures for Incremental Learning
Matteo Gambella, Manuel Roveri
Incremental learning is a machine learning paradigm where a model learns from a sequential stream of tasks. This setting poses a key challenge: balancing plasticity (learning new t…
What changes after deployment? A survey on On-device Learning in TinyML
Massimo Pavan, Luca Pezzarossa, Fabrizio Pittorino +2
Machine learning models on microcontroller-class devices (TinyML) face a fundamental challenge: post-deployment distribution change undermines static models. On-device learning (OD…
HERCULES: Hardware-Efficient, Robust, Continual Learning Neural Architecture Search
Matteo Gambella, Fabrizio Pittorino, Manuel Roveri
Neural Architecture Search (NAS) has emerged as a powerful framework for automatically discovering neural architectures that balance accuracy and efficiency. However, as AI transit…
Architecture-Aware Minimization (AM): How to Find Flat Minima in Neural Architecture Search
Matteo Gambella, Fabrizio Pittorino, Manuel Roveri
Neural Architecture Search (NAS) has become an essential tool for designing effective and efficient neural networks. In this paper, we investigate the geometric properties of neura…
EmbBERT: Attention Under 2 MB Memory
Riccardo Bravin, Massimo Pavan, Hazem Hesham Yousef Shalby +2
Transformer architectures based on the attention mechanism have revolutionized natural language processing (NLP), driving major breakthroughs across virtually every NLP task. Howev…
SQUAD: Scalable Quorum Adaptive Decisions via ensemble of early exit neural networks
Matteo Gambella, Fabrizio Pittorino, Giuliano Casale +1
Early-exit neural networks have become popular for reducing inference latency by allowing intermediate predictions when sufficient confidence is achieved. However, standard approac…