6 citations · 10 across the 12 of their papers we have counts for
13 papers
Memory-Efficient Integer-Only Training of Deep Neural Networks
Hazem Hesham Yousef Shalby, Fabrizio Pittorino, Manuel Roveri
Training neural networks in reduced precision can yield significant efficiency gains, yet all existing methods that scale to standard computer vision benchmarks retain floating-poi…
What changes after deployment? A survey on On-device Learning in TinyML
Massimo Pavan, Luca Pezzarossa, Fabrizio Pittorino +2
Machine learning models on microcontroller-class devices (TinyML) face a fundamental challenge: post-deployment distribution change undermines static models. On-device learning (OD…
HERCULES: Hardware-Efficient, Robust, Continual Learning Neural Architecture Search
Matteo Gambella, Fabrizio Pittorino, Manuel Roveri
Neural Architecture Search (NAS) has emerged as a powerful framework for automatically discovering neural architectures that balance accuracy and efficiency. However, as AI transit…
Active In-Context Learning for Tabular Foundation Models
Wilailuck Treerath, Fabrizio Pittorino
Active learning (AL) reduces labeling cost by querying informative samples, but in tabular settings its cold-start gains are often limited because uncertainty estimates are unrelia…
SQUAD: Scalable Quorum Adaptive Decisions via ensemble of early exit neural networks
Matteo Gambella, Fabrizio Pittorino, Giuliano Casale +1
Early-exit neural networks have become popular for reducing inference latency by allowing intermediate predictions when sufficient confidence is achieved. However, standard approac…
BEP: A Binary Error Propagation Algorithm for Binary Neural Networks Training
Luca Colombo, Fabrizio Pittorino, Daniele Zambon +3
Binary Neural Networks (BNNs), which constrain both weights and activations to binary values, offer substantial reductions in computational complexity, memory footprint, and energy…
DQT: Dynamic Quantization Training via Dequantization-Free Nested Integer Arithmetic
Hazem Hesham Yousef Shalby, Fabrizio Pittorino, Francesca Palermo +2
The deployment of deep neural networks on resource-constrained devices relies on quantization. While static, uniform quantization applies a fixed bit-width to all inputs, it fails…
InfoQ: Mixed-Precision Quantization via Global Information Flow
Mehmet Emre Akbulut, Hazem Hesham Yousef Shalby, Fabrizio Pittorino +1
Mixed-precision quantization (MPQ) is crucial for deploying deep neural networks on resource-constrained devices, but finding the optimal bit-width for each layer represents a comp…
Architecture-Aware Minimization (AM): How to Find Flat Minima in Neural Architecture Search
Matteo Gambella, Fabrizio Pittorino, Manuel Roveri
Neural Architecture Search (NAS) has become an essential tool for designing effective and efficient neural networks. In this paper, we investigate the geometric properties of neura…
Quantifying Cryptocurrency Unpredictability: A Comprehensive Study of Complexity and Forecasting
Francesco Puoti, Fabrizio Pittorino, Manuel Roveri
This paper offers a thorough examination of the univariate predictability in cryptocurrency time-series. By exploiting a combination of complexity measure and model predictions we…
EmbBERT: Attention Under 2 MB Memory
Riccardo Bravin, Massimo Pavan, Hazem Hesham Yousef Shalby +2
Transformer architectures based on the attention mechanism have revolutionized natural language processing (NLP), driving major breakthroughs across virtually every NLP task. Howev…
Training Multi-Layer Binary Neural Networks With Local Binary Error Signals
Luca Colombo, Fabrizio Pittorino, Manuel Roveri
Binary Neural Networks (BNNs) significantly reduce computational complexity and memory usage in machine and deep learning by representing weights and activations with just one bit.…
FlatNAS: optimizing Flatness in Neural Architecture Search for Out-of-Distribution Robustness
Matteo Gambella, Fabrizio Pittorino, Manuel Roveri
Neural Architecture Search (NAS) paves the way for the automatic definition of Neural Network (NN) architectures, attracting increasing research attention and offering solutions in…