4 papers
Memory Constrained Dynamic Subnetwork Update for Transfer Learning
Aël Quélennec, Pavlo Mozharovskyi, Van-Tam Nguyen +1
On-device neural network training faces critical memory constraints that limit the adaptation of pre-trained models to downstream tasks. We present MeDyate, a theoretically-grounde…
Study of Training Dynamics for Memory-Constrained Fine-Tuning
Aël Quélennec, Nour Hezbri, Pavlo Mozharovskyi +2
Memory-efficient training of deep neural networks has become increasingly important as models grow larger while deployment environments impose strict resource constraints. We propo…
Activation Map Compression through Tensor Decomposition for Deep Learning
Le-Trung Nguyen, Aël Quélennec, Enzo Tartaglione +2
Internet of Things and Deep Learning are synergetically and exponentially growing industrial fields with a massive call for their unification into a common framework called Edge AI…
Towards On-device Learning on the Edge: Ways to Select Neurons to Update under a Budget Constraint
Aël Quélennec, Enzo Tartaglione, Pavlo Mozharovskyi +1
In the realm of efficient on-device learning under extreme memory and computation constraints, a significant gap in successful approaches persists. Although considerable effort has…