2 citations · 2 across the 5 of their papers we have counts for
4 papers · 1 filter
SLAD : Shared LoRA Adapters for Task Specific Distillation
Reda Bensaid, Yassir Bendou, Vincent Gripon +1
In the context of resource-constrained environments such as embedded systems, adapting reduced-size foundation models to downstream tasks has become increasingly popular. This has…
Energy-Efficient Plant Monitoring via Knowledge Distillation
Ilyass Moummad, Reda Bensaid, Kawtar Zaher +5
Recent advances in large-scale visual representation learning have significantly improved performance in plant species and plant disease recognition tasks. However, state-of-the-ar…
Efficient Few-Shot Learning for Edge AI via Knowledge Distillation on MobileViT
Shuhei Tsuyuki, Reda Bensaid, Jérémy Morlier +4
Efficient and adaptable deep learning models are an important area of deep learning research, driven by the need for highly efficient models on edge devices. Few-shot learning enab…
MUKA: Multi Kernel Audio Adaptation Of Audio-Language Models
Reda Bensaid, Amine Ouasfi, Yassir Bendou +4
Multimodal foundation models have demonstrated impressive generalization capabilities, yet efficiently adapting them to new tasks in a few-shot setting remains a critical challenge…