151 citations · 208 across the 22 of their papers we have counts for
3 papers · 1 filter
Knowledge distillation through geometry-aware representational alignment
Prajjwal Bhattarai, Mohammad Amjad, Dmytro Zhylko +1
Knowledge distillation is a common paradigm for transferring capabilities from larger models to smaller ones. While traditional distillation methods leverage a probabilistic diverg…
MoENAS: Mixture-of-Expert based Neural Architecture Search for jointly Accurate, Fair, and Robust Edge Deep Neural Networks
Lotfi Abdelkrim Mecharbat, Alberto Marchisio, Muhammad Shafique +2
There has been a surge in optimizing edge Deep Neural Networks (DNNs) for accuracy and efficiency using traditional optimization techniques such as pruning, and more recently, empl…
GLoG-CSUnet: Enhancing Vision Transformers with Adaptable Radiomic Features for Medical Image Segmentation
Niloufar Eghbali, Hassan Bagher-Ebadian, Tuka Alhanai +1
Vision Transformers (ViTs) have shown promise in medical image semantic segmentation (MISS) by capturing long-range correlations. However, ViTs often struggle to model local spatia…