117 citations · 411 across the 25 of their papers we have counts for
27 papers
Query-based Knowledge Transfer for Heterogeneous Learning Environments
Norah Alballa, Wenxuan Zhang, Ziquan Liu +3
Decentralized collaborative learning under data heterogeneity and privacy constraints has rapidly advanced. However, existing solutions like federated learning, ensembles, and tran…
Flashback: Understanding and Mitigating Forgetting in Federated Learning
Mohammed Aljahdali, Ahmed M. Abdelmoniem, Marco Canini +1
In Federated Learning (FL), forgetting, or the loss of knowledge across rounds, hampers algorithm convergence, particularly in the presence of severe data heterogeneity among clien…
Practical Insights into Knowledge Distillation for Pre-Trained Models
Norah Alballa, Ahmed M. Abdelmoniem, Marco Canini
This research investigates the enhancement of knowledge distillation (KD) processes in pre-trained models, an emerging field in knowledge transfer with significant implications for…
Quantize Once, Train Fast: Allreduce-Compatible Compression with Provable Guarantees
Jihao Xin, Marco Canini, Peter Richtárik +1
Distributed training enables large-scale deep learning, but suffers from high communication overhead, especially as models and datasets grow. Gradient compression, particularly qua…
FilFL: Client Filtering for Optimized Client Participation in Federated Learning
Fares Fourati, Salma Kharrat, Vaneet Aggarwal +2
Federated learning, an emerging machine learning paradigm, enables clients to collaboratively train a model without exchanging local data. Clients participating in the training pro…
Resource-Efficient Federated Learning
Ahmed M. Abdelmoniem, Atal Narayan Sahu, Marco Canini +1
Federated Learning (FL) enables distributed training by learners using local data, thereby enhancing privacy and reducing communication. However, it presents numerous challenges re…