9 citations · 28 across the 14 of their papers we have counts for
13 papers · 1 filter
Towards Trustworthy Federated Learning with Untrusted Participants
Youssef Allouah, Rachid Guerraoui, John Stephan
Resilience against malicious participants and data privacy are essential for trustworthy federated learning, yet achieving both with good utility typically requires the strong assu…
ByzFL: Research Framework for Robust Federated Learning
Marc González, Rachid Guerraoui, Rafael Pinot +3
We present ByzFL, an open-source Python library for developing and benchmarking robust federated learning (FL) algorithms. ByzFL provides a unified and extensible framework that in…
Overcoming the Challenges of Batch Normalization in Federated Learning
Rachid Guerraoui, Rafael Pinot, Geovani Rizk +2
Batch normalization has proven to be a very beneficial mechanism to accelerate the training and improve the accuracy of deep neural networks in centralized environments. Yet, the s…
Adaptive Gradient Clipping for Robust Federated Learning
Youssef Allouah, Rachid Guerraoui, Nirupam Gupta +3
Robust federated learning aims to maintain reliable performance despite the presence of adversarial or misbehaving workers. While state-of-the-art (SOTA) robust distributed gradien…
Balancing Privacy, Robustness, and Efficiency in Machine Learning
Youssef Allouah, Rachid Guerraoui, John Stephan
This position paper argues that achieving robustness, privacy, and efficiency simultaneously in machine learning systems is infeasible under prevailing threat models. The tension b…
SABLE: Secure And Byzantine robust LEarning
Antoine Choffrut, Rachid Guerraoui, Rafael Pinot +3
Due to the widespread availability of data, machine learning (ML) algorithms are increasingly being implemented in distributed topologies, wherein various nodes collaborate to trai…
Fixing by Mixing: A Recipe for Optimal Byzantine ML under Heterogeneity
Youssef Allouah, Sadegh Farhadkhani, Rachid Guerraoui +3
Byzantine machine learning (ML) aims to ensure the resilience of distributed learning algorithms to misbehaving (or Byzantine) machines. Although this problem received significant…
On the Privacy-Robustness-Utility Trilemma in Distributed Learning
Youssef Allouah, Rachid Guerraoui, Nirupam Gupta +2
The ubiquity of distributed machine learning (ML) in sensitive public domain applications calls for algorithms that protect data privacy, while being robust to faults and adversari…
On the Impossible Safety of Large AI Models
El-Mahdi El-Mhamdi, Sadegh Farhadkhani, Rachid Guerraoui +5
Large AI Models (LAIMs), of which large language models are the most prominent recent example, showcase some impressive performance. However they have been empirically found to pos…
Robust Collaborative Learning with Linear Gradient Overhead
Sadegh Farhadkhani, Rachid Guerraoui, Nirupam Gupta +3
Collaborative learning algorithms, such as distributed SGD (or D-SGD), are prone to faulty machines that may deviate from their prescribed algorithm because of software or hardware…
Byzantine Machine Learning Made Easy by Resilient Averaging of Momentums
Sadegh Farhadkhani, Rachid Guerraoui, Nirupam Gupta +2
Byzantine resilience emerged as a prominent topic within the distributed machine learning community. Essentially, the goal is to enhance distributed optimization algorithms, such a…
Combining Differential Privacy and Byzantine Resilience in Distributed SGD
Rachid Guerraoui, Nirupam Gupta, Rafael Pinot +2
Privacy and Byzantine resilience (BR) are two crucial requirements of modern-day distributed machine learning. The two concepts have been extensively studied individually but the q…
Differential Privacy and Byzantine Resilience in SGD: Do They Add Up?
Rachid Guerraoui, Nirupam Gupta, Rafaël Pinot +2
This paper addresses the problem of combining Byzantine resilience with privacy in machine learning (ML). Specifically, we study if a distributed implementation of the renowned Sto…