555 citations · 1k across the 61 of their papers we have counts for
5 papers · 1 filter
The Probabilistic Fault Tolerance of Neural Networks in the Continuous Limit
El-Mahdi El-Mhamdi, Rachid Guerraoui, Andrei Kucharavy +1
The loss of a few neurons in a brain rarely results in any visible loss of function. However, the insight into what "few" means in this context is unclear. How many random neuron f…
Asynchronous Byzantine Machine Learning (the case of SGD)
Georgios Damaskinos, El Mahdi El Mhamdi, Rachid Guerraoui +2
Asynchronous distributed machine learning solutions have proven very effective so far, but always assuming perfectly functioning workers. In practice, some of the workers can howev…
The Hidden Vulnerability of Distributed Learning in Byzantium
El Mahdi El Mhamdi, Rachid Guerraoui, Sébastien Rouault
While machine learning is going through an era of celebrated success, concerns have been raised about the vulnerability of its backbone: stochastic gradient descent (SGD). Recent a…
On The Robustness of a Neural Network
El Mahdi El Mhamdi, Rachid Guerraoui, Sebastien Rouault
With the development of neural networks based machine learning and their usage in mission critical applications, voices are rising against the \textit{black box} aspect of neural n…
When Neurons Fail
El Mahdi El Mhamdi, Rachid Guerraoui
We view a neural network as a distributed system of which neurons can fail independently, and we evaluate its robustness in the absence of any (recovery) learning phase. We give ti…