18 citations · 18 across the 2 of their papers we have counts for
3 papers · 1 filter
The Probabilistic Fault Tolerance of Neural Networks in the Continuous Limit
El-Mahdi El-Mhamdi, Rachid Guerraoui, Andrei Kucharavy +1
The loss of a few neurons in a brain rarely results in any visible loss of function. However, the insight into what "few" means in this context is unclear. How many random neuron f…
Asynchronous Byzantine Machine Learning (the case of SGD)
Georgios Damaskinos, El Mahdi El Mhamdi, Rachid Guerraoui +2
Asynchronous distributed machine learning solutions have proven very effective so far, but always assuming perfectly functioning workers. In practice, some of the workers can howev…
The Hidden Vulnerability of Distributed Learning in Byzantium
El Mahdi El Mhamdi, Rachid Guerraoui, Sébastien Rouault
While machine learning is going through an era of celebrated success, concerns have been raised about the vulnerability of its backbone: stochastic gradient descent (SGD). Recent a…