149 citations · 302 across the 9 of their papers we have counts for
4 papers · 1 filter
Robust Federated Learning Through Representation Matching and Adaptive Hyper-parameters
Hesham Mostafa
Federated learning is a distributed, privacy-aware learning scenario which trains a single model on data belonging to several clients. Each client trains a local model on its data…
Single-bit-per-weight deep convolutional neural networks without batch-normalization layers for embedded systems
Mark D. McDonnell, Hesham Mostafa, Runchun Wang +1
Batch-normalization (BN) layers are thought to be an integrally important layer type in today's state-of-the-art deep convolutional neural networks for computer vision tasks such a…
Parameter Efficient Training of Deep Convolutional Neural Networks by Dynamic Sparse Reparameterization
Hesham Mostafa, Xin Wang
Modern deep neural networks are typically highly overparameterized. Pruning techniques are able to remove a significant fraction of network parameters with little loss in accuracy.…
Surrogate Gradient Learning in Spiking Neural Networks
Emre O. Neftci, Hesham Mostafa, Friedemann Zenke
Spiking neural networks are nature's versatile solution to fault-tolerant and energy efficient signal processing. To translate these benefits into hardware, a growing number of neu…