activity
20172023
most citedTraining with Quantization Noise for Extreme Model Compression

115 citations · 342 across the 14 of their papers we have counts for

collaborators
Showing cs.LGShow all

10 papers · 1 filter

cs.LG2023★ 2 cited

Evaluating Privacy Leakage in Split Learning

Xinchi Qiu, Ilias Leontiadis, Luca Melis +2

Privacy-Preserving machine learning (PPML) can help us train and deploy models that utilize private information. In particular, on-device machine learning allows us to avoid sharin…

cs.LG2023★ 17 cited

Green Federated Learning

Ashkan Yousefpour, Shen Guo, Ashish Shenoy +7

The rapid progress of AI is fueled by increasingly large and computationally intensive machine learning models and datasets. As a consequence, the amount of compute used in trainin…

cs.LG2022

Privacy-Aware Compression for Federated Learning Through Numerical Mechanism Design

Chuan Guo, Kamalika Chaudhuri, Pierre Stock +1

In private federated learning (FL), a server aggregates differentially private updates from a large number of clients in order to train a machine learning model. The main challenge…

cs.LG2022★ 2 cited

TAN Without a Burn: Scaling Laws of DP-SGD

Tom Sander, Pierre Stock, Alexandre Sablayrolles

Differentially Private methods for training Deep Neural Networks (DNNs) have progressed recently, in particular with the use of massive batches and aggregated data augmentations fo…

cs.LG2022★ 3 cited

CANIFE: Crafting Canaries for Empirical Privacy Measurement in Federated Learning

Samuel Maddock, Alexandre Sablayrolles, Pierre Stock

Federated Learning (FL) is a setting for training machine learning models in distributed environments where the clients do not share their raw data but instead send model updates t…

cs.LG2022★ 4 cited

Reconciling Security and Communication Efficiency in Federated Learning

Karthik Prasad, Sayan Ghosh, Graham Cormode +3

Cross-device Federated Learning is an increasingly popular machine learning setting to train a model by leveraging a large population of client devices with high privacy and securi…

cs.LG2022★ 3 cited

Defending against Reconstruction Attacks with Rényi Differential Privacy

Pierre Stock, Igor Shilov, Ilya Mironov +1

Reconstruction attacks allow an adversary to regenerate data samples of the training set using access to only a trained model. It has been recently shown that simple heuristics can…

cs.LG2021★ 4 cited

An Embedding of ReLU Networks and an Analysis of their Identifiability

Pierre Stock, Rémi Gribonval

Neural networks with the Rectified Linear Unit (ReLU) nonlinearity are described by a vector of parameters , and realized as a piecewise linear continuous function $R_θ: x \in \…

cs.LG2020★ 115 cited

Training with Quantization Noise for Extreme Model Compression

Angela Fan, Pierre Stock, Benjamin Graham +4

We tackle the problem of producing compact models, maximizing their accuracy for a given model size. A standard solution is to train networks with Quantization Aware Training, wher…

cs.LG2017★ 16 cited

ConvNets and ImageNet Beyond Accuracy: Understanding Mistakes and Uncovering Biases

Pierre Stock, Moustapha Cisse

ConvNets and Imagenet have driven the recent success of deep learning for image classification. However, the marked slowdown in performance improvement combined with the lack of ro…