activity
20092022
most citedThe Shattered Gradients Problem: If resnets are the answer, then what is the question?

96 citations · 444 across the 23 of their papers we have counts for

collaborators
Showing stat.MLShow all

10 papers · 1 filter

stat.ML2021★ 2 cited

EigenGame Unloaded: When playing games is better than optimizing

Ian Gemp, Brian McWilliams, Claire Vernade +1

We build on the recently proposed EigenGame that views eigendecomposition as a competitive game. EigenGame's updates are biased if computed using minibatches of data, which hinders…

stat.ML2017★ 7 cited

Preserving Differential Privacy Between Features in Distributed Estimation

Christina Heinze-Deml, Brian McWilliams, Nicolai Meinshausen

Privacy is crucial in many applications of machine learning. Legal, ethical and societal issues restrict the sharing of sensitive data making it difficult to learn from datasets th…

stat.ML2016★ 8 cited

Scalable Adaptive Stochastic Optimization Using Random Projections

Gabriel Krummenacher, Brian McWilliams, Yannic Kilcher +2

Adaptive stochastic gradient methods such as AdaGrad have gained popularity in particular for training deep neural networks. The most commonly used and studied variant maintains a…

stat.ML2015★ 5 cited

DUAL-LOCO: Distributing Statistical Estimation Using Random Projections

Christina Heinze, Brian McWilliams, Nicolai Meinshausen

We present DUAL-LOCO, a communication-efficient algorithm for distributed statistical estimation. DUAL-LOCO assumes that the data is distributed according to the features rather th…

stat.ML2014★ 23 cited

Fast and Robust Least Squares Estimation in Corrupted Linear Models

Brian McWilliams, Gabriel Krummenacher, Mario Lucic +1

Subsampling methods have been recently proposed to speed up least squares estimation in large scale settings. However, these algorithms are typically not robust to outliers or corr…

stat.ML2014★ 17 cited

LOCO: Distributing Ridge Regression with Random Projections

Christina Heinze, Brian McWilliams, Nicolai Meinshausen +1

We propose LOCO, an algorithm for large-scale ridge regression which distributes the features across workers on a cluster. Important dependencies between variables are preserved us…