29 citations · 78 across the 7 of their papers we have counts for
4 papers · 1 filter
Improving Efficiency in Large-Scale Decentralized Distributed Training
Wei Zhang, Xiaodong Cui, Abdullah Kayi +9
Decentralized Parallel SGD (D-PSGD) and its asynchronous variant Asynchronous Parallel SGD (AD-PSGD) is a family of distributed learning algorithms that have been demonstrated to p…
Sobolev Independence Criterion
Youssef Mroueh, Tom Sercu, Mattia Rigotti +2
We propose the Sobolev Independence Criterion (SIC), an interpretable dependency measure between a high dimensional random variable X and a response variable Y . SIC decomposes to…
Wasserstein Barycenter Model Ensembling
Pierre Dognin, Igor Melnyk, Youssef Mroueh +3
In this paper we propose to perform model ensembling in a multiclass or a multilabel learning setting using Wasserstein (W.) barycenters. Optimal transport metrics, such as the Was…
Co-Occuring Directions Sketching for Approximate Matrix Multiply
Youssef Mroueh, Etienne Marcheret, Vaibhava Goel
We introduce co-occurring directions sketching, a deterministic algorithm for approximate matrix product (AMM), in the streaming model. We show that co-occuring directions achieves…