output
20102023
most citedTensorizing Neural Networks

604 citations

Showing stat.MLShow all

13 papers · 1 filter

stat.ML2020★ 1 cited

Learning Output Embeddings in Structured Prediction

Luc Brogat-Motte, Alessandro Rudi, Céline Brouard +2

A powerful and flexible approach to structured prediction consists in embedding the structured objects to be predicted into a feature space of possibly infinite dimension by means…

stat.ML2019★ 17 cited

Ranking and synchronization from pairwise measurements via SVD

Alexandre d'Aspremont, Mihai Cucuringu, Hemant Tyagi

Given a measurement graph and an unknown signal , we investigate algorithms for recovering from pairwise measurements of the form ; $\…

stat.ML2019★ 3 cited

Regularity as Regularization: Smooth and Strongly Convex Brenier Potentials in Optimal Transport

François-Pierre Paty, Alexandre d'Aspremont, Marco Cuturi

Estimating Wasserstein distances between two high-dimensional densities suffers from the curse of dimensionality: one needs an exponential (wrt dimension) number of samples to ensu…

stat.ML2018★ 34 cited

A Kernel Perspective for Regularizing Deep Neural Networks

Alberto Bietti, Grégoire Mialon, Dexiong Chen +1

We propose a new point of view for regularizing deep neural networks by using the norm of a reproducing kernel Hilbert space (RKHS). Even though this norm cannot be computed, it ad…

stat.ML2018★ 70 cited

Differential Properties of Sinkhorn Approximation for Learning with Wasserstein Distance

Giulia Luise, Alessandro Rudi, Massimiliano Pontil +1

Applications of optimal transport have recently gained remarkable attention thanks to the computational advantages of entropic regularization. However, in most situations the Sinkh…

stat.ML2018★ 9 cited

Constant Step Size Stochastic Gradient Descent for Probabilistic Modeling

Dmitry Babichev, Francis Bach

Stochastic gradient methods enable learning probabilistic models from large amounts of data. While large step-sizes (learning rates) have shown to be best for least-squares (e.g.,…

stat.ML2016★ 8 cited

Beyond CCA: Moment Matching for Multi-View Models

Anastasia Podosinnikova, Francis Bach, Simon Lacoste-Julien

We introduce three novel semi-parametric extensions of probabilistic canonical correlation analysis with identifiability guarantees. We consider moment matching techniques for esti…

stat.ML2015★ 18 cited

Barrier Frank-Wolfe for Marginal Inference

Rahul G. Krishnan, Simon Lacoste-Julien, David Sontag

We introduce a globally-convergent algorithm for optimizing the tree-reweighted (TRW) variational objective over the marginal polytope. The algorithm is based on the conditional gr…

stat.ML2015★ 5 cited

Rethinking LDA: moment matching for discrete ICA

Anastasia Podosinnikova, Francis Bach, Simon Lacoste-Julien

We consider moment matching techniques for estimation in Latent Dirichlet Allocation (LDA). By drawing explicit links between LDA and discrete versions of independent component ana…

stat.ML2015★ 30 cited

A New PAC-Bayesian Perspective on Domain Adaptation

Pascal Germain, Amaury Habrard, François Laviolette +1

We study the issue of PAC-Bayesian domain adaptation: We want to learn, from a source domain, a majority vote model dedicated to a target one. Our theoretical contribution brings a…

stat.ML2015★ 5 cited

PAC-Bayesian Theorems for Domain Adaptation with Specialization to Linear Classifiers

Pascal Germain, Amaury Habrard, François Laviolette +1

In this paper, we provide two main contributions in PAC-Bayesian theory for domain adaptation where the objective is to learn, from a source distribution, a well-performing majorit…

stat.ML2015★ 23 cited

Learning the Structure for Structured Sparsity

Nino Shervashidze, Francis Bach

Structured sparsity has recently emerged in statistics, machine learning and signal processing as a promising paradigm for learning in high-dimensional settings. All existing metho…

stat.ML2011★ 3 cited

Regret lower bounds and extended Upper Confidence Bounds policies in stochastic multi-armed bandit problem

Antoine Salomon, Jean-Yves Audibert, Issam El Alaoui

This paper is devoted to regret lower bounds in the classical model of stochastic multi-armed bandit. A well-known result of Lai and Robbins, which has then been extended by Burnet…