output
20102023
most citedTensorizing Neural Networks

604 citations

Showing cs.LGShow all

14 papers · 1 filter

cs.LG2021

On the Consistency of Max-Margin Losses

Alex Nowak-Vila, Alessandro Rudi, Francis Bach

The foundational concept of Max-Margin in machine learning is ill-posed for output spaces with more than two labels such as in structured prediction. In this paper, we show that th…

cs.LG2019★ 14 cited

Partially Encrypted Machine Learning using Functional Encryption

Theo Ryffel, Edouard Dufour-Sans, Romain Gay +2

Machine learning on encrypted data has received a lot of attention thanks to recent breakthroughs in homomorphic encryption and secure multi-party computation. It allows outsourcin…

cs.LG2018★ 6 cited

Sharp Analysis of Learning with Discrete Losses

Alex Nowak-Vila, Francis Bach, Alessandro Rudi

The problem of devising learning strategies for discrete losses (e.g., multilabeling, ranking) is currently addressed with methods and theoretical analyses ad-hoc for each loss. In…

cs.LG2016★ 42 cited

Minding the Gaps for Block Frank-Wolfe Optimization of Structured SVMs

Anton Osokin, Jean-Baptiste Alayrac, Isabella Lukasewitz +2

In this paper, we propose several improvements on the block-coordinate Frank-Wolfe (BCFW) algorithm from Lacoste-Julien et al. (2013) recently used to optimize the structured suppo…

cs.LG2015★ 28 cited

Submodular Functions: from Discrete to Continous Domains

Francis Bach

Submodular set-functions have many applications in combinatorial optimization, as they can be minimized and approximately maximized in polynomial time. A key element in many of the…

cs.LG2015★ 604 cited

Tensorizing Neural Networks

Alexander Novikov, Dmitry Podoprikhin, Anton Osokin +1

Deep neural networks currently demonstrate state-of-the-art performance in several domains. At the same time, models of this class are very demanding in terms of computational reso…

cs.LG2014★ 303 cited

Breaking the Curse of Dimensionality with Convex Neural Networks

Francis Bach

We consider neural networks with a single hidden layer and non-decreasing homogeneous activa-tion functions like the rectified linear units. By letting the number of hidden units g…

cs.LG2014★ 32 cited

On the Consistency of Ordinal Regression Methods

Fabian Pedregosa, Francis Bach, Alexandre Gramfort

Many of the ordinal regression models that have been proposed in the literature can be seen as methods that minimize a convex surrogate of the zero-one, absolute, or squared loss f…

cs.LG2014★ 2 cited

Spectral Ranking using Seriation

Fajwel Fogel, Alexandre d'Aspremont, Milan Vojnovic

We describe a seriation algorithm for ranking a set of items given pairwise comparisons between these items. Intuitively, the algorithm assigns similar rankings to items that compa…

cs.LG2013★ 26 cited

Convex relaxations of structured matrix factorizations

Francis Bach

We consider the factorization of a rectangular matrix into a positive linear combination of rank-one factors of the form , where and belongs to certain sets…

cs.LG2013★ 211 cited

Non-strongly-convex smooth stochastic approximation with convergence rate O(1/n)

Francis Bach, Eric Moulines

We consider the stochastic approximation problem where a convex function has to be minimized, given only the knowledge of unbiased estimates of its gradients at certain points, a f…

cs.LG2012★ 79 cited

Sharp analysis of low-rank kernel matrix approximations

Francis Bach

We consider supervised learning problems within the positive-definite kernel framework, such as kernel ridge regression, kernel logistic regression or the support vector machine. W…

cs.LG2011★ 57 cited

Trace Lasso: a trace norm regularization for correlated designs

Edouard Grave, Guillaume Obozinski, Francis Bach

Using the -norm to regularize the estimation of the parameter vector of a linear model leads to an unstable estimator when covariates are highly correlated. In this paper,…

cs.LG2011★ 253 cited

Convergence Rates of Inexact Proximal-Gradient Methods for Convex Optimization

Mark Schmidt, Nicolas Le Roux, Francis Bach

We consider the problem of optimizing the sum of a smooth convex function and a non-smooth convex function using proximal-gradient methods, where an error is present in the calcula…