174 citations · 327 across the 11 of their papers we have counts for
5 papers · 1 filter
Initialization and Regularization of Factorized Neural Layers
Mikhail Khodak, Neil Tenenholtz, Lester Mackey +1
Factorized layers--operations parameterized by products of two or more matrices--occur in a variety of deep learning contexts, including compressed model training, certain types of…
Weighted Meta-Learning
Diana Cai, Rishit Sheth, Lester Mackey +1
Meta-learning leverages related source tasks to learn an initialization that can be quickly fine-tuned to a target task with limited labeled examples. However, many popular meta-le…
Feature Gradients: Scalable Feature Selection via Discrete Relaxation
Rishit Sheth, Nicolo Fusi
In this paper we introduce Feature Gradients, a gradient-based search algorithm for feature selection. Our approach extends a recent result on the estimation of learnability in the…
Probabilistic Neural Architecture Search
Francesco Paolo Casale, Jonathan Gordon, Nicolo Fusi
In neural architecture search (NAS), the space of neural network architectures is automatically explored to maximize predictive accuracy for a given task. Despite the success of re…
Probabilistic Matrix Factorization for Automated Machine Learning
Nicolo Fusi, Rishit Sheth, Huseyn Melih Elibol
In order to achieve state-of-the-art performance, modern machine learning techniques require careful data pre-processing and hyperparameter tuning. Moreover, given the ever increas…