697 citations · 1.5k across the 20 of their papers we have counts for
7 papers · 1 filter
Knowledge Transfer from Teachers to Learners in Growing-Batch Reinforcement Learning
Patrick Emedom-Nnamdi, Abram L. Friesen, Bobak Shahriari +2
Standard approaches to sequential decision-making exploit an agent's ability to continually interact with its environment and improve its control policy. However, due to safety, et…
Neural Programmer-Interpreters
Scott Reed, Nando de Freitas
We propose the neural programmer-interpreter (NPI): a recurrent and compositional neural network that learns to represent and execute programs. NPI has three learnable components:…
ACDC: A Structured Efficient Linear Layer
Marcin Moczulski, Misha Denil, Jeremy Appleyard +1
The linear layer is one of the most pervasive modules in deep learning representations. However, it requires parameters and operations. These costs can be prohibi…
Deep Multi-Instance Transfer Learning
Dimitrios Kotzias, Misha Denil, Phil Blunsom +1
We present a new approach for transferring knowledge from groups to individuals that comprise them. We evaluate our method in text, by inferring the ratings of individual sentences…
Predicting Parameters in Deep Learning
Misha Denil, Babak Shakibi, Laurent Dinh +2
We demonstrate that there is significant redundancy in the parameterization of several deep learning models. Given only a few weight values for each feature it is possible to accur…
A Machine Learning Perspective on Predictive Coding with PAQ
Byron Knoll, Nando de Freitas
PAQ8 is an open source lossless data compression algorithm that currently achieves the best compression rates on many benchmarks. This report presents a detailed description of PAQ…
Portfolio Allocation for Bayesian Optimization
Eric Brochu, Matthew W. Hoffman, Nando de Freitas
Bayesian optimization with Gaussian processes has become an increasingly popular tool in the machine learning community. It is efficient and can be used when very little is known a…