activity
20102023
most citedPredicting Parameters in Deep Learning

697 citations · 1.5k across the 20 of their papers we have counts for

collaborators
Showing cs.LGShow all

7 papers · 1 filter

cs.LG2023

Knowledge Transfer from Teachers to Learners in Growing-Batch Reinforcement Learning

Patrick Emedom-Nnamdi, Abram L. Friesen, Bobak Shahriari +2

Standard approaches to sequential decision-making exploit an agent's ability to continually interact with its environment and improve its control policy. However, due to safety, et…

cs.LG2015★ 227 cited

Neural Programmer-Interpreters

Scott Reed, Nando de Freitas

We propose the neural programmer-interpreter (NPI): a recurrent and compositional neural network that learns to represent and execute programs. NPI has three learnable components:…

cs.LG2015★ 19 cited

ACDC: A Structured Efficient Linear Layer

Marcin Moczulski, Misha Denil, Jeremy Appleyard +1

The linear layer is one of the most pervasive modules in deep learning representations. However, it requires parameters and operations. These costs can be prohibi…

cs.LG2014★ 15 cited

Deep Multi-Instance Transfer Learning

Dimitrios Kotzias, Misha Denil, Phil Blunsom +1

We present a new approach for transferring knowledge from groups to individuals that comprise them. We evaluate our method in text, by inferring the ratings of individual sentences…

cs.LG2013★ 697 cited

Predicting Parameters in Deep Learning

Misha Denil, Babak Shakibi, Laurent Dinh +2

We demonstrate that there is significant redundancy in the parameterization of several deep learning models. Given only a few weight values for each feature it is possible to accur…

cs.LG2011★ 1 cited

A Machine Learning Perspective on Predictive Coding with PAQ

Byron Knoll, Nando de Freitas

PAQ8 is an open source lossless data compression algorithm that currently achieves the best compression rates on many benchmarks. This report presents a detailed description of PAQ…

cs.LG2010★ 91 cited

Portfolio Allocation for Bayesian Optimization

Eric Brochu, Matthew W. Hoffman, Nando de Freitas

Bayesian optimization with Gaussian processes has become an increasingly popular tool in the machine learning community. It is efficient and can be used when very little is known a…