activity
20112025
most citedDistilling the Knowledge in a Neural Network

14.1k citations · 89.2k across the 108 of their papers we have counts for

collaborators
Showing 2018Show all

15 papers · 1 filter

cs.LG2018★ 1 cited

Generating Diverse Programs with Instruction Conditioned Reinforced Adversarial Learning

Aishwarya Agrawal, Mateusz Malinowski, Felix Hill +3

Advances in Deep Reinforcement Learning have led to agents that perform well across a variety of sensory-motor domains. In this work, we study the setting in which an agent must le…

cs.LG2018★ 104 cited

Sample Efficient Adaptive Text-to-Speech

Yutian Chen, Yannis Assael, Brendan Shillingford +11

We present a meta-learning approach for adaptive text-to-speech (TTS) with few data. During training, we learn a multi-speaker model using a shared conditional WaveNet core and ind…

cs.CV2018★ 796 cited

Deep Audio-Visual Speech Recognition

Triantafyllos Afouras, Joon Son Chung, Andrew Senior +2

The goal of this work is to recognise phrases and sentences being spoken by a talking face, with or without the audio. Unlike previous works that have focussed on recognising a lim…

cs.LG2018★ 200 cited

Meta-Learning with Latent Embedding Optimization

Andrei A. Rusu, Dushyant Rao, Jakub Sygnowski +4

Gradient-based meta-learning techniques are both widely applicable and proficient at solving challenging few-shot learning and fast adaptation problems. However, they have practica…

cs.CL2018★ 382 cited

Universal Transformers

Mostafa Dehghani, Stephan Gouws, Oriol Vinyals +2

Recurrent neural networks (RNNs) sequentially process data by updating their state with each new data point, and have long been the de facto choice for sequence modeling tasks. How…

cs.LG2018★ 6.4k cited

Representation Learning with Contrastive Predictive Coding

Aaron van den Oord, Yazhe Li, Oriol Vinyals

While supervised learning has enabled great progress in many applications, unsupervised learning has not seen such widespread adoption, and remains an important and challenging end…