124 citations · 231 across the 10 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021★ 1 cited
Should We Be Pre-training? An Argument for End-task Aware Training as an Alternative
Lucio M. Dery, Paul Michel, Ameet Talwalkar +1
In most settings of practical concern, machine learning practitioners know in advance what end-task they wish to boost with auxiliary tasks. However, widely used methods for levera…
cs.LG2021★ 5 cited
Auxiliary Task Update Decomposition: The Good, The Bad and The Neutral
Lucio M. Dery, Yann Dauphin, David Grangier
While deep learning has been very beneficial in data-rich settings, tasks with smaller training set often resort to pre-training or multitask learning to leverage data from other t…