1 citations · 4 across the 14 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021
Differentiable Architecture Pruning for Transfer Learning
Nicolo Colombo, Yang Gao
We propose a new gradient-based approach for extracting sub-architectures from a given large model. Contrarily to existing pruning methods, which are unable to disentangle the netw…
cs.LG2021
Adapting by Pruning: A Case Study on BERT
Yang Gao, Nicolo Colombo, Wei Wang
Adapting pre-trained neural models to downstream tasks has become the standard practice for obtaining high-quality models. In this work, we propose a novel model adaptation paradig…