53 citations · 58 across the 6 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021
Meta-learning for downstream aware and agnostic pretraining
Hongyin Luo, Shuyan Dong, Yung-Sung Chuang +1
Neural network pretraining is gaining attention due to its outstanding performance in natural language processing applications. However, pretraining usually leverages predefined ta…
cs.CL2021★ 53 cited
SUPERB: Speech processing Universal PERformance Benchmark
Shu-wen Yang, Po-Han Chi, Yung-Sung Chuang +17
Self-supervised learning (SSL) has proven vital for advancing research in natural language processing (NLP) and computer vision (CV). The paradigm pretrains a shared model on large…