56 citations · 67 across the 12 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021★ 4 cited
The Power of Contrast for Feature Learning: A Theoretical Analysis
Wenlong Ji, Zhun Deng, Ryumei Nakada +2
Contrastive learning has achieved state-of-the-art performance in various self-supervised learning tasks and even outperforms its supervised counterpart. Despite its empirical succ…
stat.ML2021★ 1 cited
Asymptotic Risk of Overparameterized Likelihood Models: Double Descent Theory for Deep Neural Networks
Ryumei Nakada, Masaaki Imaizumi
We investigate the asymptotic risk of a general class of overparameterized likelihood models, including deep models. The recent empirical success of large-scale models has motivate…