921 citations · 1.4k across the 54 of their papers we have counts for
Showing 2021 · cs.LGShow all
2 papers · 2 filters
cs.LG2021★ 11 cited
Improved Regularization and Robustness for Fine-tuning in Neural Networks
Dongyue Li, Hongyang R. Zhang
A widely used algorithm for transfer learning is fine-tuning, where a pre-trained model is fine-tuned on a target task with a small amount of labeled data. When the capacity of the…
cs.LG2021★ 6 cited
Self-Adaptive Training: Bridging Supervised and Self-Supervised Learning
Lang Huang, Chao Zhang, Hongyang Zhang
We propose self-adaptive training -- a unified training algorithm that dynamically calibrates and enhances training processes by model predictions without incurring an extra comput…