5 citations · 8 across the 4 of their papers we have counts for
3 papers · 1 filter
REX: Revisiting Budgeted Training with an Improved Schedule
John Chen, Cameron Wolfe, Anastasios Kyrillidis
Deep learning practitioners often operate on a computational and monetary budget. Thus, it is critical to design optimization algorithms that perform well under any budget. The lin…
Mitigating deep double descent by concatenating inputs
John Chen, Qihan Wang, Anastasios Kyrillidis
The double descent curve is one of the most intriguing properties of deep neural networks. It contrasts the classical bias-variance curve with the behavior of modern neural network…
Negative sampling in semi-supervised learning
John Chen, Vatsal Shah, Anastasios Kyrillidis
We introduce Negative Sampling in Semi-Supervised Learning (NS3L), a simple, fast, easy to tune algorithm for semi-supervised learning (SSL). NS3L is motivated by the success of ne…