2 papers
cs.LG2024
First line of defense: A robust first layer mitigates adversarial attacks
Janani Suresh, Nancy Nayak, Sheetal Kalyani
Adversarial training (AT) incurs significant computational overhead, leading to growing interest in designing inherently robust architectures. We demonstrate that a carefully desig…
cs.LG2024
Randomness Helps Rigor: A Probabilistic Learning Rate Scheduler Bridging Theory and Deep Learning Practice
Dahlia Devapriya, Thulasi Tholeti, Janani Suresh +1
Learning rate schedulers have shown great success in speeding up the convergence of learning algorithms in practice. However, their convergence to a minimum has not been proven the…