7 citations · 24 across the 11 of their papers we have counts for
5 papers · 1 filter
Why is Pruning at Initialization Immune to Reinitializing and Shuffling?
Sahib Singh, Rosanne Liu
Recent studies assessing the efficacy of pruning neural networks methods uncovered a surprising finding: when conducting ablation studies on existing pruning-at-initialization meth…
WeightScale: Interpreting Weight Change in Neural Networks
Ayush Manish Agrawal, Atharva Tendle, Harshvardhan Sikka +1
Interpreting the learning dynamics of neural networks can provide useful insights into how networks learn and the development of better training and design approaches. We present a…
Using Anomaly Feature Vectors for Detecting, Classifying and Warning of Outlier Adversarial Examples
Nelson Manohar-Alers, Ryan Feng, Sahib Singh +2
We present DeClaW, a system for detecting, classifying, and warning of adversarial inputs presented to a classification neural network. In contrast to current state-of-the-art meth…
Benchmarking Differential Privacy and Federated Learning for BERT Models
Priyam Basu, Tiasa Singha Roy, Rakshit Naidu +3
Natural Language Processing (NLP) techniques can be applied to help with the diagnosis of medical conditions such as depression, using a collection of a person's utterances. Depres…
DP-SGD vs PATE: Which Has Less Disparate Impact on Model Accuracy?
Archit Uniyal, Rakshit Naidu, Sasikanth Kotti +4
Recent advances in differentially private deep learning have demonstrated that application of differential privacy, specifically the DP-SGD algorithm, has a disparate impact on dif…