335 citations · 366 across the 6 of their papers we have counts for
3 papers · 1 filter
Augmentations vs Algorithms: What Works in Self-Supervised Learning
Warren Morningstar, Alex Bijamov, Chris Duvarney +8
We study the relative effects of data augmentations, pretraining algorithms, and model architectures in Self-Supervised Learning (SSL). While the recent literature in this space le…
Towards Federated Learning Under Resource Constraints via Layer-wise Training and Depth Dropout
Pengfei Guo, Warren Richard Morningstar, Raviteja Vemulapalli +3
Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessib…
Federated Variational Inference: Towards Improved Personalization and Generalization
Elahe Vedadi, Joshua V. Dillon, Philip Andrew Mansfield +3
Conventional federated learning algorithms train a single global model by leveraging all participating clients' data. However, due to heterogeneity in client generative distributio…