25 citations · 54 across the 19 of their papers we have counts for
3 papers · 1 filter
What Happens During Finetuning of Vision Transformers: An Invariance Based Investigation
Gabriele Merlin, Vedant Nanda, Ruchit Rawal +1
The pretrain-finetune paradigm usually improves downstream performance over training a model from scratch on the same task, becoming commonplace across many areas of machine learni…
Diffused Redundancy in Pre-trained Representations
Vedant Nanda, Till Speicher, John P. Dickerson +3
Representations learned by pre-training a neural network on a large dataset are increasingly used successfully to perform a variety of downstream tasks. In this work, we take a clo…
Investigating the Effects of Fairness Interventions Using Pointwise Representational Similarity
Camila Kolling, Till Speicher, Vedant Nanda +2
Machine learning (ML) algorithms can often exhibit discriminatory behavior, negatively affecting certain populations across protected groups. To address this, numerous debiasing me…