27 citations · 37 across the 3 of their papers we have counts for
3 papers
DeiT-LT Distillation Strikes Back for Vision Transformer Training on Long-Tailed Datasets
Harsh Rangwani, Pradipto Mondal, Mayank Mishra +2
Vision Transformer (ViT) has emerged as a prominent architecture for various computer vision tasks. In ViT, we divide the input image into patch tokens and process them through a s…
Escaping Saddle Points for Effective Generalization on Class-Imbalanced Data
Harsh Rangwani, Sumukh K Aithal, Mayank Mishra +1
Real-world datasets exhibit imbalances of varying types and degrees. Several techniques based on re-weighting and margin adjustment of loss are often used to enhance the performanc…
A Closer Look at Smoothness in Domain Adversarial Training
Harsh Rangwani, Sumukh K Aithal, Mayank Mishra +2
Domain adversarial training has been ubiquitous for achieving invariant representations and is used widely for various domain adaptation tasks. In recent times, methods converging…