7 citations · 21 across the 8 of their papers we have counts for
12 papers
MoIN: Mixture of Introvert Experts to Upcycle an LLM
Ajinkya Tejankar, KL Navaneet, Ujjawal Panchal +2
The goal of this paper is to improve (upcycle) an existing large language model without the prohibitive requirements of continued pre-training of the full-model. The idea is to spl…
Defending Against Patch-based Backdoor Attacks on Self-Supervised Learning
Ajinkya Tejankar, Maziar Sanjabi, Qifan Wang +4
Recently, self-supervised learning (SSL) was shown to be vulnerable to patch-based data poisoning backdoor attacks. It was shown that an adversary can poison a small part of the un…
Backdoor Attacks on Vision Transformers
Akshayvarun Subramanya, Aniruddha Saha, Soroush Abbasi Koohpayegani +2
Vision Transformers (ViT) have recently demonstrated exemplary performance on a variety of vision tasks and are being used as an alternative to CNNs. Their design is based on a sel…
SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillation
K L Navaneet, Soroush Abbasi Koohpayegani, Ajinkya Tejankar +1
Feature regression is a simple way to distill large neural network models to smaller ones. We show that with simple changes to the network architecture, regression can outperform m…
A Fistful of Words: Learning Transferable Visual Models from Bag-of-Words Supervision
Ajinkya Tejankar, Maziar Sanjabi, Bichen Wu +4
Using natural language as a supervision for training visual recognition models holds great promise. Recent works have shown that if such supervision is used in the form of alignmen…
Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning
KL Navaneet, Soroush Abbasi Koohpayegani, Ajinkya Tejankar +3
We are interested in representation learning in self-supervised, supervised, and semi-supervised settings. Some recent self-supervised learning methods like mean-shift (MSF) cluste…
Constrained Mean Shift for Representation Learning
Ajinkya Tejankar, Soroush Abbasi Koohpayegani, Hamed Pirsiavash
We are interested in representation learning from labeled or unlabeled data. Inspired by recent success of self-supervised learning (SSL), we develop a non-contrastive representati…
Backdoor Attacks on Self-Supervised Learning
Aniruddha Saha, Ajinkya Tejankar, Soroush Abbasi Koohpayegani +1
Large-scale unlabeled data has spurred recent progress in self-supervised learning methods that learn rich visual representations. State-of-the-art self-supervised methods for lear…
Mean Shift for Self-Supervised Learning
Soroush Abbasi Koohpayegani, Ajinkya Tejankar, Hamed Pirsiavash
Most recent self-supervised learning (SSL) algorithms learn features by contrasting between instances of images or by clustering the images and then contrasting between the image c…
ISD: Self-Supervised Learning by Iterative Similarity Distillation
Ajinkya Tejankar, Soroush Abbasi Koohpayegani, Vipin Pillai +2
Recently, contrastive learning has achieved great results in self-supervised learning, where the main idea is to push two augmentations of an image (positive pairs) closer compared…
CompRess: Self-Supervised Learning by Compressing Representations
Soroush Abbasi Koohpayegani, Ajinkya Tejankar, Hamed Pirsiavash
Self-supervised learning aims to learn good representations with unlabeled data. Recent works have shown that larger models benefit more from self-supervised learning than smaller…
A simple baseline for domain adaptation using rotation prediction
Ajinkya Tejankar, Hamed Pirsiavash
Recently, domain adaptation has become a hot research area with lots of applications. The goal is to adapt a model trained in one domain to another domain with scarce annotated dat…