activity
20202024
most citedSimA: Simple Softmax-free Attention for Vision Transformers

8 citations · 30 across the 11 of their papers we have counts for

collaborators

17 papers

cs.LG2024★ 1 cited

MCNC: Manifold-Constrained Reparameterization for Neural Compression

Chayne Thrash, Ali Abbasi, Reed Andreas +4

The outstanding performance of large foundational models across diverse tasks, from computer vision to speech and natural language processing, has significantly increased their dem…

cs.CV2023

GeNIe: Generative Hard Negative Images Through Diffusion

Soroush Abbasi Koohpayegani, Anuj Singh, K L Navaneet +2

Data augmentation is crucial in training deep models, preventing them from overfitting to limited data. Recent advances in generative AI, e.g., diffusion models, have enabled more…

cs.CV2023★ 8 cited

CompGS: Smaller and Faster Gaussian Splatting with Vector Quantization

KL Navaneet, Kossar Pourahmadi Meibodi, Soroush Abbasi Koohpayegani +1

3D Gaussian Splatting (3DGS) is a new method for modeling and rendering 3D radiance fields that achieves much faster learning and rendering time compared to SOTA NeRF methods. Howe…

cs.CV2023

SlowFormer: Universal Adversarial Patch for Attack on Compute and Energy Efficiency of Inference Efficient Vision Transformers

KL Navaneet, Soroush Abbasi Koohpayegani, Essam Sleiman +1

Recently, there has been a lot of progress in reducing the computation of deep models at inference time. These methods can reduce both the computational needs and power usage of de…

cs.CL2023★ 1 cited

NOLA: Compressing LoRA using Linear Combination of Random Basis

Soroush Abbasi Koohpayegani, KL Navaneet, Parsa Nooralinejad +2

Fine-tuning Large Language Models (LLMs) and storing them for each downstream task or domain is impractical because of the massive model size (e.g., 350GB in GPT-3). Current litera…

cs.CV2022★ 7 cited

Backdoor Attacks on Vision Transformers

Akshayvarun Subramanya, Aniruddha Saha, Soroush Abbasi Koohpayegani +2

Vision Transformers (ViT) have recently demonstrated exemplary performance on a variety of vision tasks and are being used as an alternative to CNNs. Their design is based on a sel…