4 papers
FouRA: Fourier Low Rank Adaptation
Shubhankar Borse, Shreya Kadambi, Nilesh Prasad Pandey +7
While Low-Rank Adaptation (LoRA) has proven beneficial for efficiently fine-tuning large models, LoRA fine-tuned text-to-image diffusion models lack diversity in the generated imag…
Oh! We Freeze: Improving Quantized Knowledge Distillation via Signal Propagation Analysis for Large Language Models
Kartikeya Bhardwaj, Nilesh Prasad Pandey, Sweta Priyadarshi +3
Large generative models such as large language models (LLMs) and diffusion models have revolutionized the fields of NLP and computer vision respectively. However, their slow infere…
ZiCo-BC: A Bias Corrected Zero-Shot NAS for Vision Tasks
Kartikeya Bhardwaj, Hsin-Pai Cheng, Sweta Priyadarshi +1
Zero-Shot Neural Architecture Search (NAS) approaches propose novel training-free metrics called zero-shot proxies to substantially reduce the search time compared to the tradition…
Super-Efficient Super Resolution for Fast Adversarial Defense at the Edge
Kartikeya Bhardwaj, Dibakar Gope, James Ward +2
Autonomous systems are highly vulnerable to a variety of adversarial attacks on Deep Neural Networks (DNNs). Training-free model-agnostic defenses have recently gained popularity d…