activity
20232026
most citedKnowledge Distillation in Vision Transformers: A Critical Review

13 citations · 29 across the 11 of their papers we have counts for

collaborators
Showing cs.CVShow all

7 papers · 1 filter

cs.CV2026

XEns-CKD: An Explainable Ensemble-Based Approach for Chronic Kidney Disease Stage Detection

Rehan Ahmad, Gousia Habib, Muhammad Shaban +1

Chronic kidney disease (CKD) is a silent disease. Its progression may not significantly hamper a person's daily routine. Human kidney function can be classified as normal or as one…

cs.CV2024★ 1 cited

Optimizing Vision Transformers with Data-Free Knowledge Transfer

Gousia Habib, Damandeep Singh, Ishfaq Ahmad Malik +1

The groundbreaking performance of transformers in Natural Language Processing (NLP) tasks has led to their replacement of traditional Convolutional Neural Networks (CNNs), owing to…

cs.CV2024★ 3 cited

Harnessing The Power of Attention For Patch-Based Biomedical Image Classification

Gousia Habib, Shaima Qureshi, Malik ishfaq

Biomedical image analysis is of paramount importance for the advancement of healthcare and medical research. Although conventional convolutional neural networks (CNNs) are frequent…

cs.CV2024★ 2 cited

Exploring the Efficacy of Group-Normalization in Deep Learning Models for Alzheimer's Disease Classification

Gousia Habib, Ishfaq Ahmed Malik, Jameel Ahmad +2

Batch Normalization is an important approach to advancing deep learning since it allows multiple networks to train simultaneously. A problem arises when normalizing along the batch…

cs.CV2024★ 10 cited

A Comprehensive Review of Knowledge Distillation in Computer Vision

Gousia Habib, Tausifa jan Saleem, Sheikh Musa Kaleem +2

Deep learning techniques have been demonstrated to surpass preceding cutting-edge machine learning techniques in recent years, with computer vision being one of the most prominent…

cs.CV2023

LIB-KD: Teaching Inductive Bias for Efficient Vision Transformer Distillation and Compression

Gousia Habib, Tausifa Jan Saleem, Ishfaq Ahmad Malik +1

With the rapid development of computer vision, Vision Transformers (ViTs) offer the tantalising prospect of unified information processing across visual and textual domains due to…

cs.CV2023★ 13 cited

Knowledge Distillation in Vision Transformers: A Critical Review

Gousia Habib, Tausifa Jan Saleem, Brejesh Lall

In Natural Language Processing (NLP), Transformers have already revolutionized the field by utilizing an attention-based encoder-decoder model. Recently, some pioneering works have…