11 citations · 24 across the 6 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2024
Do deep neural networks utilize the weight space efficiently?
Onur Can Koyun, Behçet Uğur Töreyin
Deep learning models like Transformers and Convolutional Neural Networks (CNNs) have revolutionized various domains, but their parameter-intensive nature hampers deployment in reso…
cs.LG2021★ 7 cited
PURSUhInT: In Search of Informative Hint Points Based on Layer Clustering for Knowledge Distillation
Reyhan Kevser Keser, Aydin Ayanzadeh, Omid Abdollahi Aghdam +3
One of the most efficient methods for model compression is hint distillation, where the student model is injected with information (hints) from several different layers of the teac…