5 papers
Alignment Adapter to Improve the Performance of Compressed Deep Learning Models
Rohit Raj Rai, Abhishek Dhaka, Amit Awekar
Compressed Deep Learning (DL) models are essential for deployment in resource-constrained environments. But their performance often lags behind their large-scale counterparts. To b…
Models in the Same Family are NOT Trust-Equivalent
Rohit Raj Rai, Chirag Kothari, Siddhesh Shelke +2
Within a model family, a smaller variant is often deployed as a drop-in replacement for a larger one when their performance is similar. However, performance alone does not tell the…
Application Specific Compression of Deep Learning Models
Rohit Raj Rai, Angana Borah, Amit Awekar
Large Deep Learning models are compressed and deployed for specific applications. However, current Deep Learning model compression methods do not utilize the information about the…
Compressed models are NOT miniature versions of large models
Rohit Raj Rai, Rishant Pal, Amit Awekar
Large neural models are often compressed before deployment. Model compression is necessary for many practical reasons, such as inference latency, memory footprint, and energy consu…
Effect of dimensionality change on the bias of word embeddings
Rohit Raj Rai, Amit Awekar
Word embedding methods (WEMs) are extensively used for representing text data. The dimensionality of these embeddings varies across various tasks and implementations. The effect of…