Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Improving the Performance of Compressed Transformers with Post-Hoc Embedding Alignment
Rohit Raj Rai, Abhishek Dhaka, Amit Awekar
Model compression is necessary for deployment of transformer models in resource-constrained environments. However, compression reduces the performance of transformer models on down…
cs.LG2024
Compressed models are NOT miniature versions of large models
Rohit Raj Rai, Rishant Pal, Amit Awekar
Large neural models are often compressed before deployment. Model compression is necessary for many practical reasons, such as inference latency, memory footprint, and energy consu…