10 citations
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
Are Compressed Language Models Less Subgroup Robust?
Leonidas Gee, Andrea Zugarini, Novi Quadrianto
To reduce the inference cost of large language models, model compression is increasingly used to create smaller scalable models. However, little is known about their robustness to…
cs.CL2024★ 10 cited
Fast Vocabulary Transfer for Language Model Compression
Leonidas Gee, Andrea Zugarini, Leonardo Rigutini +1
Real-world business applications require a trade-off between language model performance and size. We propose a new method for model compression that relies on vocabulary transfer.…