2 papers
cs.LG2023
Partitioning-Guided K-Means: Extreme Empty Cluster Resolution for Extreme Model Compression
Tianhong Huang, Victor Agostinelli, Lizhong Chen
Compactness in deep learning can be critical to a model's viability in low-resource applications, and a common approach to extreme model compression is quantization. We consider It…
cs.CL2023
Improving Autoregressive NLP Tasks via Modular Linearized Attention
Victor Agostinelli, Lizhong Chen
Various natural language processing (NLP) tasks necessitate models that are efficient and small based on their ultimate application at the edge or in other resource-constrained env…