20 citations · 75 across the 9 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.CL2022
Numerical Optimizations for Weighted Low-rank Estimation on Language Model
Ting Hua, Yen-Chang Hsu, Felicity Wang +3
Singular value decomposition (SVD) is one of the most popular compression methods that approximate a target matrix with smaller matrices. However, standard SVD treats the parameter…
cs.LG2022★ 20 cited
Language model compression with weighted low-rank factorization
Yen-Chang Hsu, Ting Hua, Sungen Chang +3
Factorizing a large matrix into small matrices is a popular strategy for model compression. Singular value decomposition (SVD) plays a vital role in this compression strategy, appr…
cs.CL2022★ 3 cited
Hyperparameter-free Continuous Learning for Domain Classification in Natural Language Understanding
Ting Hua, Yilin Shen, Changsheng Zhao +2
Domain classification is the fundamental task in natural language understanding (NLU), which often requires fast accommodation to new emerging domains. This constraint makes it imp…