activity
20172024
most citedLanguage model compression with weighted low-rank factorization

20 citations · 75 across the 9 of their papers we have counts for

collaborators

9 papers

cs.CL2024★ 1 cited

DISP-LLM: Dimension-Independent Structural Pruning for Large Language Models

Shangqian Gao, Chi-Heng Lin, Ting Hua +4

Large Language Models (LLMs) have achieved remarkable success in various natural language processing tasks, including language modeling, understanding, and generation. However, the…

cs.CV2023

Prompt Tuning for Zero-shot Compositional Learning

Lingyu Zhang, Ting Hua, Yilin Shen +1

Open World Compositional Zero-Shot Learning (OW-CZSL) is known to be an extremely challenging task, which aims to recognize unseen compositions formed from seen attributes and obje…

cs.CR2023★ 12 cited

TrojLLM: A Black-box Trojan Prompt Attack on Large Language Models

Jiaqi Xue, Mengxin Zheng, Ting Hua +4

Large Language Models (LLMs) are progressively being utilized as machine learning services and interface tools for various applications. However, the security implications of LLMs,…

cs.CV2023★ 20 cited

Continual Diffusion: Continual Customization of Text-to-Image Diffusion with C-LoRA

James Seale Smith, Yen-Chang Hsu, Lingyu Zhang +4

Recent works demonstrate a remarkable ability to customize text-to-image diffusion models while only providing a few example images. What happens if you try to customize such model…

cs.CL2022

Numerical Optimizations for Weighted Low-rank Estimation on Language Model

Ting Hua, Yen-Chang Hsu, Felicity Wang +3

Singular value decomposition (SVD) is one of the most popular compression methods that approximate a target matrix with smaller matrices. However, standard SVD treats the parameter…

cs.LG2022★ 20 cited

Language model compression with weighted low-rank factorization

Yen-Chang Hsu, Ting Hua, Sungen Chang +3

Factorizing a large matrix into small matrices is a popular strategy for model compression. Singular value decomposition (SVD) plays a vital role in this compression strategy, appr…

cs.CL2022★ 3 cited

Hyperparameter-free Continuous Learning for Domain Classification in Natural Language Understanding

Ting Hua, Yilin Shen, Changsheng Zhao +2

Domain classification is the fundamental task in natural language understanding (NLU), which often requires fast accommodation to new emerging domains. This constraint makes it imp…

cs.CL2021★ 16 cited

Automatic Mixed-Precision Quantization Search of BERT

Changsheng Zhao, Ting Hua, Yilin Shen +2

Pre-trained language models such as BERT have shown remarkable effectiveness in various natural language processing tasks. However, these models usually contain millions of paramet…

math.CO2017★ 3 cited

Mahonian STAT on rearrangement class of words

Shishuo Fu, Ting Hua, Vincent Vajnovszki

In 2000, Babson and Steingrímsson generalized the notion of permutation patterns to the so-called vincular patterns, and they showed that many Mahonian statistics can be expressed…