2 papers
cs.LG2024
Post-Training Statistical Calibration for Higher Activation Sparsity
Vui Seng Chua, Yujie Pan, Nilesh Jain
We present Statistical Calibrated Activation Pruning (SCAP), a post-training activation pruning framework that (1) generalizes sparsification by input activations of Fully-Connecte…
cs.LG2024
Shears: Unstructured Sparsity with Neural Low-rank Adapter Search
J. Pablo Muñoz, Jinjie Yuan, Nilesh Jain
Recently, several approaches successfully demonstrated that weight-sharing Neural Architecture Search (NAS) can effectively explore a search space of elastic low-rank adapters (LoR…