307 citations · 693 across the 70 of their papers we have counts for
6 papers · 1 filter
ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models
Xiang Meng, Kayhan Behdin, Haoyue Wang +1
The impressive performance of Large Language Models (LLMs) across various natural language processing tasks comes at the cost of vast computational resources and storage requiremen…
FALCON: FLOP-Aware Combinatorial Optimization for Neural Network Pruning
Xiang Meng, Wenyu Chen, Riade Benbaki +1
The increasing computational demands of modern neural networks present deployment challenges on resource-constrained devices. Network pruning offers a solution to reduce model size…
OSSCAR: One-Shot Structured Pruning in Vision and Language Models with Combinatorial Optimization
Xiang Meng, Shibal Ibrahim, Kayhan Behdin +3
Structured pruning is a promising approach for reducing the inference costs of large vision and language models. By removing carefully chosen structures, e.g., neurons or attention…
Randomization Can Reduce Both Bias and Variance: A Case Study in Random Forests
Brian Liu, Rahul Mazumder
We study the often overlooked phenomenon, first noted in \cite{breiman2001random}, that random forests appear to reduce bias compared to bagging. Motivated by an interesting paper…
FAST: An Optimization Framework for Fast Additive Segmentation in Transparent ML
Brian Liu, Rahul Mazumder
We present FAST, an optimization framework for fast additive segmentation. FAST segments piecewise constant shape functions for each feature in a dataset to produce transparent add…
FFSplit: Split Feed-Forward Network For Optimizing Accuracy-Efficiency Trade-off in Language Model Inference
Zirui Liu, Qingquan Song, Qiang Charles Xiao +4
The large number of parameters in Pretrained Language Models enhance their performance, but also make them resource-intensive, making it challenging to deploy them on commodity har…