4 citations · 5 across the 3 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
AMS-QUANT: Adaptive Mantissa Sharing for Floating-point Quantization
Mengtao Lv, Ruiqi Zhu, Xinyu Wang +1
Large language models (LLMs) have demonstrated remarkable capabilities in various kinds of tasks, while the billion or even trillion parameters bring storage and efficiency bottlen…
cs.LG2023★ 4 cited
E-Sparse: Boosting the Large Language Model Inference through Entropy-based N:M Sparsity
Yun Li, Lin Niu, Xipeng Zhang +3
Traditional pruning methods are known to be challenging to work in Large Language Models (LLMs) for Generative AI because of their unaffordable training process and large computati…