2 papers
cs.LG2023
Probabilistic Weight Fixing: Large-scale training of neural network weight uncertainties for quantization
Christopher Subia-Waud, Srinandan Dasmahapatra
Weight-sharing quantization has emerged as a technique to reduce energy expenditure during inference in large neural networks by constraining their weights to a limited set of valu…
cs.LG2022
Weight Fixing Networks
Christopher Subia-Waud, Srinandan Dasmahapatra
Modern iterations of deep learning models contain millions (billions) of unique parameters, each represented by a b-bit number. Popular attempts at compressing neural networks (suc…