1 citations · 1 across the 1 of their papers we have counts for
3 papers
cs.LG2026★ 1 cited
Robust Training of Neural Networks at Arbitrary Precision and Sparsity
Chengxi Ye, Grace Chu, Yanfeng Liu +5
The discontinuous operations inherent in quantization and sparsification introduce a long-standing obstacle to backpropagation, particularly in ultra-low precision and sparse regim…
cs.CV2024
MobileNetV4 -- Universal Models for the Mobile Ecosystem
Danfeng Qin, Chas Leichner, Manolis Delakis +11
We present the latest generation of MobileNets, known as MobileNetV4 (MNv4), featuring universally efficient architecture designs for mobile devices. At its core, we introduce the…
cs.LG2024
Custom Gradient Estimators are Straight-Through Estimators in Disguise
Matt Schoenbauer, Daniele Moro, Lukasz Lew +1
Quantization-aware training comes with a fundamental challenge: the derivative of quantization functions such as rounding are zero almost everywhere and nonexistent elsewhere. Vari…