1k citations · 1.1k across the 9 of their papers we have counts for
6 papers · 1 filter
Pushing the Limits of Block Rotations in Post-Training Quantization
Sai Sanjeet, Ian Colbert, Pablo Monteagudo-Lago +3
Recent post-training quantization (PTQ) methods have adopted block rotations to diffuse outliers prior to rounding. While this reduces the overhead of online full-vector rotations,…
A2Q+: Improving Accumulator-Aware Weight Quantization
Ian Colbert, Alessandro Pappalardo, Jakoba Petri-Koenig +1
Quantization techniques commonly reduce the inference costs of neural networks by restricting the precision of weights and activations. Recent studies show that also reducing the p…
QONNX: Representing Arbitrary-Precision Quantized Neural Networks
Alessandro Pappalardo, Yaman Umuroglu, Michaela Blott +11
We present extensions to the Open Neural Network Exchange (ONNX) intermediate representation format to represent arbitrary-precision quantized neural networks. We first introduce s…
Open-source FPGA-ML codesign for the MLPerf Tiny Benchmark
Hendrik Borras, Giuseppe Di Guglielmo, Javier Duarte +15
We present our development experience and recent results for the MLPerf Tiny Inference Benchmark on field-programmable gate array (FPGA) platforms. We use the open-source hls4ml an…
EcoFlow: Efficient Convolutional Dataflows for Low-Power Neural Network Accelerators
Lois Orosa, Skanda Koppula, Yaman Umuroglu +5
Dilated and transposed convolutions are widely used in modern convolutional neural networks (CNNs). These kernels are used extensively during CNN training and inference of applicat…
Ps and Qs: Quantization-aware pruning for efficient low latency neural network inference
Benjamin Hawks, Javier Duarte, Nicholas J. Fraser +3
Efficient machine learning implementations optimized for inference in hardware have wide-ranging benefits, depending on the application, from lower inference latency to higher data…