12 citations · 37 across the 8 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.PF2022
FullPack: Full Vector Utilization for Sub-Byte Quantized Inference on General Purpose CPUs
Hossein Katebi, Navidreza Asadi, Maziar Goudarzi
Although prior art has demonstrated negligible accuracy drop in sub-byte quantization -- where weights and/or activations are represented by less than 8 bits -- popular SIMD instru…
cs.DC2022★ 12 cited
Variant Parallelism: Lightweight Deep Convolutional Models for Distributed Inference on IoT Devices
Navidreza Asadi, Maziar Goudarzi
Two major techniques are commonly used to meet real-time inference limitations when distributing models across resource-constrained IoT devices: (1) model parallelism (MP) and (2)…