7 citations · 15 across the 9 of their papers we have counts for
5 papers · 1 filter
QGen: On the Ability to Generalize in Quantization Aware Training
MohammadHossein AskariHemmat, Ahmadreza Jeddi, Reyhane Askari Hemmat +6
Quantization lowers memory usage, computational requirements, and latency by utilizing fewer bits to represent model weights and activations. In this work, we investigate the gener…
DeepliteRT: Computer Vision at the Edge
Saad Ashfaq, Alexander Hoffman, Saptarshi Mitra +3
The proliferation of edge devices has unlocked unprecedented opportunities for deep learning model deployment in computer vision applications. However, these complex models require…
DeepGEMM: Accelerated Ultra Low-Precision Inference on CPU Architectures using Lookup Tables
Darshan C. Ganji, Saad Ashfaq, Ehsan Saboori +6
A lot of recent progress has been made in ultra low-bit quantization, promising significant improvements in latency, memory footprint and energy consumption on edge devices. Quanti…
Accelerating Deep Learning Model Inference on Arm CPUs with Ultra-Low Bit Quantization and Runtime
Saad Ashfaq, MohammadHossein AskariHemmat, Sudhakar Sah +3
Deep Learning has been one of the most disruptive technological advancements in recent times. The high performance of deep learning models comes at the expense of high computationa…
Deeplite Neutrino: An End-to-End Framework for Constrained Deep Learning Model Optimization
Anush Sankaran, Olivier Mastropietro, Ehsan Saboori +4
Designing deep learning-based solutions is becoming a race for training deeper models with a greater number of layers. While a large-size deeper model could provide competitive acc…