activity
20192021
most citedCompressing RNNs for IoT devices by 15-38x using Kronecker Products

30 citations · 74 across the 7 of their papers we have counts for

collaborators
Showing cs.LGShow all

8 papers · 1 filter

cs.LG2021★ 1 cited

Doping: A technique for efficient compression of LSTM models using sparse structured additive matrices

Urmish Thakker, Paul N. Whatmough, Zhigang Liu +2

Structured matrices, such as those derived from Kronecker products (KP), are effective at compressing neural networks, but can lead to unacceptable accuracy loss when applied to la…

cs.LG2020★ 2 cited

High Throughput Matrix-Matrix Multiplication between Asymmetric Bit-Width Operands

Dibakar Gope, Jesse Beu, Matthew Mattina

Matrix multiplications between asymmetric bit-width operands, especially between 8- and 4-bit operands are likely to become a fundamental kernel of many important workloads includi…

cs.LG2020★ 4 cited

Compressing Language Models using Doped Kronecker Products

Urmish Thakker, Paul N. Whatmough, Zhi-Gang Liu +2

Kronecker Products (KP) have been used to compress IoT RNN Applications by 15-38x compression factors, achieving better results than traditional compression methods. However when K…

cs.LG2019

Ternary MobileNets via Per-Layer Hybrid Filter Banks

Dibakar Gope, Jesse Beu, Urmish Thakker +1

MobileNets family of computer vision neural networks have fueled tremendous progress in the design and organization of resource-efficient architectures in recent years. New applica…

cs.LG2019

Pushing the limits of RNN Compression

Urmish Thakker, Igor Fedorov, Jesse Beu +4

Recurrent Neural Networks (RNN) can be difficult to deploy on resource constrained devices due to their size. As a result, there is a need for compression techniques that can signi…

cs.LG2019★ 24 cited

Run-Time Efficient RNN Compression for Inference on Edge Devices

Urmish Thakker, Jesse Beu, Dibakar Gope +2

Recurrent neural networks can be large and compute-intensive, yet many applications that benefit from RNNs run on small devices with very limited compute and storage capabilities w…

cs.LG2019★ 30 cited

Compressing RNNs for IoT devices by 15-38x using Kronecker Products

Urmish Thakker, Jesse Beu, Dibakar Gope +4

Recurrent Neural Networks (RNN) can be difficult to deploy on resource constrained devices due to their size.As a result, there is a need for compression techniques that can signif…

cs.LG2019

Efficient Winograd or Cook-Toom Convolution Kernel Implementation on Widely Used Mobile CPUs

Partha Maji, Andrew Mundy, Ganesh Dasika +3

The Winograd or Cook-Toom class of algorithms help to reduce the overall compute complexity of many modern deep convolutional neural networks (CNNs). Although there has been a lot…