192 citations · 731 across the 30 of their papers we have counts for
33 papers
Maia 200: A Software Defined Dataflow System for Large-scale AI Acceleration
Sherry Xu, Marco Heddes, Jackson Peng +14
We introduce Maia 200, an advanced AI accelerator delivering high performance-10 145 Tflop/s FP4 and 5072 Tflop/s FP8 within a 750W TDP and 7 TB/s HBM bandwidth. Maia exemplifies a…
UDC: Unified DNAS for Compressible TinyML Models
Igor Fedorov, Ramon Matas, Hokchhay Tann +3
Deploying TinyML models on low-cost IoT hardware is very challenging, due to limited device memory capacity. Neural processing unit (NPU) hardware address the memory challenge by u…
Federated Learning Based on Dynamic Regularization
Durmus Alp Emre Acar, Yue Zhao, Ramon Matas Navarro +3
We propose a novel federated learning method for distributively training neural network models, where the server orchestrates cooperation between a subset of randomly chosen device…
Towards Efficient Point Cloud Graph Neural Networks Through Architectural Simplification
Shyam A. Tailor, René de Jong, Tiago Azevedo +2
In recent years graph neural network (GNN)-based approaches have become a popular strategy for processing point cloud data, regularly achieving state-of-the-art performance on a va…
S2TA: Exploiting Structured Sparsity for Energy-Efficient Mobile CNN Acceleration
Zhi-Gang Liu, Paul N. Whatmough, Yuhao Zhu +1
Exploiting sparsity is a key technique in accelerating quantized convolutional neural network (CNN) inference on mobile devices. Prior sparse CNN accelerators largely exploit un-st…
Doping: A technique for efficient compression of LSTM models using sparse structured additive matrices
Urmish Thakker, Paul N. Whatmough, Zhigang Liu +2
Structured matrices, such as those derived from Kronecker products (KP), are effective at compressing neural networks, but can lead to unacceptable accuracy loss when applied to la…
On the Effects of Quantisation on Model Uncertainty in Bayesian Neural Networks
Martin Ferianc, Partha Maji, Matthew Mattina +1
Bayesian neural networks (BNNs) are making significant progress in many research areas where decision-making needs to be accompanied by uncertainty estimation. Being able to quanti…
Information contraction in noisy binary neural networks and its implications
Chuteng Zhou, Quntao Zhuang, Matthew Mattina +1
Neural networks have gained importance as the machine learning models that achieve state-of-the-art performance on large-scale image classification, object detection and natural la…
Sparse Systolic Tensor Array for Efficient CNN Hardware Acceleration
Zhi-Gang Liu, Paul N. Whatmough, Matthew Mattina
Convolutional neural network (CNN) inference on mobile devices demands efficient hardware acceleration of low-precision (INT8) general matrix multiplication (GEMM). Exploiting data…
Rank and run-time aware compression of NLP Applications
Urmish Thakker, Jesse Beu, Dibakar Gope +2
Sequence model based NLP applications can be large. Yet, many applications that benefit from them run on small devices with very limited compute and storage capabilities, while sti…
High Throughput Matrix-Matrix Multiplication between Asymmetric Bit-Width Operands
Dibakar Gope, Jesse Beu, Matthew Mattina
Matrix multiplications between asymmetric bit-width operands, especially between 8- and 4-bit operands are likely to become a fundamental kernel of many important workloads includi…
Efficient Residue Number System Based Winograd Convolution
Zhi-Gang Liu, Matthew Mattina
Prior research has shown that Winograd algorithm can reduce the computational complexity of convolutional neural networks (CNN) with weights and activations represented in floating…
TinyLSTMs: Efficient Neural Speech Enhancement for Hearing Aids
Igor Fedorov, Marko Stamenovic, Carl Jensen +5
Modern speech enhancement algorithms achieve remarkable noise suppression by means of large recurrent neural networks (RNNs). However, large RNNs limit practical deployment in hear…
Systolic Tensor Array: An Efficient Structured-Sparse GEMM Accelerator for Mobile CNN Inference
Zhi-Gang Liu, Paul N. Whatmough, Matthew Mattina
Convolutional neural network (CNN) inference on mobile devices demands efficient hardware acceleration of low-precision (INT8) general matrix multiplication (GEMM). The systolic ar…
Searching for Winograd-aware Quantized Networks
Javier Fernandez-Marques, Paul N. Whatmough, Andrew Mundy +1
Lightweight architectural designs of Convolutional Neural Networks (CNNs) together with quantization have paved the way for the deployment of demanding computer vision applications…
Noisy Machines: Understanding Noisy Neural Networks and Enhancing Robustness to Analog Hardware Errors Using Distillation
Chuteng Zhou, Prad Kadambi, Matthew Mattina +1
The success of deep learning has brought forth a wave of interest in computer hardware design to better meet the high demands of neural network inference. In particular, analog com…
Compressing Language Models using Doped Kronecker Products
Urmish Thakker, Paul N. Whatmough, Zhi-Gang Liu +2
Kronecker Products (KP) have been used to compress IoT RNN Applications by 15-38x compression factors, achieving better results than traditional compression methods. However when K…
Ternary MobileNets via Per-Layer Hybrid Filter Banks
Dibakar Gope, Jesse Beu, Urmish Thakker +1
MobileNets family of computer vision neural networks have fueled tremendous progress in the design and organization of resource-efficient architectures in recent years. New applica…
ISP4ML: Understanding the Role of Image Signal Processing in Efficient Deep Learning Vision Systems
Patrick Hansen, Alexey Vilkin, Yury Khrustalev +4
Convolutional neural networks (CNNs) are now predominant components in a variety of computer vision (CV) systems. These systems typically include an image signal processor (ISP), e…
Pushing the limits of RNN Compression
Urmish Thakker, Igor Fedorov, Jesse Beu +4
Recurrent Neural Networks (RNN) can be difficult to deploy on resource constrained devices due to their size. As a result, there is a need for compression techniques that can signi…
Run-Time Efficient RNN Compression for Inference on Edge Devices
Urmish Thakker, Jesse Beu, Dibakar Gope +2
Recurrent neural networks can be large and compute-intensive, yet many applications that benefit from RNNs run on small devices with very limited compute and storage capabilities w…
Compressing RNNs for IoT devices by 15-38x using Kronecker Products
Urmish Thakker, Jesse Beu, Dibakar Gope +4
Recurrent Neural Networks (RNN) can be difficult to deploy on resource constrained devices due to their size.As a result, there is a need for compression techniques that can signif…
SpArSe: Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers
Igor Fedorov, Ryan P. Adams, Matthew Mattina +1
The vast majority of processors in the world are actually microcontroller units (MCUs), which find widespread use performing simple control tasks in applications ranging from autom…
Measuring scheduling efficiency of RNNs for NLP applications
Urmish Thakker, Ganesh Dasika, Jesse Beu +1
Recurrent neural networks (RNNs) have shown state of the art results for speech recognition, natural language processing, image captioning and video summarizing applications. Many…