4 papers
STResNet & STYOLO : A New Family of Compact Classification and Object Detection Models for MCUs
Sudhakar Sah, Ravish Kumar
Recent advancements in lightweight neural networks have significantly improved the efficiency of deploying deep learning models on edge hardware. However, most existing architectur…
CompressNAS : A Fast and Efficient Technique for Model Compression using Decomposition
Sudhakar Sah, Nikhil Chabbra, Matthieu Durnerin
Deep Convolutional Neural Networks (CNNs) are increasingly difficult to deploy on microcontrollers (MCUs) and lightweight NPUs (Neural Processing Units) due to their growing size a…
ActNAS : Generating Efficient YOLO Models using Activation NAS
Sudhakar Sah, Ravish Kumar, Darshan C. Ganji +1
Activation functions introduce non-linearity into Neural Networks, enabling them to learn complex patterns. Different activation functions vary in speed and accuracy, ranging from…
Token Pruning using a Lightweight Background Aware Vision Transformer
Sudhakar Sah, Ravish Kumar, Honnesh Rohmetra +1
High runtime memory and high latency puts significant constraint on Vision Transformer training and inference, especially on edge devices. Token pruning reduces the number of input…