TinyML: Tools, Applications, Challenges, and Future Research Directions

Abstract

In recent years, Artificial Intelligence (AI) and Machine learning (ML) have gained significant interest from both, industry and academia. Notably, conventional ML techniques require enormous amounts of power to meet the desired accuracy, which has limited their use mainly to high-capability devices such as network nodes. However, with many advancements in technologies such as the Internet of Things (IoT) and edge computing, it is desirable to incorporate ML techniques into resource-constrained embedded devices for distributed and ubiquitous intelligence. This has motivated the emergence of the TinyML paradigm which is an embedded ML technique that enables ML applications on multiple cheap, resource- and power-constrained devices. However, during this transition towards appropriate implementation of the TinyML technology, multiple challenges such as processing capacity optimization, improved reliability, and maintenance of learning models' accuracy require timely solutions. In this article, various avenues available for TinyML implementation are reviewed. Firstly, a background of TinyML is provided, followed by detailed discussions on various tools supporting TinyML. Then, state-of-art applications of TinyML using advanced technologies are detailed. Lastly, various research challenges and future directions are identified.

12 pags, 3 tables, 4 figures

References in corpus (8)

• Intelligence at the Extreme Edge: A Survey on Reformable TinyML
• TinyLSTMs: Efficient Neural Speech Enhancement for Hearing Aids
• A Survey on Semantic Communications for Intelligent Wireless Networks
• A Tiny CNN Architecture for Medical Face Mask Detection for Resource-Constrained Endpoints
• Energy-Efficient Inference on the Edge Exploiting TinyML Capabilities for UAVs
• Rethinking Generalization in American Sign Language Prediction for Edge Devices with Extremely Low Memory Footprint
• Differentiable Network Pruning for Microcontrollers
• AutoFlow: Learning a Better Training Set for Optical Flow

Cited by in corpus (3)

• Communications over Unlicensed sub-8 GHz Spectrum: Opportunities and Challenges
• Neural Network-Based Bandit: A Medium Access Control for the IIoT Alarm Scenario
• From Tiny Machine Learning to Tiny Deep Learning: A Survey