Real-Time Apple Detection System Using Embedded Systems With Hardware Accelerators: An Edge AI Application

Abstract

Real-time apple detection in orchards is one of the most effective ways of estimating apple yields, which helps in managing apple supplies more effectively. Traditional detection methods used highly computational machine learning algorithms with intensive hardware set up, which are not suitable for infield real-time apple detection due to their weight and power constraints. In this study, a real-time embedded solution inspired from "Edge AI" is proposed for apple detection with the implementation of YOLOv3-tiny algorithm on various embedded platforms such as Raspberry Pi 3 B+ in combination with Intel Movidius Neural Computing Stick (NCS), Nvidia's Jetson Nano and Jetson AGX Xavier. Data set for training were compiled using acquired images during field survey of apple orchard situated in the north region of Italy, and images used for testing were taken from widely used google data set by filtering out the images containing apples in different scenes to ensure the robustness of the algorithm. The proposed study adapts YOLOv3-tiny architecture to detect small objects. It shows the feasibility of deployment of the customized model on cheap and power-efficient embedded hardware without compromising mean average detection accuracy (83.64%) and achieved frame rate up to 30 fps even for the difficult scenarios such as overlapping apples, complex background, less exposure of apple due to leaves and branches. Furthermore, the proposed embedded solution can be deployed on the unmanned ground vehicles to detect, count, and measure the size of the apples in real-time to help the farmers and agronomists in their decision making and management skills.

References in corpus (11)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• Decoupled Weight Decay Regularization
• YOLOv3: An Incremental Improvement
• Deep learning in agriculture: A survey
• Improved Regularization of Convolutional Neural Networks with Cutout
• Empirical Evaluation of Rectified Activations in Convolutional Network
• Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights
• The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scale
• Apple Flower Detection using Deep Convolutional Networks

Cited by in corpus (9)

• Efficient-CapsNet: Capsule Network with Self-Attention Routing
• Local Motion Planner for Autonomous Navigation in Vineyards with a RGB-D Camera-Based Algorithm and Deep Learning Synergy
• Position-Agnostic Autonomous Navigation in Vineyards with Deep Reinforcement Learning
• DeepWay: a Deep Learning Waypoint Estimator for Global Path Generation
• A Cost-Effective Person-Following System for Assistive Unmanned Vehicles with Deep Learning at the Edge
• Waypoint Generation in Row-based Crops with Deep Learning and Contrastive Clustering
• Autonomous Navigation in Rows of Trees and High Crops with Deep Semantic Segmentation
• Information Fusion for Assistance Systems in Production Assessment
• A Real-time Low-cost Artificial Intelligence System for Autonomous Spraying in Palm Plantations