DeepCorn: A Semi-Supervised Deep Learning Method for High-Throughput Image-Based Corn Kernel Counting and Yield Estimation

Abstract

The success of modern farming and plant breeding relies on accurate and efficient collection of data. For a commercial organization that manages large amounts of crops, collecting accurate and consistent data is a bottleneck. Due to limited time and labor, accurately phenotyping crops to record color, head count, height, weight, etc. is severely limited. However, this information, combined with other genetic and environmental factors, is vital for developing new superior crop species that help feed the world's growing population. Recent advances in machine learning, in particular deep learning, have shown promise in mitigating this bottleneck. In this paper, we propose a novel deep learning method for counting on-ear corn kernels in-field to aid in the gathering of real-time data and, ultimately, to improve decision making to maximize yield. We name this approach DeepCorn, and show that this framework is robust under various conditions. DeepCorn estimates the density of corn kernels in an image of corn ears and predicts the number of kernels based on the estimated density map. DeepCorn uses a truncated VGG-16 as a backbone for feature extraction and merges feature maps from multiple scales of the network to make it robust against image scale variations. We also adopt a semi-supervised learning approach to further improve the performance of our proposed method. Our proposed method achieves the MAE and RMSE of 41.36 and 60.27 in the corn kernel counting task, respectively. Our experimental results demonstrate the superiority and effectiveness of our proposed method compared to other state-of-the-art methods.

arXiv comment27 pages, 7 figures

References in corpus (15)

• Adam: A Method for Stochastic Optimization
• Very Deep Convolutional Networks for Large-Scale Image Recognition
• TensorFlow: A system for large-scale machine learning
• EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
• Deep Residual Learning for Image Recognition
• Crop Yield Prediction Using Deep Neural Networks
• SCAR: Spatial-/Channel-wise Attention Regression Networks for Crowd Counting
• CNN-based Density Estimation and Crowd Counting: A Survey
• CrowdNet: A Deep Convolutional Network for Dense Crowd Counting
• Convolutional Neural Networks for Image-based Corn Kernel Detection and Counting
• Predicting Yield Performance of Parents in Plant Breeding: A Neural Collaborative Filtering Approach
• Classification of Crop Tolerance to Heat and Drought: A Deep Convolutional Neural Networks Approach
• W-Net: Reinforced U-Net for Density Map Estimation
• Image-Based Sorghum Head Counting When You Only Look Once
• MTCNET: Multi-task Learning Paradigm for Crowd Count Estimation

Cited by in corpus (3)

• Simultaneous Corn and Soybean Yield Prediction from Remote Sensing Data Using Deep Transfer Learning
• 3D Reconstruction-Based Seed Counting of Sorghum Panicles for Agricultural Inspection
• Automated Seed Quality Testing System using GAN & Active Learning