Learned Visual Navigation for Under-Canopy Agricultural Robots
arXiv:2107.02792 · doi:10.15607/RSS.2021.XVII.019
Abstract
We describe a system for visually guided autonomous navigation of under-canopy farm robots. Low-cost under-canopy robots can drive between crop rows under the plant canopy and accomplish tasks that are infeasible for over-the-canopy drones or larger agricultural equipment. However, autonomously navigating them under the canopy presents a number of challenges: unreliable GPS and LiDAR, high cost of sensing, challenging farm terrain, clutter due to leaves and weeds, and large variability in appearance over the season and across crop types. We address these challenges by building a modular system that leverages machine learning for robust and generalizable perception from monocular RGB images from low-cost cameras, and model predictive control for accurate control in challenging terrain. Our system, CropFollow, is able to autonomously drive 485 meters per intervention on average, outperforming a state-of-the-art LiDAR based system (286 meters per intervention) in extensive field testing spanning over 25 km.
RSS 2021. Project website with data and videos: https://ansivakumar.github.io/learned-visual-navigation/
References in corpus (7)
- Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning
- Deep Steering: Learning End-to-End Driving Model from Spatial and Temporal Visual Cues
- Local Motion Planner for Autonomous Navigation in Vineyards with a RGB-D Camera-Based Algorithm and Deep Learning Synergy
- High Precision Control of Tracked Field Robots in the Presence of Unknown Traction Coefficients
- Multi-Sensor Fusion based Robust Row Following for Compact Agricultural Robots
- Integrating Egocentric Localization for More Realistic Point-Goal Navigation Agents
- Design and Construction of Unmanned Ground Vehicles for Sub-Canopy Plant Phenotyping
Cited by in corpus (6)
- WayFAST: Navigation with Predictive Traversability in the Field
- Verifying Controllers with Convolutional Neural Network-based Perception: A Case for Intelligible, Safe, and Precise Abstractions
- Deep Model Predictive Control with Stability Guarantees
- CropNav: a Framework for Autonomous Navigation in Real Farms
- Fed-EC: Bandwidth-Efficient Clustering-Based Federated Learning For Autonomous Visual Robot Navigation
- End-to-End Crop Row Navigation via LiDAR-Based Deep Reinforcement Learning