Lessons from Deploying CropFollow++: Under-Canopy Agricultural Navigation with Keypoints
2404.17718
0
0
❗
Abstract
We present a vision-based navigation system for under-canopy agricultural robots using semantic keypoints. Autonomous under-canopy navigation is challenging due to the tight spacing between the crop rows ($sim 0.75$ m), degradation in RTK-GPS accuracy due to multipath error, and noise in LiDAR measurements from the excessive clutter. Our system, CropFollow++, introduces modular and interpretable perception architecture with a learned semantic keypoint representation. We deployed CropFollow++ in multiple under-canopy cover crop planting robots on a large scale (25 km in total) in various field conditions and we discuss the key lessons learned from this.
Create account to get full access
Overview
- Presents a vision-based navigation system for under-canopy agricultural robots using semantic keypoints
- Addresses the challenges of autonomous under-canopy navigation, such as tight crop row spacing, degradation of RTK-GPS accuracy, and noise in LiDAR measurements
- Introduces a modular and interpretable perception architecture with a learned semantic keypoint representation, called CropFollow++
- Deployed CropFollow++ on multiple under-canopy cover crop planting robots across a large scale (25 km) in various field conditions
Plain English Explanation
The paper describes a new navigation system for autonomous robots working in agricultural fields with densely planted crops. These robots need to navigate through tight spaces between the crop rows, but this is challenging because the GPS signals can be disrupted, and the laser sensors (LiDAR) have trouble seeing clearly due to all the plants and other obstacles.
The researchers developed a system called CropFollow++ that uses cameras and computer vision techniques to help the robots understand their surroundings. Instead of relying solely on GPS and LiDAR, CropFollow++ learns to recognize important visual "landmarks" or keypoints in the environment, such as specific features of the crops, soil, or other objects. This allows the robots to navigate more precisely, even in the cramped conditions under the crop canopy.
The researchers deployed CropFollow++ on real robots working in agricultural fields over a total distance of 25 kilometers. They learned some valuable lessons from this real-world testing, which they discuss in the paper.
Technical Explanation
The authors present a vision-based navigation system called CropFollow++ that uses a learned semantic keypoint representation to enable autonomous navigation for under-canopy agricultural robots. Under-canopy navigation is challenging due to factors like tight crop row spacing, degradation of RTK-GPS accuracy, and noise in LiDAR measurements from the excessive clutter.
The CropFollow++ system introduces a modular and interpretable perception architecture that learns to detect semantic keypoints in the environment. This allows the robots to navigate more precisely, even in the confined spaces under the crop canopy, without relying solely on GPS and LiDAR. The researchers deployed CropFollow++ on multiple under-canopy cover crop planting robots across a large scale (25 km) in various field conditions and discuss the key lessons learned from this real-world deployment.
Critical Analysis
The paper presents a promising approach to address the significant challenges of autonomous under-canopy navigation, which is a crucial capability for advanced agricultural robotics. The use of learned semantic keypoints to augment traditional sensors like GPS and LiDAR is an interesting and potentially powerful solution.
However, the paper does not provide a detailed evaluation of the system's performance, such as quantitative metrics on navigation accuracy, reliability, or efficiency. Additionally, the paper does not discuss potential limitations or edge cases that the system may struggle with, such as how it handles changes in lighting conditions, crop growth stages, or unexpected obstacles.
Further research could explore the generalizability of the CropFollow++ approach to different crop types and field conditions, as well as investigate ways to make the system more robust and adaptable. Comparisons to other state-of-the-art under-canopy navigation techniques would also help contextualize the contributions of this work.
Conclusion
This paper presents a vision-based navigation system called CropFollow++ that uses a learned semantic keypoint representation to enable autonomous under-canopy navigation for agricultural robots. The approach addresses the significant challenges of working in the tight, cluttered spaces under crop canopies, where traditional sensors like GPS and LiDAR can struggle.
The real-world deployment of CropFollow++ on cover crop planting robots over a large scale demonstrates the potential of this technology to enhance the capabilities of agricultural robotics. As the field of precision agriculture continues to advance, systems like CropFollow++ could play a key role in enabling more autonomous and adaptable solutions for sustainable food production.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
A Vision-Based Navigation System for Arable Fields
Rajitha de Silva, Grzegorz Cielniak, Junfeng Gao
0
0
Vision-based navigation systems in arable fields are an underexplored area in agricultural robot navigation. Vision systems deployed in arable fields face challenges such as fluctuating weed density, varying illumination levels, growth stages and crop row irregularities. Current solutions are often crop-specific and aimed to address limited individual conditions such as illumination or weed density. Moreover, the scarcity of comprehensive datasets hinders the development of generalised machine learning systems for navigating these fields. This paper proposes a suite of deep learning-based perception algorithms using affordable vision sensors for vision-based navigation in arable fields. Initially, a comprehensive dataset that captures the intricacies of multiple crop seasons, various crop types, and a range of field variations was compiled. Next, this study delves into the creation of robust infield perception algorithms capable of accurately detecting crop rows under diverse conditions such as different growth stages, weed density, and varying illumination. Further, it investigates the integration of crop row following with vision-based crop row switching for efficient field-scale navigation. The proposed infield navigation system was tested in commercial arable fields traversing a total distance of 4.5 km with average heading and cross-track errors of 1.24{deg} and 3.32 cm respectively.
5/29/2024
LiDAR-Based Crop Row Detection Algorithm for Over-Canopy Autonomous Navigation in Agriculture Fields
Ruiji Liu, Francisco Yandun, George Kantor
0
0
Autonomous navigation is crucial for various robotics applications in agriculture. However, many existing methods depend on RTK-GPS systems, which are expensive and susceptible to poor signal coverage. This paper introduces a state-of-the-art LiDAR-based navigation system that can achieve over-canopy autonomous navigation in row-crop fields, even when the canopy fully blocks the interrow spacing. Our crop row detection algorithm can detect crop rows across diverse scenarios, encompassing various crop types, growth stages, weeds presence, and discontinuities within the crop rows. Without utilizing the global localization of the robot, our navigation system can perform autonomous navigation in these challenging scenarios, detect the end of the crop rows, and navigate to the next crop row autonomously, providing a crop-agnostic approach to navigate the whole row-crop field. This navigation system has undergone tests in various simulated agricultural fields, achieving an average of 2.98cm autonomous driving accuracy without human intervention on the custom Amiga robot. In addition, the qualitative results of our crop row detection algorithm from the actual soybean fields validate our LiDAR-based crop row detection algorithm's potential for practical agricultural applications.
5/9/2024
Under-Canopy Navigation using Aerial Lidar Maps
Lucas Carvalho de Lima, Nicholas Lawrance, Kasra Khosoussi, Paulo Borges, Michael Bruenig
0
0
Autonomous navigation in unstructured natural environments poses a significant challenge. In goal navigation tasks without prior information, the limited look-ahead of onboard sensors utilised by robots compromises path efficiency. We propose a novel approach that leverages an above-the-canopy aerial map for improved ground robot navigation. Our system utilises aerial lidar scans to create a 3D probabilistic occupancy map, uniquely incorporating the uncertainty in the aerial vehicle's trajectory for improved accuracy. Novel path planning cost functions are introduced, combining path length with obstruction risk estimated from the probabilistic map. The D-Star Lite algorithm then calculates an optimal (minimum-cost) path to the goal. This system also allows for dynamic replanning upon encountering unforeseen obstacles on the ground. Extensive experiments and ablation studies in simulated and real forests demonstrate the effectiveness of our system.
6/19/2024
GPS-free Autonomous Navigation in Cluttered Tree Rows with Deep Semantic Segmentation
Alessandro Navone, Mauro Martini, Marco Ambrosio, Andrea Ostuni, Simone Angarano, Marcello Chiaberge
0
0
Segmentation-based autonomous navigation has recently been presented as an appealing approach to guiding robotic platforms through crop rows without requiring perfect GPS localization. Nevertheless, current techniques are restricted to situations where the distinct separation between the plants and the sky allows for the identification of the row's center. However, tall, dense vegetation, such as high tree rows and orchards, is the primary cause of GPS signal blockage. In this study, we increase the overall robustness and adaptability of the control algorithm by extending the segmentation-based robotic guiding to those cases where canopies and branches occlude the sky and prevent the utilization of GPS and earlier approaches. An efficient Deep Neural Network architecture has been used to address semantic segmentation, performing the training with synthetic data only. Numerous vineyards and tree fields have undergone extensive testing in both simulation and real-world to show the solution's competitive benefits.
4/9/2024