Precise Apple Detection and Localization in Orchards using YOLOv5 for Robotic Harvesting Systems

Read original: arXiv:2405.06260 - Published 5/13/2024 by Jiang Ziyue, Yin Bo, Lu Boyun
Total Score

0

šŸ”Ž

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a novel approach to apple detection and position estimation using the YOLOv5 object detection model.
  • The researchers aimed to develop a robust system for identifying apples in complex orchard environments and providing precise location information.
  • The system was evaluated against other popular object detection models, such as SSD, and demonstrated an impressive apple detection accuracy of approximately 85%.

Plain English Explanation

The paper describes a new way to use artificial intelligence (AI) to help with fruit harvesting, specifically for apple farms. The key problem they wanted to solve was accurately detecting and locating apples on trees, which is crucial for robotic harvesting systems.

To do this, the researchers used a type of AI model called YOLOv5, which is good at quickly identifying objects in images. They trained this model using a dataset of images they collected from apple orchards, showing apples in various conditions and surroundings.

When they tested the YOLOv5 model, they found it could detect apples with around 85% accuracy, which is better than other popular object detection models like SSD. This means the system can reliably locate apples on trees, which is an important step towards automating fruit harvesting with robots.

The researchers believe this technology could lead to more efficient and sustainable apple harvesting practices, as robots could potentially work faster and more precisely than human laborers. This could be especially useful for large commercial orchards.

Technical Explanation

The researchers leveraged the YOLOv5 object detection model to tackle the challenge of accurately detecting and localizing apples in complex orchard environments. They curated a dataset of diverse apple tree images, which was automatically labeled for training and evaluation purposes.

Through extensive experimentation, the team compared the performance of their YOLOv5-based system against other popular object detection models, including SSD. The results demonstrated that the YOLOv5 model outperformed its counterparts, achieving an impressive apple detection accuracy of approximately 85%.

This high level of accuracy in apple detection and position estimation represents a significant advancement in the field of agricultural robotics. The researchers believe their proposed system lays the groundwork for more efficient and sustainable fruit harvesting practices, as it could enable the development of more capable robotic harvesting systems.

Critical Analysis

The paper provides a robust and well-designed study, with the researchers carefully curating a comprehensive dataset and conducting thorough experiments to evaluate their YOLOv5-based system. However, the paper does not delve into the potential limitations or challenges of deploying such a system in real-world commercial orchards.

For example, the researchers do not address how the system might perform in varying weather conditions, different lighting scenarios, or with different apple cultivars. Additionally, the paper does not discuss the computational requirements or processing speeds of the YOLOv5 model, which could be crucial factors for implementing the system on mobile robotic platforms.

Further research could explore the integration of the apple detection and localization system with other components, such as robotic manipulators or computer vision techniques for sizing and maturity assessment, to create a comprehensive robotic harvesting solution.

Conclusion

This paper presents a promising approach to apple detection and position estimation using the YOLOv5 object detection model. The researchers have demonstrated that their system can achieve a high level of accuracy in identifying apples within complex orchard environments, which is a critical step towards the development of more advanced and autonomous fruit harvesting robots.

While the study provides a solid foundation, further research is needed to address the potential limitations and challenges of deploying such a system in real-world commercial orchards. By addressing these concerns and integrating the apple detection capabilities with other robotic technologies, the researchers can help drive the advancement of agricultural robotics and contribute to more efficient and sustainable fruit harvesting practices.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on š• ā†’

Related Papers

šŸ”Ž

Total Score

0

Precise Apple Detection and Localization in Orchards using YOLOv5 for Robotic Harvesting Systems

Jiang Ziyue, Yin Bo, Lu Boyun

The advancement of agricultural robotics holds immense promise for transforming fruit harvesting practices, particularly within the apple industry. The accurate detection and localization of fruits are pivotal for the successful implementation of robotic harvesting systems. In this paper, we propose a novel approach to apple detection and position estimation utilizing an object detection model, YOLOv5. Our primary objective is to develop a robust system capable of identifying apples in complex orchard environments and providing precise location information. To achieve this, we curated an autonomously labeled dataset comprising diverse apple tree images, which was utilized for both training and evaluation purposes. Through rigorous experimentation, we compared the performance of our YOLOv5-based system with other popular object detection models, including SSD. Our results demonstrate that the YOLOv5 model outperforms its counterparts, achieving an impressive apple detection accuracy of approximately 85%. We believe that our proposed system's accurate apple detection and position estimation capabilities represent a significant advancement in agricultural robotics, laying the groundwork for more efficient and sustainable fruit harvesting practices.

Read more

5/13/2024

šŸ”Ž

Total Score

0

Immature Green Apple Detection and Sizing in Commercial Orchards using YOLOv8 and Shape Fitting Techniques

Ranjan Sapkota, Dawood Ahmed, Martin Churuvija, Manoj Karkee

Detecting and estimating size of apples during the early stages of growth is crucial for predicting yield, pest management, and making informed decisions related to crop-load management, harvest and post-harvest logistics, and marketing. Traditional fruit size measurement methods are laborious and timeconsuming. This study employs the state-of-the-art YOLOv8 object detection and instance segmentation algorithm in conjunction with geometric shape fitting techniques on 3D point cloud data to accurately determine the size of immature green apples (or fruitlet) in a commercial orchard environment. The methodology utilized two RGB-D sensors: Intel RealSense D435i and Microsoft Azure Kinect DK. Notably, the YOLOv8 instance segmentation models exhibited proficiency in immature green apple detection, with the YOLOv8m-seg model achieving the highest [email protected] and [email protected] scores of 0.94 and 0.91, respectively. Using the ellipsoid fitting technique on images from the Azure Kinect, we achieved an RMSE of 2.35 mm, MAE of 1.66 mm, MAPE of 6.15 mm, and an R-squared value of 0.9 in estimating the size of apple fruitlets. Challenges such as partial occlusion caused some error in accurately delineating and sizing green apples using the YOLOv8-based segmentation technique, particularly in fruit clusters. In a comparison with 102 outdoor samples, the size estimation technique performed better on the images acquired with Microsoft Azure Kinect than the same with Intel Realsense D435i. This superiority is evident from the metrics: the RMSE values (2.35 mm for Azure Kinect vs. 9.65 mm for Realsense D435i), MAE values (1.66 mm for Azure Kinect vs. 7.8 mm for Realsense D435i), and the R-squared values (0.9 for Azure Kinect vs. 0.77 for Realsense D435i).

Read more

4/3/2024

YOLOv1 to YOLOv10: A comprehensive review of YOLO variants and their application in the agricultural domain
Total Score

0

YOLOv1 to YOLOv10: A comprehensive review of YOLO variants and their application in the agricultural domain

Mujadded Al Rabbani Alif, Muhammad Hussain

This survey investigates the transformative potential of various YOLO variants, from YOLOv1 to the state-of-the-art YOLOv10, in the context of agricultural advancements. The primary objective is to elucidate how these cutting-edge object detection models can re-energise and optimize diverse aspects of agriculture, ranging from crop monitoring to livestock management. It aims to achieve key objectives, including the identification of contemporary challenges in agriculture, a detailed assessment of YOLO's incremental advancements, and an exploration of its specific applications in agriculture. This is one of the first surveys to include the latest YOLOv10, offering a fresh perspective on its implications for precision farming and sustainable agricultural practices in the era of Artificial Intelligence and automation. Further, the survey undertakes a critical analysis of YOLO's performance, synthesizes existing research, and projects future trends. By scrutinizing the unique capabilities packed in YOLO variants and their real-world applications, this survey provides valuable insights into the evolving relationship between YOLO variants and agriculture. The findings contribute towards a nuanced understanding of the potential for precision farming and sustainable agricultural practices, marking a significant step forward in the integration of advanced object detection technologies within the agricultural sector.

Read more

6/17/2024

šŸš€

Total Score

0

Comprehensive Performance Evaluation of YOLOv10, YOLOv9 and YOLOv8 on Detecting and Counting Fruitlet in Complex Orchard Environments

Ranjan Sapkota, Zhichao Meng, Martin Churuvija, Xiaoqiang Du, Zenghong Ma, Manoj Karkee

This study performed an extensive evaluation of the performances of all configurations of YOLOv8, YOLOv9, and YOLOv10 object detection algorithms for fruitlet (of green fruit) detection in commercial orchards. Additionally, this research performed and validated in-field counting of fruitlets using an iPhone and machine vision sensors in 5 different apple varieties (Scifresh, Scilate, Honeycrisp, Cosmic crisp & Golden delicious). This comprehensive investigation of total 17 different configurations (5 for YOLOv8, 6 for YOLOv9 and 6 for YOLOv10) revealed that YOLOv9 outperforms YOLOv10 and YOLOv8 in terms of mAP@50, while YOLOv10x outperformed all 17 configurations tested in terms of precision and recall. Specifically, YOLOv9 Gelan-e achieved the highest mAP@50 of 0.935, outperforming YOLOv10n's 0.921 and YOLOv8s's 0.924. In terms of precision, YOLOv10x achieved the highest precision of 0.908, indicating superior object identification accuracy compared to other configurations tested (e.g. YOLOv9 Gelan-c with a precision of 0.903 and YOLOv8m with 0.897. In terms of recall, YOLOv10s achieved the highest in its series (0.872), while YOLOv9 Gelan m performed the best among YOLOv9 configurations (0.899), and YOLOv8n performed the best among the YOLOv8 configurations (0.883). Meanwhile, three configurations of YOLOv10: YOLOv10b, YOLOv10l, and YOLOv10x achieved superior post-processing speeds of 1.5 milliseconds, outperforming all other configurations within the YOLOv9 and YOLOv8 families. Specifically, YOLOv9 Gelan-e recorded a post-processing speed of 1.9 milliseconds, and YOLOv8m achieved 2.1 milliseconds. Furthermore, YOLOv8n exhibited the highest inference speed among all configurations tested, achieving a processing time of 4.1 milliseconds while YOLOv9 Gelan-t and YOLOv10n also demonstrated comparatively slower inference speeds of 9.3 ms and 5.5 ms, respectively.

Read more

8/28/2024