Drone-type-Set: Drone types detection benchmark for drone detection and tracking
2405.10398
0
0
Abstract
The Unmanned Aerial Vehicles (UAVs) market has been significantly growing and Considering the availability of drones at low-cost prices the possibility of misusing them, for illegal purposes such as drug trafficking, spying, and terrorist attacks posing high risks to national security, is rising. Therefore, detecting and tracking unauthorized drones to prevent future attacks that threaten lives, facilities, and security, become a necessity. Drone detection can be performed using different sensors, while image-based detection is one of them due to the development of artificial intelligence techniques. However, knowing unauthorized drone types is one of the challenges due to the lack of drone types datasets. For that, in this paper, we provide a dataset of various drones as well as a comparison of recognized object detection models on the proposed dataset including YOLO algorithms with their different versions, like, v3, v4, and v5 along with the Detectronv2. The experimental results of different models are provided along with a description of each method. The collected dataset can be found in https://drive.google.com/drive/folders/1EPOpqlF4vG7hp4MYnfAecVOsdQ2JwBEd?usp=share_link
Create account to get full access
Overview
ā¢ This paper introduces the "Drone-type-Set" dataset, a benchmark for evaluating drone detection and tracking algorithms. ā¢ The dataset contains over 100,000 annotated drone images across 10 different drone types, making it a comprehensive resource for drone detection research. ā¢ The paper also provides a performance evaluation of several popular object detection models, including YOLOV3, YOLOV4, and YOLOV5, on the Drone-type-Set dataset.
Plain English Explanation
Drones, or unmanned aerial vehicles (UAVs), have become increasingly prevalent in various applications, from recreational use to commercial and military operations. However, accurately detecting and tracking different types of drones poses a significant challenge. This paper introduces a new dataset called "Drone-type-Set" that aims to address this issue.
The Drone-type-Set dataset contains over 100,000 annotated images of 10 different drone models. This comprehensive dataset provides researchers with a valuable resource to train and evaluate algorithms for detecting and classifying different types of drones. The paper also evaluates the performance of several popular object detection models, such as YOLOV3, YOLOV4, and YOLOV5, on the Drone-type-Set dataset. This information can help researchers and developers select the most appropriate model for their drone detection and tracking needs.
Technical Explanation
The paper presents the Drone-type-Set dataset, which is a comprehensive benchmark for evaluating drone detection and tracking algorithms. The dataset contains over 100,000 annotated images of 10 different drone models, including popular consumer and commercial drones. This level of detail and diversity in the dataset is crucial for training and evaluating machine learning models that can accurately detect and classify various drone types.
The paper also evaluates the performance of several popular object detection models, including YOLOV3, YOLOV4, and YOLOV5, on the Drone-type-Set dataset. The results provide insights into the strengths and limitations of these models for drone detection and classification tasks, which can inform the selection of the most appropriate model for specific applications.
Critical Analysis
The Drone-type-Set dataset and the performance evaluation of popular object detection models presented in this paper are valuable contributions to the field of drone detection and tracking research. The comprehensive nature of the dataset, with its diverse collection of drone models, is a significant improvement over previously available datasets.
However, the paper does not address the potential limitations of the dataset, such as the representation of different environmental conditions, lighting scenarios, or camera angles. These factors can significantly impact the performance of detection algorithms and should be considered in future iterations of the dataset.
Additionally, the paper only evaluates a limited set of object detection models, and it would be beneficial to expand the analysis to include a wider range of algorithms, including more recent developments in the field of autonomous drone racing and oriented object detection in optical remote sensing images.
Conclusion
The Drone-type-Set dataset introduced in this paper is a valuable resource for researchers and developers working on drone detection and tracking algorithms. The dataset's comprehensive coverage of different drone models and the performance evaluation of popular object detection models provide crucial insights that can inform the development of more accurate and robust drone detection systems.
As the use of drones continues to grow, the ability to reliably detect and classify different drone types is becoming increasingly important for a wide range of applications, from public safety and airspace management to military and defense operations. The Drone-type-Set dataset and the insights presented in this paper represent a significant step forward in addressing this challenge.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
New!Robust Low-Cost Drone Detection and Classification in Low SNR Environments
Stefan Gluge, Matthias Nyfeler, Ahmad Aghaebrahimian, Nicola Ramagnano, Christof Schupbach
0
0
The proliferation of drones, or unmanned aerial vehicles (UAVs), has raised significant safety concerns due to their potential misuse in activities such as espionage, smuggling, and infrastructure disruption. This paper addresses the critical need for effective drone detection and classification systems that operate independently of UAV cooperation. We evaluate various convolutional neural networks (CNNs) for their ability to detect and classify drones using spectrogram data derived from consecutive Fourier transforms of signal components. The focus is on model robustness in low signal-to-noise ratio (SNR) environments, which is critical for real-world applications. A comprehensive dataset is provided to support future model development. In addition, we demonstrate a low-cost drone detection system using a standard computer, software-defined radio (SDR) and antenna, validated through real-world field testing. On our development dataset, all models consistently achieved an average balanced classification accuracy of >= 85% at SNR > -12dB. In the field test, these models achieved an average balance accuracy of > 80%, depending on transmitter distance and antenna direction. Our contributions include: a publicly available dataset for model development, a comparative analysis of CNN for drone detection under low SNR conditions, and the deployment and field evaluation of a practical, low-cost detection system.
6/28/2024
š
Certified ML Object Detection for Surveillance Missions
Mohammed Belcaid (C-S Group), Eric Bonnafous (C-S Group), Louis Crison (C-S Group), Christophe Faure (C-S Group), Eric Jenn, Claire Pagetti
0
0
In this paper, we present a development process of a drone detection system involving a machine learning object detection component. The purpose is to reach acceptable performance objectives and provide sufficient evidences, required by the recommendations (soon to be published) of the ED 324 / ARP 6983 standard, to gain confidence in the dependability of the designed system.
6/19/2024
Clustering-based Learning for UAV Tracking and Pose Estimation
Jiaping Xiao, Phumrapee Pisutsin, Cheng Wen Tsao, Mir Feroskhan
0
0
UAV tracking and pose estimation plays an imperative role in various UAV-related missions, such as formation control and anti-UAV measures. Accurately detecting and tracking UAVs in a 3D space remains a particularly challenging problem, as it requires extracting sparse features of micro UAVs from different flight environments and continuously matching correspondences, especially during agile flight. Generally, cameras and LiDARs are the two main types of sensors used to capture UAV trajectories in flight. However, both sensors have limitations in UAV classification and pose estimation. This technical report briefly introduces the method proposed by our team NTU-ICG for the CVPR 2024 UG2+ Challenge Track 5. This work develops a clustering-based learning detection approach, CL-Det, for UAV tracking and pose estimation using two types of LiDARs, namely Livox Avia and LiDAR 360. We combine the information from the two data sources to locate drones in 3D. We first align the timestamps of Livox Avia data and LiDAR 360 data and then separate the point cloud of objects of interest (OOIs) from the environment. The point cloud of OOIs is clustered using the DBSCAN method, with the midpoint of the largest cluster assumed to be the UAV position. Furthermore, we utilize historical estimations to fill in missing data. The proposed method shows competitive pose estimation performance and ranks 5th on the final leaderboard of the CVPR 2024 UG2+ Challenge.
5/28/2024
š
C2FDrone: Coarse-to-Fine Drone-to-Drone Detection using Vision Transformer Networks
Sairam VC Rebbapragada, Pranoy Panda, Vineeth N Balasubramanian
0
0
A vision-based drone-to-drone detection system is crucial for various applications like collision avoidance, countering hostile drones, and search-and-rescue operations. However, detecting drones presents unique challenges, including small object sizes, distortion, occlusion, and real-time processing requirements. Current methods integrating multi-scale feature fusion and temporal information have limitations in handling extreme blur and minuscule objects. To address this, we propose a novel coarse-to-fine detection strategy based on vision transformers. We evaluate our approach on three challenging drone-to-drone detection datasets, achieving F1 score enhancements of 7%, 3%, and 1% on the FL-Drones, AOT, and NPS-Drones datasets, respectively. Additionally, we demonstrate real-time processing capabilities by deploying our model on an edge-computing device. Our code will be made publicly available.
5/1/2024