CRASAR-U-DROIDs: A Large Scale Benchmark Dataset for Building Alignment and Damage Assessment in Georectified sUAS Imagery
0
Sign in to get full access
Overview
- This paper describes the creation of a large-scale dataset called CRASAR-U-DROIDs, which is designed to benchmark building alignment and damage assessment tasks using georectified small Unmanned Aerial System (sUAS) imagery.
- The dataset covers a variety of building types and damage levels from real-world disaster scenarios, providing a comprehensive resource for training and evaluating computer vision models in this domain.
Plain English Explanation
The paper presents a new dataset called CRASAR-U-DROIDs, which is designed to help researchers and developers build better computer vision models for analyzing damage to buildings in aerial imagery captured by small drones. This is an important task for disaster response and recovery efforts, as it can provide critical information to aid in the assessment of damage and the coordination of relief efforts.
The dataset contains a large number of high-resolution aerial images of buildings, some of which have been damaged by real-world disasters. These images are carefully georectified, meaning they have been processed to correct for distortions and align the buildings in the images with their actual locations on a map. This makes the dataset more useful for training models that need to understand the spatial relationships between buildings and their surroundings.
By providing this diverse and well-annotated dataset, the researchers hope to spur the development of more accurate and robust computer vision models for building alignment and damage assessment. These models could be used to quickly and efficiently analyze aerial imagery captured by drones in the aftermath of a disaster, helping to guide the allocation of resources and the coordination of relief efforts.
Technical Explanation
The CRASAR-U-DROIDs dataset consists of over 100,000 high-resolution georectified aerial images of buildings, captured by small drones (sUAS) in a variety of disaster scenarios. The dataset is designed to support two key computer vision tasks: building alignment and building damage assessment.
For building alignment, the dataset provides annotations that precisely localize and orient the buildings within each image, allowing models to learn the spatial relationships between buildings and their surroundings. This is critical for tasks like situational awareness and damage mapping, where accurately aligning buildings to their real-world locations is essential.
The dataset also includes detailed annotations of building damage, ranging from minor to severe. This allows models to learn the visual cues and patterns associated with different levels of damage, which can be used to quickly assess the extent of destruction in the aftermath of a disaster.
The researchers used a combination of automated and manual annotation techniques to create this dataset, ensuring high-quality and consistent labels. They also designed the dataset to be representative of a wide range of building types, disaster scenarios, and environmental conditions, making it a valuable benchmark for evaluating the performance and robustness of computer vision models in this domain.
Critical Analysis
The CRASAR-U-DROIDs dataset represents a significant contribution to the field of disaster response and recovery, providing a comprehensive resource for training and evaluating computer vision models for building alignment and damage assessment. However, the paper does acknowledge a few limitations and areas for further research.
One potential limitation is the geographic scope of the dataset, which is primarily focused on disaster scenarios in the United States. While this is understandable given the researchers' affiliation, expanding the dataset to include a broader range of global disaster scenarios could enhance its applicability and generalizability.
Additionally, the paper does not provide detailed information on the diversity of building types, materials, and architectural styles represented in the dataset. Ensuring that the dataset encompasses a wide range of building characteristics could be important for developing models that can reliably operate in diverse real-world environments.
Finally, the paper does not explore the potential biases or errors that may be present in the automated and manual annotation processes used to create the dataset. Understanding and mitigating such biases could be an important area for future research, as it can impact the performance and fairness of the models developed using this dataset.
Conclusion
The CRASAR-U-DROIDs dataset represents a significant step forward in the development of computer vision-based tools for disaster response and recovery. By providing a large-scale, well-annotated dataset of georectified aerial imagery, the researchers have created a valuable benchmark for training and evaluating models that can assist in the rapid assessment of building damage following a disaster.
The potential impact of this research is substantial, as these models could help to streamline the allocation of resources, coordinate relief efforts, and ultimately save lives in the aftermath of a catastrophic event. As the field of disaster response continues to evolve, datasets like CRASAR-U-DROIDs will play a crucial role in driving the development of more accurate and reliable computer vision technologies for this critical domain.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
CRASAR-U-DROIDs: A Large Scale Benchmark Dataset for Building Alignment and Damage Assessment in Georectified sUAS Imagery
Thomas Manzini, Priyankari Perali, Raisa Karnik, Robin Murphy
This document presents the Center for Robot Assisted Search And Rescue - Uncrewed Aerial Systems - Disaster Response Overhead Inspection Dataset (CRASAR-U-DROIDs) for building damage assessment and spatial alignment collected from small uncrewed aerial systems (sUAS) geospatial imagery. This dataset is motivated by the increasing use of sUAS in disaster response and the lack of previous work in utilizing high-resolution geospatial sUAS imagery for machine learning and computer vision models, the lack of alignment with operational use cases, and with hopes of enabling further investigations between sUAS and satellite imagery. The CRASAR-U-DRIODs dataset consists of fifty-two (52) orthomosaics from ten (10) federally declared disasters (Hurricane Ian, Hurricane Ida, Hurricane Harvey, Hurricane Idalia, Hurricane Laura, Hurricane Michael, Musset Bayou Fire, Mayfield Tornado, Kilauea Eruption, and Champlain Towers Collapse) spanning 67.98 square kilometers (26.245 square miles), containing 21,716 building polygons and damage labels, and 7,880 adjustment annotations. The imagery was tiled and presented in conjunction with overlaid building polygons to a pool of 130 annotators who provided human judgments of damage according to the Joint Damage Scale. These annotations were then reviewed via a two-stage review process in which building polygon damage labels were first reviewed individually and then again by committee. Additionally, the building polygons have been aligned spatially to precisely overlap with the imagery to enable more performant machine learning models to be trained. It appears that CRASAR-U-DRIODs is the largest labeled dataset of sUAS orthomosaic imagery.
Read more7/31/2024
🌿
0
RescueNet: A High Resolution UAV Semantic Segmentation Benchmark Dataset for Natural Disaster Damage Assessment
Maryam Rahnemoonfar, Tashnim Chowdhury, Robin Murphy
Recent advancements in computer vision and deep learning techniques have facilitated notable progress in scene understanding, thereby assisting rescue teams in achieving precise damage assessment. In this paper, we present RescueNet, a meticulously curated high-resolution post-disaster dataset that includes detailed classification and semantic segmentation annotations. This dataset aims to facilitate comprehensive scene understanding in the aftermath of natural disasters. RescueNet comprises post-disaster images collected after Hurricane Michael, obtained using Unmanned Aerial Vehicles (UAVs) from multiple impacted regions. The uniqueness of RescueNet lies in its provision of high-resolution post-disaster imagery, accompanied by comprehensive annotations for each image. Unlike existing datasets that offer annotations limited to specific scene elements such as buildings, RescueNet provides pixel-level annotations for all classes, including buildings, roads, pools, trees, and more. Furthermore, we evaluate the utility of the dataset by implementing state-of-the-art segmentation models on RescueNet, demonstrating its value in enhancing existing methodologies for natural disaster damage assessment.
Read more5/20/2024
🎲
0
Non-Uniform Spatial Alignment Errors in sUAS Imagery From Wide-Area Disasters
Thomas Manzini, Priyankari Perali, Raisa Karnik, Mihir Godbole, Hasnat Abdullah, Robin Murphy
This work presents the first quantitative study of alignment errors between small uncrewed aerial systems (sUAS) geospatial imagery and a priori building polygons and finds that alignment errors are non-uniform and irregular. The work also introduces a publicly available dataset of imagery, building polygons, and human-generated and curated adjustments that can be used to evaluate existing strategies for aligning building polygons with sUAS imagery. There are no efforts that have aligned pre-existing spatial data with sUAS imagery, and thus, there is no clear state of practice. However, this effort and analysis show that the translational alignment errors present in this type of data, averaging 82px and an intersection over the union of 0.65, which would induce further errors and biases in downstream machine learning systems unless addressed. This study identifies and analyzes the translational alignment errors of 21,619 building polygons in fifty-one orthomosaic images, covering 16787.2 Acres (26.23 square miles), constructed from sUAS raw imagery from nine wide-area disasters (Hurricane Ian, Hurricane Harvey, Hurricane Michael, Hurricane Ida, Hurricane Idalia, Hurricane Laura, the Mayfield Tornado, the Musset Bayou Fire, and the Kilauea Eruption). The analysis finds no uniformity among the angle and distance metrics of the building polygon alignments as they present an average degree variance of 0.4 and an average pixel distance variance of 0.45. This work alerts the sUAS community to the problem of spatial alignment and that a simple linear transform, often used to align satellite imagery, will not be sufficient to align spatial data in sUAS orthomosaic imagery.
Read more5/13/2024
0
UAV-Enhanced Combination to Application: Comprehensive Analysis and Benchmarking of a Human Detection Dataset for Disaster Scenarios
Ragib Amin Nihal, Benjamin Yen, Katsutoshi Itoyama, Kazuhiro Nakadai
Unmanned aerial vehicles (UAVs) have revolutionized search and rescue (SAR) operations, but the lack of specialized human detection datasets for training machine learning models poses a significant challenge.To address this gap, this paper introduces the Combination to Application (C2A) dataset, synthesized by overlaying human poses onto UAV-captured disaster scenes. Through extensive experimentation with state-of-the-art detection models, we demonstrate that models fine-tuned on the C2A dataset exhibit substantial performance improvements compared to those pre-trained on generic aerial datasets. Furthermore, we highlight the importance of combining the C2A dataset with general human datasets to achieve optimal performance and generalization across various scenarios. This points out the crucial need for a tailored dataset to enhance the effectiveness of SAR operations. Our contributions also include developing dataset creation pipeline and integrating diverse human poses and disaster scenes information to assess the severity of disaster scenarios. Our findings advocate for future developments, to ensure that SAR operations benefit from the most realistic and effective AI-assisted interventions possible.
Read more8/27/2024