Osprey: Multi-Session Autonomous Aerial Mapping with LiDAR-based SLAM and Next Best View Planning
2311.03484
0
0
🏅
Abstract
Aerial mapping systems are important for many surveying applications (e.g., industrial inspection or agricultural monitoring). Aerial platforms that can fly GPS-guided preplanned missions semi-autonomously are already widely available but fully autonomous systems can significantly improve efficiency. Autonomously mapping complex 3D structures requires a system that performs online mapping and mission planning. This paper presents Osprey, an autonomous aerial mapping system with state-of-the-art multi-session LiDAR-based mapping capabilities. It enables a non-expert operator to specify a bounded target area that the aerial platform can then map autonomously over multiple flights. Field experiments with Osprey demonstrate that this system can achieve greater map coverage of large industrial sites than manual surveys with a pilot-flown aerial platform or a terrestrial laser scanner (TLS). Three sites, with a total ground coverage of $2528$ m$^2$ and a maximum height of $27$ m, were mapped in separate missions using $112$ minutes of autonomous flight time. True colour maps were created from images captured by Osprey using pointcloud and NeRF reconstruction methods. These maps provide useful data for structural inspection tasks.
Create account to get full access
Overview
- Aerial mapping systems enable efficient surveying and monitoring of large areas from the air
- Fully autonomous aerial mapping platforms can improve efficiency over manually piloted drones
- The paper introduces Osprey, an autonomous aerial mapping system with advanced LiDAR-based mapping capabilities
- Osprey enables non-experts to map a specified area autonomously over multiple flights
- Field tests show Osprey achieved greater map coverage of large industrial sites compared to manual surveys or terrestrial laser scanners
- Osprey created detailed 3D maps and true color visuals using point cloud and NeRF reconstruction methods
Plain English Explanation
Imagine you need to create a detailed map of a large industrial complex or farm. Traditionally, you would have to hire a team of surveyors to walk around the site with specialized equipment, which can be time-consuming and expensive. Alternatively, you could hire a pilot to fly a drone over the area, but someone would still need to manually control the drone, which can be challenging for complex sites.
The researchers behind Osprey have developed a system that allows a non-expert to simply outline the area they want to map on a computer, and then an autonomous drone will take care of the rest. The drone is equipped with advanced laser scanning technology (LiDAR) that can precisely measure the 3D structure of buildings, trees, and other objects on the ground.
Once the initial scan is complete, the drone can automatically plan additional flights to fill in any gaps or blind spots in the data. This process continues until the entire area has been thoroughly mapped.
The final result is a highly detailed 3D model of the site, complete with accurate measurements and colorful visuals that can be used for a variety of purposes, such as inspecting the condition of buildings or monitoring crop growth.
Technical Explanation
The Osprey system consists of an aerial platform equipped with a LiDAR sensor and a camera. The platform is capable of flying pre-planned GPS-guided missions semi-autonomously. However, Osprey's key innovation is its ability to perform online mapping and mission planning, enabling fully autonomous operation.
The system works as follows: First, a non-expert operator specifies a bounded target area that needs to be mapped. Osprey then plans and executes an initial flight mission to capture an initial scan of the area using its LiDAR sensor.
After the initial scan, Osprey processes the LiDAR data to create a 3D point cloud representation of the mapped area. This point cloud is analyzed to identify any gaps or occluded regions that were not fully captured during the initial flight.
Based on this analysis, Osprey then plans additional flight missions to fill in the gaps and capture data from new vantage points. This multi-session mapping process continues iteratively until the entire target area has been fully mapped.
The researchers conducted field experiments at three different sites, with a total ground coverage of 2,528 square meters and a maximum height of 27 meters. These sites were mapped using 112 minutes of autonomous flight time with Osprey.
The resulting LiDAR point cloud data was used to create detailed 3D maps of the sites, while the captured images were processed using point cloud and NeRF (Neural Radiance Fields) reconstruction methods to generate true color visual maps.
Critical Analysis
While the Osprey system represents a significant advancement in autonomous aerial mapping, there are several limitations and areas for further research to consider:
-
Scalability: The paper does not provide details on the maximum area or complexity that Osprey can handle. Large-scale industrial sites or dense urban environments may present additional challenges.
-
Environmental factors: The performance of Osprey in various weather conditions (e.g., wind, rain, low visibility) or at different times of day (e.g., low light) is not addressed. These factors could impact the quality of the LiDAR data and visual mapping.
-
Safety and regulatory compliance: As with any autonomous aerial system, there are potential safety concerns regarding flight operations near structures, people, or other aircraft. The paper does not discuss how Osprey handles these issues or complies with relevant regulations.
-
Data processing and storage: The paper does not provide details on the computational resources required for processing the large amounts of data generated by Osprey or the storage requirements for the final maps.
-
Cost and accessibility: While Osprey aims to make aerial mapping more accessible to non-experts, the cost of implementing such a system is not discussed. This could be a barrier to widespread adoption, particularly for smaller organizations or individuals.
Overall, while Osprey represents a promising step towards autonomous aerial mapping, further research and real-world testing are necessary to address the limitations and ensure the system is reliable, safe, and economically viable for a wide range of applications.
Conclusion
The Osprey system represents a significant advancement in autonomous aerial mapping technology. By enabling non-experts to map complex 3D structures over multiple autonomous flights, Osprey has the potential to greatly improve the efficiency and accessibility of aerial surveying and monitoring applications.
The field experiments demonstrate Osprey's ability to achieve greater map coverage and detail than traditional manual surveys or terrestrial laser scanners, making it a valuable tool for tasks such as industrial inspection or agricultural monitoring.
While there are still some limitations and areas for further research, the core concepts and capabilities demonstrated by Osprey could pave the way for more widespread adoption of autonomous aerial mapping systems in various industries and applications.
As this technology continues to evolve, it will be important to address concerns related to scalability, environmental factors, safety, data processing, and cost-effectiveness to ensure that the benefits of autonomous aerial mapping can be realized to their fullest potential.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Under-Canopy Navigation using Aerial Lidar Maps
Lucas Carvalho de Lima, Nicholas Lawrance, Kasra Khosoussi, Paulo Borges, Michael Bruenig
0
0
Autonomous navigation in unstructured natural environments poses a significant challenge. In goal navigation tasks without prior information, the limited look-ahead of onboard sensors utilised by robots compromises path efficiency. We propose a novel approach that leverages an above-the-canopy aerial map for improved ground robot navigation. Our system utilises aerial lidar scans to create a 3D probabilistic occupancy map, uniquely incorporating the uncertainty in the aerial vehicle's trajectory for improved accuracy. Novel path planning cost functions are introduced, combining path length with obstruction risk estimated from the probabilistic map. The D-Star Lite algorithm then calculates an optimal (minimum-cost) path to the goal. This system also allows for dynamic replanning upon encountering unforeseen obstacles on the ground. Extensive experiments and ablation studies in simulated and real forests demonstrate the effectiveness of our system.
6/19/2024
🏋️
Autonomous Active Mapping in Steep Alpine Environments with Fixed-wing Aerial Vehicles
Jaeyoung Lim, Florian Achermann, Nicholas Lawrance, Roland Siegwart
0
0
Monitoring large scale environments is a crucial task for managing remote alpine environments, especially for hazardous events such as avalanches. One key information for avalanche risk forecast is imagery of released avalanches. As these happen in remote and potentially dangerous locations this data is difficult to obtain. Fixed-wing vehicles, due to their long range and travel speeds are a promising platform to gather aerial imagery to map avalanche activities. However, operating such vehicles in mountainous terrain remains a challenge due to the complex topography, regulations, and uncertain environment. In this work, we present a system that is capable of safely navigating and mapping an avalanche using a fixed-wing aerial system and discuss the challenges arising when executing such a mission. We show in our field experiments that we can effectively navigate in steep terrain environments while maximizing the map quality. We expect our work to enable more autonomous operations of fixed-wing vehicles in alpine environments to maximize the quality of the data gathered.
5/6/2024
FlyNeRF: NeRF-Based Aerial Mapping for High-Quality 3D Scene Reconstruction
Maria Dronova, Vladislav Cheremnykh, Alexey Kotcov, Aleksey Fedoseev, Dzmitry Tsetserukou
0
0
Current methods for 3D reconstruction and environmental mapping frequently face challenges in achieving high precision, highlighting the need for practical and effective solutions. In response to this issue, our study introduces FlyNeRF, a system integrating Neural Radiance Fields (NeRF) with drone-based data acquisition for high-quality 3D reconstruction. Utilizing unmanned aerial vehicle (UAV) for capturing images and corresponding spatial coordinates, the obtained data is subsequently used for the initial NeRF-based 3D reconstruction of the environment. Further evaluation of the reconstruction render quality is accomplished by the image evaluation neural network developed within the scope of our system. According to the results of the image evaluation module, an autonomous algorithm determines the position for additional image capture, thereby improving the reconstruction quality. The neural network introduced for render quality assessment demonstrates an accuracy of 97%. Furthermore, our adaptive methodology enhances the overall reconstruction quality, resulting in an average improvement of 2.5 dB in Peak Signal-to-Noise Ratio (PSNR) for the 10% quantile. The FlyNeRF demonstrates promising results, offering advancements in such fields as environmental monitoring, surveillance, and digital twins, where high-fidelity 3D reconstructions are crucial.
4/22/2024
📈
AeroTraj: Trajectory Planning for Fast, and Accurate 3D Reconstruction Using a Drone-based LiDAR
Fawad Ahmad, Christina Shin, Rajrup Ghosh, John D'Ambrosio, Eugene Chai, Karthik Sundaresan, Ramesh Govindan
0
0
This paper presents AeroTraj, a system that enables fast, accurate, and automated reconstruction of 3D models of large buildings using a drone-mounted LiDAR. LiDAR point clouds can be used directly to assemble 3D models if their positions are accurately determined. AeroTraj uses SLAM for this, but must ensure complete and accurate reconstruction while minimizing drone battery usage. Doing this requires balancing competing constraints: drone speed, height, and orientation. AeroTraj exploits building geometry in designing an optimal trajectory that incorporates these constraints. Even with an optimal trajectory, SLAM's position error can drift over time, so AeroTraj tracks drift in-flight by offloading computations to the cloud and invokes a re-calibration procedure to minimize error. AeroTraj can reconstruct large structures with centimeter-level accuracy and with an average end-to-end latency below 250 ms, significantly outperforming the state of the art.
6/28/2024