Learning Which Side to Scan: Multi-View Informed Active Perception with Side Scan Sonar for Autonomous Underwater Vehicles
2402.01106
0
0
Abstract
Autonomous underwater vehicles often perform surveys that capture multiple views of targets in order to provide more information for human operators or automatic target recognition algorithms. In this work, we address the problem of choosing the most informative views that minimize survey time while maximizing classifier accuracy. We introduce a novel active perception framework for multi-view adaptive surveying and reacquisition using side scan sonar imagery. Our framework addresses this challenge by using a graph formulation for the adaptive survey task. We then use Graph Neural Networks (GNNs) to both classify acquired sonar views and to choose the next best view based on the collected data. We evaluate our method using simulated surveys in a high-fidelity side scan sonar simulator. Our results demonstrate that our approach is able to surpass the state-of-the-art in classification accuracy and survey efficiency. This framework is a promising approach for more efficient autonomous missions involving side scan sonar, such as underwater exploration, marine archaeology, and environmental monitoring.
Create account to get full access
Overview
- This paper presents a method for autonomous underwater vehicles (AUVs) to learn which side to scan using side-scan sonar.
- The proposed approach utilizes multi-view information to actively perceive the environment and determine the optimal scanning direction.
- The authors demonstrate the effectiveness of their method through simulations and real-world experiments with an AUV.
Plain English Explanation
Autonomous underwater vehicles (AUVs) are robots that can explore the ocean without a human operator. To navigate and map their surroundings, AUVs often use side-scan sonar, which sends out sound waves and measures the echoes to create an image of the seafloor.
In this paper, the researchers developed a new way for AUVs to decide which direction to scan using the side-scan sonar. Instead of just scanning one side, the AUV can use information from multiple viewpoints to determine the best direction to scan. This "multi-view informed active perception" approach allows the AUV to more efficiently explore its environment and gather more useful data.
The researchers tested their method in computer simulations and real-world experiments with an AUV. The results showed that the AUV could successfully learn which side to scan based on the available information, allowing it to explore the seafloor more effectively.
This work could help improve the capabilities of AUVs, enabling them to autonomously navigate and map underwater environments with greater efficiency and accuracy. This could have applications in fields like ocean exploration, marine biology research, and seafloor mapping.
Technical Explanation
The paper presents a novel approach for learning-which-side-to-scan with side-scan sonar on autonomous underwater vehicles (AUVs). The authors propose a "multi-view informed active perception" method that leverages information from multiple viewpoints to determine the optimal scanning direction.
The key components of the proposed approach include:
- Sensor Model: The authors develop a probabilistic sensor model to represent the uncertainty in the side-scan sonar measurements and their relationship to the environment.
- Multi-View Fusion: The method fuses information from multiple viewpoints to build a more complete understanding of the environment and identify the best scanning direction.
- Planning and Control: The AUV uses this multi-view information to plan its trajectory and control its movement to actively perceive the environment.
The authors evaluate their approach through both simulation and real-world experiments with an AUV. The results demonstrate that the multi-view-informed-active-perception method outperforms traditional single-view scanning strategies, enabling the AUV to more effectively explore and map the seafloor.
Critical Analysis
The paper presents a well-designed and thorough approach to the problem of side-scan-sonar optimization for AUVs. The authors' use of multi-view information and active perception is a promising direction for improving the efficiency and effectiveness of underwater exploration.
However, the paper does not address several potential limitations and areas for future research:
- Real-World Challenges: While the real-world experiments demonstrate the feasibility of the approach, the paper does not discuss how the method might perform in more challenging, dynamic, or unpredictable underwater environments.
- Computational Complexity: The multi-view fusion and planning algorithms may introduce additional computational overhead, which could be a concern for resource-constrained AUVs.
- Sensor Limitations: The paper does not consider the potential impacts of sensor noise, degradation, or failure on the performance of the learning-which-side-to-scan approach.
Future research could explore these areas to further validate and improve the practicality of the proposed multi-view-informed-active-perception method for side-scan-sonar optimization in AUVs.
Conclusion
This paper presents a novel approach for autonomous underwater vehicles (AUVs) to actively determine the optimal scanning direction using side-scan sonar. The proposed multi-view-informed-active-perception method leverages information from multiple viewpoints to improve the efficiency and effectiveness of seafloor exploration and mapping.
The results of the simulations and real-world experiments demonstrate the promising capabilities of this approach, which could have significant implications for fields such as ocean exploration, marine biology research, and underwater infrastructure monitoring. Further research is needed to address the potential limitations and challenges identified in the paper, but this work represents an important step forward in enhancing the autonomous capabilities of underwater vehicles.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🤿
A Sonar-based AUV Positioning System for Underwater Environments with Low Infrastructure Density
Emilio Olivastri, Daniel Fusaro, Wanmeng Li, Simone Mosco, Alberto Pretto
0
0
The increasing demand for underwater vehicles highlights the necessity for robust localization solutions in inspection missions. In this work, we present a novel real-time sonar-based underwater global positioning algorithm for AUVs (Autonomous Underwater Vehicles) designed for environments with a sparse distribution of human-made assets. Our approach exploits two synergistic data interpretation frontends applied to the same stream of sonar data acquired by a multibeam Forward-Looking Sonar (FSD). These observations are fused within a Particle Filter (PF) either to weigh more particles that belong to high-likelihood regions or to solve symmetric ambiguities. Preliminary experiments carried out on a simulated environment resembling a real underwater plant provided promising results. This work represents a starting point towards future developments of the method and consequent exhaustive evaluations also in real-world scenarios.
5/6/2024
NeuRSS: Enhancing AUV Localization and Bathymetric Mapping with Neural Rendering for Sidescan SLAM
Yiping Xie, Jun Zhang, Nils Bore, John Folkesson
0
0
Implicit neural representations and neural render- ing have gained increasing attention for bathymetry estimation from sidescan sonar (SSS). These methods incorporate multiple observations of the same place from SSS data to constrain the elevation estimate, converging to a globally-consistent bathymetric model. However, the quality and precision of the bathymetric estimate are limited by the positioning accuracy of the autonomous underwater vehicle (AUV) equipped with the sonar. The global positioning estimate of the AUV relying on dead reckoning (DR) has an unbounded error due to the absence of a geo-reference system like GPS underwater. To address this challenge, we propose in this letter a modern and scalable framework, NeuRSS, for SSS SLAM based on DR and loop closures (LCs) over large timescales, with an elevation prior provided by the bathymetric estimate using neural rendering from SSS. This framework is an iterative procedure that improves localization and bathymetric mapping. Initially, the bathymetry estimated from SSS using the DR estimate, though crude, can provide an important elevation prior in the nonlinear least-squares (NLS) optimization that estimates the relative pose between two loop-closure vertices in a pose graph. Subsequently, the global pose estimate from the SLAM component improves the positioning estimate of the vehicle, thus improving the bathymetry estimation. We validate our localization and mapping approach on two large surveys collected with a surface vessel and an AUV, respectively. We evaluate their localization results against the ground truth and compare the bathymetry estimation against data collected with multibeam echo sounders (MBES).
5/10/2024
🏷️
Multi-modal Perception Dataset of In-water Objects for Autonomous Surface Vehicles
Mingi Jeong, Arihant Chadda, Ziang Ren, Luyang Zhao, Haowen Liu, Monika Roznere, Aiwei Zhang, Yitao Jiang, Sabriel Achong, Samuel Lensgraf, Alberto Quattrini Li
0
0
This paper introduces the first publicly accessible multi-modal perception dataset for autonomous maritime navigation, focusing on in-water obstacles within the aquatic environment to enhance situational awareness for Autonomous Surface Vehicles (ASVs). This dataset, consisting of diverse objects encountered under varying environmental conditions, aims to bridge the research gap in marine robotics by providing a multi-modal, annotated, and ego-centric perception dataset, for object detection and classification. We also show the applicability of the proposed dataset's framework using deep learning-based open-source perception algorithms that have shown success. We expect that our dataset will contribute to development of the marine autonomy pipeline and marine (field) robotics. Please note this is a work-in-progress paper about our on-going research that we plan to release in full via future publication.
4/30/2024
Multi-AUV Cooperative Underwater Multi-Target Tracking Based on Dynamic-Switching-enabled Multi-Agent Reinforcement Learning
Shengbo Wang, Chuan Lin, Guangjie Han, Shengchao Zhu, Zhixian Li, Zhenyu Wang
0
0
With the rapid development of underwater communication, sensing, automation, robot technologies, autonomous underwater vehicle (AUV) swarms are gradually becoming popular and have been widely promoted in ocean exploration and underwater tracking or surveillance, etc. However, the complex underwater environment poses significant challenges for AUV swarm-based accurate tracking for the underwater moving targets. In this paper, we aim at proposing a multi-AUV cooperative underwater multi-target tracking algorithm especially when the real underwater factors are taken into account.We first give normally modelling approach for the underwater sonar-based detection and the ocean current interference on the target tracking process.Then, we regard the AUV swarm as a underwater ad-hoc network and propose a novel Multi-Agent Reinforcement Learning (MARL) architecture towards the AUV swarm based on Software-Defined Networking (SDN).It enhances the flexibility and scalability of the AUV swarm through centralized management and distributed operations.Based on the proposed MARL architecture, we propose the dynamic-attention switching and dynamic-resampling switching mechanisms, to enhance the efficiency and accuracy of AUV swarm cooperation during task execution.Finally, based on a proposed AUV classification method, we propose an efficient cooperative tracking algorithm called ASMA.Evaluation results demonstrate that our proposed tracking algorithm can perform precise underwater multi-target tracking, comparing with many of recent research products in terms of convergence speed and tracking accuracy.
4/24/2024