Guaranteed Reach-Avoid for Black-Box Systems through Narrow Gaps via Neural Network Reachability

Read original: arXiv:2409.13195 - Published 9/24/2024 by Long Kiu Chung, Wonsuhk Jung, Srivatsank Pullabhotla, Parth Shinde, Yadu Sunil, Saihari Kota, Luis Felipe Wolf Batista, C'edric Pradalier, Shreyas Kousik
Total Score

0

Guaranteed Reach-Avoid for Black-Box Systems through Narrow Gaps via Neural Network Reachability

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a method for guaranteed reach-avoid control of black-box systems, even in the presence of narrow gaps.
  • The key idea is to use neural network reachability analysis to find safe trajectories that reach a goal while avoiding obstacles.
  • The approach is demonstrated on several simulated examples, showing its effectiveness compared to existing methods.

Plain English Explanation

The paper describes a way to control complex systems, like robots or vehicles, so that they can reliably reach a desired location while avoiding obstacles or hazards. This is important for many real-world applications, like self-driving cars or industrial robots, where safety is crucial.

The core of the approach is using neural networks to model the reachable set of the system - that is, all the states the system could potentially reach from a given starting point. By analyzing this reachable set, the method can find trajectories that are guaranteed to reach the goal while staying away from obstacles, even in situations with very narrow gaps that would be hard for other techniques.

The key advantage is that this works for "black-box" systems, where the detailed dynamics of the system are not known. The neural network model can capture the system behavior without needing a precise mathematical description. This makes the approach more widely applicable than methods that require a detailed system model.

Technical Explanation

The paper proposes a framework for guaranteed reach-avoid control of black-box systems using neural network reachability analysis.

The core idea is to learn a neural network model that approximates the reachable set of the system, even in the presence of obstacles with narrow gaps. This learned model can then be used to plan trajectories that are guaranteed to reach a goal state while avoiding obstacles.

Key elements of the approach include:

  • Using a differentiable neural network architecture to represent the reachable set
  • Designing a novel training procedure to ensure the network accurately captures narrow gaps in the reachable set
  • Incorporating this neural network model into an optimization-based trajectory planning framework to find guaranteed safe trajectories

The method is evaluated on several simulated examples, including a dynamic cart-pole system and an autonomous vehicle navigating through gaps between obstacles. The results demonstrate the approach can find safe trajectories in situations where other methods fail due to the presence of narrow gaps.

Critical Analysis

The paper presents a promising approach for safe and reliable control of complex systems. The key strength is the ability to handle "black-box" systems without requiring a detailed mathematical model.

However, the paper does not address several important practical considerations:

  • The training process for the neural network reachability model is computationally intensive and may not scale well to high-dimensional systems.
  • The guarantee of safety and reach-avoid behavior relies on the accuracy of the neural network model, which could be difficult to verify in real-world deployment.
  • The simulation examples are relatively simple, and more work is needed to demonstrate the approach on realistic, high-dimensional systems.

Further research is needed to address these limitations and explore ways to make the method more efficient and robust for real-world applications.

Conclusion

This paper introduces a novel approach for guaranteed reach-avoid control of black-box systems using neural network reachability analysis. The key innovation is the ability to accurately model narrow gaps in the reachable set, enabling safe trajectory planning even in complex environments.

While the method shows promise, there are still open challenges around scalability, model verification, and deployment on realistic systems. Nonetheless, this work represents an important step forward in making safe and reliable control of complex systems more accessible, with potential applications in areas like autonomous vehicles, industrial robotics, and beyond.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Guaranteed Reach-Avoid for Black-Box Systems through Narrow Gaps via Neural Network Reachability
Total Score

0

Guaranteed Reach-Avoid for Black-Box Systems through Narrow Gaps via Neural Network Reachability

Long Kiu Chung, Wonsuhk Jung, Srivatsank Pullabhotla, Parth Shinde, Yadu Sunil, Saihari Kota, Luis Felipe Wolf Batista, C'edric Pradalier, Shreyas Kousik

In the classical reach-avoid problem, autonomous mobile robots are tasked to reach a goal while avoiding obstacles. However, it is difficult to provide guarantees on the robot's performance when the obstacles form a narrow gap and the robot is a black-box (i.e. the dynamics are not known analytically, but interacting with the system is cheap). To address this challenge, this paper presents NeuralPARC. The method extends the authors' prior Piecewise Affine Reach-avoid Computation (PARC) method to systems modeled by rectified linear unit (ReLU) neural networks, which are trained to represent parameterized trajectory data demonstrated by the robot. NeuralPARC computes the reachable set of the network while accounting for modeling error, and returns a set of states and parameters with which the black-box system is guaranteed to reach the goal and avoid obstacles. Through numerical experiments, NeuralPARC is shown to outperform PARC in generating provably-safe extreme vehicle drift parking maneuvers, as well as enabling safety on an autonomous surface vehicle (ASV) subjected to large disturbances and controlled by a deep reinforcement learning (RL) policy.

Read more

9/24/2024

Goal-Reaching Trajectory Design Near Danger with Piecewise Affine Reach-avoid Computation
Total Score

0

Goal-Reaching Trajectory Design Near Danger with Piecewise Affine Reach-avoid Computation

Long Kiu Chung, Wonsuhk Jung, Chuizheng Kong, Shreyas Kousik

Autonomous mobile robots must maintain safety, but should not sacrifice performance, leading to the classical reach-avoid problem: find a trajectory that is guaranteed to reach a goal and avoid obstacles. This paper addresses the near danger case, also known as a narrow gap, where the agent starts near the goal, but must navigate through tight obstacles that block its path. The proposed method builds off the common approach of using a simplified planning model to generate plans, which are then tracked using a high-fidelity tracking model and controller. Existing approaches use reachability analysis to overapproximate the error between these models and ensure safety, but doing so introduces numerical approximation error conservativeness that prevents goal-reaching. The present work instead proposes a Piecewise Affine Reach-avoid Computation (PARC) method to tightly approximate the reachable set of the planning model. PARC significantly reduces conservativeness through a careful choice of the planning model and set representation, along with an effective approach to handling time-varying tracking errors. The utility of this method is demonstrated through extensive numerical experiments in which PARC outperforms state-of-the-art reach avoid methods in near-danger goal reaching. Furthermore, in a simulated demonstration, PARC enables the generation of provably-safe extreme vehicle dynamics drift parking maneuvers. A preliminary hardware demo on a TurtleBot3 also validates the method.

Read more

5/30/2024

Safe Reach Set Computation via Neural Barrier Certificates
Total Score

0

Safe Reach Set Computation via Neural Barrier Certificates

Alessandro Abate, Sergiy Bogomolov, Alec Edwards, Kostiantyn Potomkin, Sadegh Soudjani, Paolo Zuliani

We present a novel technique for online safety verification of autonomous systems, which performs reachability analysis efficiently for both bounded and unbounded horizons by employing neural barrier certificates. Our approach uses barrier certificates given by parameterized neural networks that depend on a given initial set, unsafe sets, and time horizon. Such networks are trained efficiently offline using system simulations sampled from regions of the state space. We then employ a meta-neural network to generalize the barrier certificates to state space regions that are outside the training set. These certificates are generated and validated online as sound over-approximations of the reachable states, thus either ensuring system safety or activating appropriate alternative actions in unsafe scenarios. We demonstrate our technique on case studies from linear models to nonlinear control-dependent models for online autonomous driving scenarios.

Read more

4/30/2024

Verification of Neural Reachable Tubes via Scenario Optimization and Conformal Prediction
Total Score

0

Verification of Neural Reachable Tubes via Scenario Optimization and Conformal Prediction

Albert Lin, Somil Bansal

Learning-based approaches for controlling safety-critical systems are rapidly growing in popularity; thus, it is important to assure their performance and safety. Hamilton-Jacobi (HJ) reachability analysis is a popular formal verification tool for providing such guarantees, since it can handle general nonlinear system dynamics, bounded adversarial system disturbances, and state and input constraints. However, its computational and memory complexity scales exponentially with the state dimension, making it intractable for large-scale systems. To overcome this challenge, neural approaches, such as DeepReach, have been used to synthesize reachable tubes and safety controllers for high-dimensional systems. However, verifying these neural reachable tubes remains challenging. In this work, we propose two verification methods, based on robust scenario optimization and conformal prediction, to provide probabilistic safety guarantees for neural reachable tubes. Our methods allow a direct trade-off between resilience to outlier errors in the neural tube, which are inevitable in a learning-based approach, and the strength of the probabilistic safety guarantee. Furthermore, we show that split conformal prediction, a widely used method in the machine learning community for uncertainty quantification, reduces to a scenario-based approach, making the two methods equivalent not only for verification of neural reachable tubes but also more generally. To our knowledge, our proof is the first in the literature to show a strong relationship between conformal prediction and scenario optimization. Finally, we propose an outlier-adjusted verification approach that uses the error distribution in neural reachable tubes to recover greater safe volumes. We demonstrate the efficacy of the proposed approaches for the high-dimensional problems of multi-vehicle collision avoidance and rocket landing with no-go zones.

Read more

4/11/2024