Distributionally Robust Lyapunov Function Search Under Uncertainty

2212.01554

YC

0

Reddit

0

Published 5/1/2024 by Kehan Long, Yinzhuang Yi, Jorge Cortes, Nikolay Atanasov

Abstract

This paper develops methods for proving Lyapunov stability of dynamical systems subject to disturbances with an unknown distribution. We assume only a finite set of disturbance samples is available and that the true online disturbance realization may be drawn from a different distribution than the given samples. We formulate an optimization problem to search for a sum-of-squares (SOS) Lyapunov function and introduce a distributionally robust version of the Lyapunov function derivative constraint. We show that this constraint may be reformulated as several SOS constraints, ensuring that the search for a Lyapunov function remains in the class of SOS polynomial optimization problems. For general systems, we provide a distributionally robust chance-constrained formulation for neural network Lyapunov function search. Simulations demonstrate the validity and efficiency of either formulation on non-linear uncertain dynamical systems.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper develops methods for proving stability of dynamic systems in the presence of uncertain disturbances.
  • The authors assume only a limited set of disturbance samples is available, and the true disturbances may come from a different distribution.
  • They formulate an optimization problem to find a Lyapunov function that can certify stability under this distributionally robust setting.
  • For general systems, they propose a chance-constrained approach using neural network Lyapunov functions.
  • Simulations demonstrate the effectiveness of their methods on nonlinear uncertain dynamical systems.

Plain English Explanation

The paper focuses on proving the stability of dynamic systems, which are mathematical models that describe how a system changes over time. In many real-world situations, these systems are subject to external disturbances or inputs that are not fully known in advance.

The authors consider a setting where only a limited set of sample disturbances is available, but the actual disturbances encountered during operation may come from a different distribution. They develop an optimization-based approach to find a special type of function, called a Lyapunov function, that can guarantee the system's stability even in the presence of these uncertain disturbances.

For more complex systems, the authors propose using neural networks to represent the Lyapunov function, and they formulate the search as a chance-constrained optimization problem. This allows them to handle a broader class of dynamical systems while still providing stability guarantees.

Through simulation experiments, the authors demonstrate that their methods can effectively certify the stability of nonlinear dynamical systems subject to uncertain disturbances.

Technical Explanation

The key idea of the paper is to develop a distributionally robust approach to Lyapunov stability analysis for dynamical systems. Lyapunov stability is a powerful mathematical framework for proving the stability of a system without explicitly solving the system's equations.

The authors assume that only a finite set of disturbance samples are available, but the true online disturbance realization may be drawn from a different distribution. They formulate an optimization problem to search for a sum-of-squares (SOS) Lyapunov function and introduce a distributionally robust version of the Lyapunov function derivative constraint. This constraint ensures that the Lyapunov function decreases along the system's trajectories, even in the presence of the uncertain disturbances.

The authors show that this distributionally robust constraint can be reformulated as several SOS constraints, allowing the overall Lyapunov function search to remain as a polynomial optimization problem. This is important as it enables the use of efficient SOS programming techniques to solve the problem.

For more general nonlinear systems, the authors propose a chance-constrained formulation that leverages neural networks to represent the Lyapunov function. This approach can handle a broader class of dynamical systems while still providing stability guarantees.

The authors demonstrate the effectiveness of their methods through simulation experiments on nonlinear uncertain dynamical systems.

Critical Analysis

The paper presents a novel and technically sophisticated approach to analyzing the stability of dynamical systems in the presence of uncertain disturbances. The authors' use of distributionally robust optimization and neural network Lyapunov functions is a significant advancement in the field.

One potential limitation is the reliance on having a finite set of disturbance samples. In practice, the true disturbance distribution may be even more complex, and the authors' methods may not be able to provide guarantees in those cases. Additionally, the computational complexity of the SOS optimization problem may limit the scalability of their approach for very high-dimensional systems.

It would also be interesting to see how the authors' methods compare to alternative approaches, such as robust control techniques or data-driven stability analysis. A more comprehensive evaluation on a diverse set of benchmark problems could help to better understand the strengths and weaknesses of the proposed methods.

Overall, this paper represents an important contribution to the field of stable learning for dynamical systems. The authors' work opens up new avenues for further research in this area.

Conclusion

This paper presents a novel framework for proving the stability of dynamical systems subject to uncertain disturbances. The authors develop a distributionally robust optimization approach to find Lyapunov functions that can guarantee stability, even when the true disturbance distribution differs from the available samples.

For more general nonlinear systems, the authors propose a chance-constrained formulation that leverages neural networks to represent the Lyapunov function. Their methods provide stability guarantees while handling a broader class of dynamical systems.

The simulation results demonstrate the effectiveness of the authors' approaches on nonlinear uncertain systems. This work represents an important advancement in the field of stable learning for dynamic systems and opens up new directions for future research.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

Distributionally Robust Policy and Lyapunov-Certificate Learning

Distributionally Robust Policy and Lyapunov-Certificate Learning

Kehan Long, Jorge Cortes, Nikolay Atanasov

YC

0

Reddit

0

This article presents novel methods for synthesizing distributionally robust stabilizing neural controllers and certificates for control systems under model uncertainty. A key challenge in designing controllers with stability guarantees for uncertain systems is the accurate determination of and adaptation to shifts in model parametric uncertainty during online deployment. We tackle this with a novel distributionally robust formulation of the Lyapunov derivative chance constraint ensuring a monotonic decrease of the Lyapunov certificate. To avoid the computational complexity involved in dealing with the space of probability measures, we identify a sufficient condition in the form of deterministic convex constraints that ensures the Lyapunov derivative constraint is satisfied. We integrate this condition into a loss function for training a neural network-based controller and show that, for the resulting closed-loop system, the global asymptotic stability of its equilibrium can be certified with high confidence, even with Out-of-Distribution (OoD) model uncertainties. To demonstrate the efficacy and efficiency of the proposed methodology, we compare it with an uncertainty-agnostic baseline approach and several reinforcement learning approaches in two control problems in simulation.

Read more

4/8/2024

🛠️

Nonlinear Distributionally Robust Optimization

Mohammed Rayyan Sheriff, Peyman Mohajerin Esfahani

YC

0

Reddit

0

This article focuses on a class of distributionally robust optimization (DRO) problems where, unlike the growing body of the literature, the objective function is potentially nonlinear in the distribution. Existing methods to optimize nonlinear functions in probability space use the Frechet derivatives, which present both theoretical and computational challenges. Motivated by this, we propose an alternative notion for the derivative and corresponding smoothness based on Gateaux (G)-derivative for generic risk measures. These concepts are explained via three running risk measure examples of variance, entropic risk, and risk on finite support sets. We then propose a G-derivative based Frank-Wolfe (FW) algorithm for generic nonlinear optimization problems in probability spaces and establish its convergence under the proposed notion of smoothness in a completely norm-independent manner. We use the set-up of the FW algorithm to devise a methodology to compute a saddle point of the nonlinear DRO problem. Finally, we validate our theoretical results on two cases of the entropic and variance risk measures in the context of portfolio selection problems. In particular, we analyze their regularity conditions and sufficient statistic, compute the respective FW-oracle in various settings, and confirm the theoretical outcomes through numerical validation.

Read more

6/11/2024

Lyapunov-stable Neural Control for State and Output Feedback: A Novel Formulation for Efficient Synthesis and Verification

Lyapunov-stable Neural Control for State and Output Feedback: A Novel Formulation for Efficient Synthesis and Verification

Lujie Yang, Hongkai Dai, Zhouxing Shi, Cho-Jui Hsieh, Russ Tedrake, Huan Zhang

YC

0

Reddit

0

Learning-based neural network (NN) control policies have shown impressive empirical performance in a wide range of tasks in robotics and control. However, formal (Lyapunov) stability guarantees over the region-of-attraction (ROA) for NN controllers with nonlinear dynamical systems are challenging to obtain, and most existing approaches rely on expensive solvers such as sums-of-squares (SOS), mixed-integer programming (MIP), or satisfiability modulo theories (SMT). In this paper, we demonstrate a new framework for learning NN controllers together with Lyapunov certificates using fast empirical falsification and strategic regularizations. We propose a novel formulation that defines a larger verifiable region-of-attraction (ROA) than shown in the literature, and refines the conventional restrictive constraints on Lyapunov derivatives to focus only on certifiable ROAs. The Lyapunov condition is rigorously verified post-hoc using branch-and-bound with scalable linear bound propagation-based NN verification techniques. The approach is efficient and flexible, and the full training and verification procedure is accelerated on GPUs without relying on expensive solvers for SOS, MIP, nor SMT. The flexibility and efficiency of our framework allow us to demonstrate Lyapunov-stable output feedback control with synthesized NN-based controllers and NN-based observers with formal stability guarantees, for the first time in literature. Source code at https://github.com/Verified-Intelligence/Lyapunov_Stable_NN_Controllers

Read more

6/6/2024

🧠

Learning a Stable Dynamic System with a Lyapunov Energy Function for Demonstratives Using Neural Networks

Yu Zhang, Yongxiang Zou, Haoyu Zhang, Xiuze Xia, Long Cheng

YC

0

Reddit

0

Autonomous Dynamic System (DS)-based algorithms hold a pivotal and foundational role in the field of Learning from Demonstration (LfD). Nevertheless, they confront the formidable challenge of striking a delicate balance between achieving precision in learning and ensuring the overall stability of the system. In response to this substantial challenge, this paper introduces a novel DS algorithm rooted in neural network technology. This algorithm not only possesses the capability to extract critical insights from demonstration data but also demonstrates the capacity to learn a candidate Lyapunov energy function that is consistent with the provided data. The model presented in this paper employs a straightforward neural network architecture that excels in fulfilling a dual objective: optimizing accuracy while simultaneously preserving global stability. To comprehensively evaluate the effectiveness of the proposed algorithm, rigorous assessments are conducted using the LASA dataset, further reinforced by empirical validation through a robotic experiment.

Read more

4/30/2024