Suppressing unknown disturbances to dynamical systems using machine learning

Read original: arXiv:2307.03690 - Published 8/22/2024 by Juan G. Restrepo, Clayton P. Byers, Per Sebastian Skardal
Total Score

0

Suppressing unknown disturbances to dynamical systems using machine learning

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a machine learning approach for suppressing unknown disturbances in dynamical systems.
  • The researchers developed a neural network-based controller that can adaptively cancel out unknown disturbances and stabilize the system.
  • The method is demonstrated on several examples, including stabilizing the Lorenz system and filtering out unknown modulations in a nonlinear oscillator.
  • The approach provides a way to ensure safety and robustness in systems with unknown or uncertain dynamics.

Plain English Explanation

Dynamical systems are mathematical models that describe how the state of a system changes over time. These systems can be influenced by external disturbances, which can cause the system to become unstable or behave in unwanted ways.

In this research, the authors developed a machine learning technique to help suppress these unknown disturbances. They created a neural network-based controller that can adaptively cancel out the disturbances and keep the system stable.

The method works by learning the patterns of the disturbances from data, and then using that knowledge to generate a corrective signal that counteracts the disturbances. This is similar to how noise-cancelling headphones work - they use a microphone to detect the surrounding noise, and then generate an anti-noise signal to cancel it out.

The researchers tested their approach on several examples, including the famous Lorenz system, which is a nonlinear dynamical system that exhibits chaotic behavior. They also showed how the method could filter out unknown modulations in a nonlinear oscillator.

By being able to provide safety assurances in systems with unknown dynamics, this approach could be useful in a variety of applications, such as aerospace, robotics, and power systems, where unexpected disturbances can be a major challenge.

Technical Explanation

The key idea behind the proposed method is to use a neural network as a feedback controller that can adaptively cancel out unknown disturbances in a dynamical system. The neural network is trained on data from the system, including measurements of the disturbances, to learn a model of the system dynamics and the disturbance patterns.

During operation, the neural network controller uses this learned model to generate a corrective signal that is added to the system's input, effectively suppressing the unknown disturbances. The researchers demonstrate this approach on several examples, including:

  1. Stabilizing the Lorenz system, a well-known chaotic dynamical system, in the presence of unknown disturbances.

  2. Filtering out unknown modulations in a nonlinear oscillator, showing how the method can be used to provide safety assurances in systems with unknown dynamics.

  3. Learning dynamical systems by leveraging data from both the system and the disturbances, which helps the neural network controller better adapt to the specific system.

The key insights from this research are that machine learning techniques, particularly neural networks, can be effectively used to model and suppress unknown disturbances in dynamical systems, and that leveraging data from both the system and the disturbances can improve the performance of the controller.

Critical Analysis

The paper presents a promising approach for dealing with unknown disturbances in dynamical systems, but there are a few potential limitations and areas for further research that could be considered:

  1. The method relies on having access to measurements of the disturbances, which may not always be available in practical applications. Techniques for learning dynamical systems from data without direct measurements of the disturbances could be an area for future investigation.

  2. The neural network controller is trained offline, which may limit its ability to adapt to changes in the system or disturbance dynamics over time. Incorporating online learning or adaptation could improve the controller's long-term performance.

  3. The paper focuses on demonstrating the method on relatively simple systems, such as the Lorenz system and a nonlinear oscillator. Applying the approach to more complex, high-dimensional dynamical systems with realistic disturbances would be an important next step to assess its practical utility.

Overall, the research presents a valuable contribution to the field of dynamical systems control, and the machine learning-based approach shows promise for providing safety assurances in systems with unknown or uncertain dynamics.

Conclusion

This paper introduces a novel machine learning-based technique for suppressing unknown disturbances in dynamical systems. The key idea is to use a neural network controller that can adaptively cancel out the disturbances and stabilize the system.

The researchers demonstrate the effectiveness of their approach on several examples, including stabilizing the chaotic Lorenz system and filtering out unknown modulations in a nonlinear oscillator. This method provides a way to ensure safety and robustness in systems with unknown or uncertain dynamics, which could be valuable in a wide range of applications, from aerospace to power systems.

While the paper presents a promising approach, there are a few potential limitations and areas for further research, such as dealing with limited disturbance measurements, incorporating online adaptation, and applying the method to more complex systems. Overall, this work demonstrates the power of machine learning techniques for addressing fundamental challenges in dynamical systems control.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Suppressing unknown disturbances to dynamical systems using machine learning
Total Score

0

Suppressing unknown disturbances to dynamical systems using machine learning

Juan G. Restrepo, Clayton P. Byers, Per Sebastian Skardal

Identifying and suppressing unknown disturbances to dynamical systems is a problem with applications in many different fields. Here we present a model-free method to identify and suppress an unknown disturbance to an unknown system based only on previous observations of the system under the influence of a known forcing function. We find that, under very mild restrictions on the training function, our method is able to robustly identify and suppress a large class of unknown disturbances. We illustrate our scheme with the identification of both deterministic and stochastic unknown disturbances to an analog electric chaotic circuit and with numerical examples where a chaotic disturbance to various chaotic dynamical systems is identified and suppressed.

Read more

8/22/2024

Modeling Unknown Stochastic Dynamical System Subject to External Excitation
Total Score

0

Modeling Unknown Stochastic Dynamical System Subject to External Excitation

Yuan Chen, Dongbin Xiu

We present a numerical method for learning unknown nonautonomous stochastic dynamical system, i.e., stochastic system subject to time dependent excitation or control signals. Our basic assumption is that the governing equations for the stochastic system are unavailable. However, short bursts of input/output (I/O) data consisting of certain known excitation signals and their corresponding system responses are available. When a sufficient amount of such I/O data are available, our method is capable of learning the unknown dynamics and producing an accurate predictive model for the stochastic responses of the system subject to arbitrary excitation signals not in the training data. Our method has two key components: (1) a local approximation of the training I/O data to transfer the learning into a parameterized form; and (2) a generative model to approximate the underlying unknown stochastic flow map in distribution. After presenting the method in detail, we present a comprehensive set of numerical examples to demonstrate the performance of the proposed method, especially for long-term system predictions.

Read more

6/26/2024

Simultaneous System Identification and Model Predictive Control with No Dynamic Regret
Total Score

0

Simultaneous System Identification and Model Predictive Control with No Dynamic Regret

Hongyu Zhou, Vasileios Tzoumas

We provide an algorithm for the simultaneous system identification and model predictive control of nonlinear systems. The algorithm has finite-time near-optimality guarantees and asymptotically converges to the optimal (non-causal) controller. Particularly, the algorithm enjoys sublinear dynamic regret, defined herein as the suboptimality against an optimal clairvoyant controller that knows how the unknown disturbances and system dynamics will adapt to its actions. The algorithm is self-supervised and applies to control-affine systems with unknown dynamics and disturbances that can be expressed in reproducing kernel Hilbert spaces. Such spaces can model external disturbances and modeling errors that can even be adaptive to the system's state and control input. For example, they can model wind and wave disturbances to aerial and marine vehicles, or inaccurate model parameters such as inertia of mechanical systems. The algorithm first generates random Fourier features that are used to approximate the unknown dynamics or disturbances. Then, it employs model predictive control based on the current learned model of the unknown dynamics (or disturbances). The model of the unknown dynamics is updated online using least squares based on the data collected while controlling the system. We validate our algorithm in both hardware experiments and physics-based simulations. The simulations include (i) a cart-pole aiming to maintain the pole upright despite inaccurate model parameters, and (ii) a quadrotor aiming to track reference trajectories despite unmodeled aerodynamic drag effects. The hardware experiments include a quadrotor aiming to track a circular trajectory despite unmodeled aerodynamic drag effects, ground effects, and wind disturbances.

Read more

7/12/2024

🧠

Total Score

0

Learning Dissipative Neural Dynamical Systems

Yuezhu Xu, S. Sivaranjani

Consider an unknown nonlinear dynamical system that is known to be dissipative. The objective of this paper is to learn a neural dynamical model that approximates this system, while preserving the dissipativity property in the model. In general, imposing dissipativity constraints during neural network training is a hard problem for which no known techniques exist. In this work, we address the problem of learning a dissipative neural dynamical system model in two stages. First, we learn an unconstrained neural dynamical model that closely approximates the system dynamics. Next, we derive sufficient conditions to perturb the weights of the neural dynamical model to ensure dissipativity, followed by perturbation of the biases to retain the fit of the model to the trajectories of the nonlinear system. We show that these two perturbation problems can be solved independently to obtain a neural dynamical model that is guaranteed to be dissipative while closely approximating the nonlinear system.

Read more

4/9/2024