Closed-Loop Koopman Operator Approximation
2303.15318
0
0
❗
Abstract
This paper proposes a method to identify a Koopman model of a feedback-controlled system given a known controller. The Koopman operator allows a nonlinear system to be rewritten as an infinite-dimensional linear system by viewing it in terms of an infinite set of lifting functions. A finite-dimensional approximation of the Koopman operator can be identified from data by choosing a finite subset of lifting functions and solving a regression problem in the lifted space. Existing methods are designed to identify open-loop systems. However, it is impractical or impossible to run experiments on some systems, such as unstable systems, in an open-loop fashion. The proposed method leverages the linearity of the Koopman operator, along with knowledge of the controller and the structure of the closed-loop system, to simultaneously identify the closed-loop and plant systems. The advantages of the proposed closed-loop Koopman operator approximation method are demonstrated in simulation using a Duffing oscillator and experimentally using a rotary inverted pendulum system. An open-source software implementation of the proposed method is publicly available, along with the experimental dataset generated for this paper.
Create account to get full access
Overview
- This paper proposes a method to identify a Koopman model of a feedback-controlled system given a known controller.
- The Koopman operator allows a nonlinear system to be rewritten as an infinite-dimensional linear system.
- Existing methods are designed for open-loop systems, but it's impractical or impossible to run experiments on some systems, like unstable systems, in an open-loop fashion.
- The proposed method leverages the linearity of the Koopman operator and knowledge of the controller and closed-loop system structure to simultaneously identify the closed-loop and plant systems.
Plain English Explanation
The paper describes a way to model the behavior of a complex, nonlinear system that is being controlled by a known controller. This type of system is common in engineering and robotics, where you have a physical device (like a pendulum or a vehicle) that is being actively controlled to maintain a desired behavior.
Traditionally, researchers have had to study these systems in an "open-loop" configuration, where the controller is disconnected, and the system is just allowed to run on its own. This can be impractical or even impossible for some systems, especially if they are unstable and will quickly fall out of control without the feedback from the controller.
The key insight of this paper is that by using a mathematical technique called the "Koopman operator," the researchers can model the entire closed-loop system - including both the physical device and the controller - as a single linear system. This allows them to identify the model of the system directly from data, without having to run open-loop experiments.
The Koopman operator works by "lifting" the nonlinear system into an infinite-dimensional space, where it can be represented as a linear system. The researchers then find a finite-dimensional approximation of this operator, which can be learned from data using a regression approach.
By incorporating knowledge of the controller and the structure of the closed-loop system, the researchers are able to simultaneously identify models for both the physical device and the control system. This provides a powerful tool for understanding and predicting the behavior of complex, feedback-controlled systems.
Technical Explanation
The paper proposes a method to identify a Koopman model of a feedback-controlled system, given a known controller. The Koopman operator allows a nonlinear system to be rewritten as an infinite-dimensional linear system by viewing it in terms of an infinite set of "lifting functions."
A finite-dimensional approximation of the Koopman operator can be identified from data by choosing a finite subset of lifting functions and solving a regression problem in the lifted space. Existing methods are designed to identify open-loop systems, but this is impractical or impossible for some systems, such as unstable systems.
The proposed method leverages the linearity of the Koopman operator, along with knowledge of the controller and the structure of the closed-loop system, to simultaneously identify the closed-loop and plant systems. This is achieved by incorporating the known controller into the regression problem used to learn the Koopman operator approximation.
The advantages of the proposed closed-loop Koopman operator approximation method are demonstrated in simulation using a Duffing oscillator and experimentally using a rotary inverted pendulum system. An open-source software implementation of the proposed method is publicly available, along with the experimental dataset generated for this paper.
Critical Analysis
The paper presents a novel and promising approach for modeling feedback-controlled nonlinear systems using the Koopman operator framework. By incorporating knowledge of the controller and the closed-loop system structure, the proposed method overcomes the limitations of existing open-loop identification techniques, which are not feasible for many real-world systems.
However, the paper does not discuss the potential limitations or caveats of the proposed method. For example, it's unclear how the method would perform when the controller is not perfectly known or when the system has unmodeled dynamics or disturbances. Additionally, the paper does not address the computational complexity and scalability of the approach, which could be a concern for high-dimensional systems.
Further research could explore the robustness of the method to model uncertainty, the ability to handle more complex controller structures, and the performance on a wider range of real-world systems. Comparisons to other closed-loop identification or nonlinear system identification techniques would also help to contextualize the strengths and limitations of the proposed approach.
Overall, the paper presents an interesting and valuable contribution to the field of nonlinear system identification, with the potential to enable the modeling and control of a wider range of real-world systems. However, further research and validation are needed to fully understand the capabilities and limitations of the method.
Conclusion
This paper proposes a novel method for identifying a Koopman model of a feedback-controlled nonlinear system, given a known controller. By leveraging the linearity of the Koopman operator and incorporating knowledge of the closed-loop system structure, the proposed approach overcomes the limitations of existing open-loop identification techniques.
The advantages of the method are demonstrated through simulations and experiments, and the researchers have made the software implementation publicly available. This work represents an important step forward in the field of nonlinear system identification, with the potential to enable the modeling and control of a wider range of real-world systems that are not amenable to open-loop analysis.
While the paper does not discuss the potential limitations of the approach, further research in this area could lead to valuable insights and improvements, ultimately advancing our ability to understand and control complex, feedback-driven nonlinear systems.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🔮
Nonparametric Control-Koopman Operator Learning: Flexible and Scalable Models for Prediction and Control
Petar Bevanda, Bas Driessen, Lucian Cristian Iacob, Roland Toth, Stefan Sosnowski, Sandra Hirche
0
0
Linearity of Koopman operators and simplicity of their estimators coupled with model-reduction capabilities has lead to their great popularity in applications for learning dynamical systems. While nonparametric Koopman operator learning in infinite-dimensional reproducing kernel Hilbert spaces is well understood for autonomous systems, its control system analogues are largely unexplored. Addressing systems with control inputs in a principled manner is crucial for fully data-driven learning of controllers, especially since existing approaches commonly resort to representational heuristics or parametric models of limited expressiveness and scalability. We address the aforementioned challenge by proposing a universal framework via control-affine reproducing kernels that enables direct estimation of a single operator even for control systems. The proposed approach, called control-Koopman operator regression (cKOR), is thus completely analogous to Koopman operator regression of the autonomous case. First in the literature, we present a nonparametric framework for learning Koopman operator representations of nonlinear control-affine systems that does not suffer from the curse of control input dimensionality. This allows for reformulating the infinite-dimensional learning problem in a finite-dimensional space based solely on data without apriori loss of precision due to a restriction to a finite span of functions or inputs as in other approaches. For enabling applications to large-scale control systems, we also enhance the scalability of control-Koopman operator estimators by leveraging random projections (sketching). The efficacy of our novel cKOR approach is demonstrated on both forecasting and control tasks.
5/14/2024
Koopman-based Deep Learning for Nonlinear System Estimation
Zexin Sun, Mingyu Chen, John Baillieul
0
0
Nonlinear differential equations are encountered as models of fluid flow, spiking neurons, and many other systems of interest in the real world. Common features of these systems are that their behaviors are difficult to describe exactly and invariably unmodeled dynamics present challenges in making precise predictions. In many cases the models exhibit extremely complicated behavior due to bifurcations and chaotic regimes. In this paper, we present a novel data-driven linear estimator that uses Koopman operator theory to extract finite-dimensional representations of complex nonlinear systems. The extracted model is used together with a deep reinforcement learning network that learns the optimal stepwise actions to predict future states of the original nonlinear system. Our estimator is also adaptive to a diffeomorphic transformation of the nonlinear system which enables transfer learning to compute state estimates of the transformed system without relearning from scratch.
5/2/2024
Koopman Data-Driven Predictive Control with Robust Stability and Recursive Feasibility Guarantees
Thomas de Jong, Valentina Breschi, Maarten Schoukens, Mircea Lazar
0
0
In this paper, we consider the design of data-driven predictive controllers for nonlinear systems from input-output data via linear-in-control input Koopman lifted models. Instead of identifying and simulating a Koopman model to predict future outputs, we design a subspace predictive controller in the Koopman space. This allows us to learn the observables minimizing the multi-step output prediction error of the Koopman subspace predictor, preventing the propagation of prediction errors. To avoid losing feasibility of our predictive control scheme due to prediction errors, we compute a terminal cost and terminal set in the Koopman space and we obtain recursive feasibility guarantees through an interpolated initial state. As a third contribution, we introduce a novel regularization cost yielding input-to-state stability guarantees with respect to the prediction error for the resulting closed-loop system. The performance of the developed Koopman data-driven predictive control methodology is illustrated on a nonlinear benchmark example from the literature.
5/3/2024
Adaptive Koopman Embedding for Robust Control of Complex Dynamical Systems
Rajpal Singh, Chandan Kumar Sah, Jishnu Keshavan
0
0
The discovery of linear embedding is the key to the synthesis of linear control techniques for nonlinear systems. In recent years, while Koopman operator theory has become a prominent approach for learning these linear embeddings through data-driven methods, these algorithms often exhibit limitations in generalizability beyond the distribution captured by training data and are not robust to changes in the nominal system dynamics induced by intrinsic or environmental factors. To overcome these limitations, this study presents an adaptive Koopman architecture capable of responding to the changes in system dynamics online. The proposed framework initially employs an autoencoder-based neural network that utilizes input-output information from the nominal system to learn the corresponding Koopman embedding offline. Subsequently, we augment this nominal Koopman architecture with a feed-forward neural network that learns to modify the nominal dynamics in response to any deviation between the predicted and observed lifted states, leading to improved generalization and robustness to a wide range of uncertainties and disturbances compared to contemporary methods. Extensive tracking control simulations, which are undertaken by integrating the proposed scheme within a Model Predictive Control framework, are used to highlight its robustness against measurement noise, disturbances, and parametric variations in system dynamics.
5/21/2024