A convergent scheme for the Bayesian filtering problem based on the Fokker--Planck equation and deep splitting

Overview

• A numerical scheme is introduced to approximate the nonlinear filtering density.
• The convergence rate of this scheme is established theoretically and empirically.
• The scheme uses a deep splitting approach to approximate the Fokker-Planck equation for the prediction step, and Bayes' formula for the update step.
• The algorithm employs a sampling-based Feynman-Kac approach to mitigate the curse of dimensionality.
• The convergence proof relies on the Malliavin integration-by-parts formula.

Plain English Explanation

The provided paper introduces a new numerical scheme for approximating the nonlinear filtering density. This is a critical step in Bayesian filtering, which is used to estimate the state of a dynamic system from noisy and partial observations.

The key idea is to use a two-step process: first, the Fokker-Planck equation is approximated using a deep splitting scheme to handle the prediction step between observations. Then, Bayes' formula is used to perform an exact update step when a new observation becomes available.

This approach has several advantages. It can operate online, meaning it can process new observation sequences without the need for retraining. Additionally, it employs a sampling-based Feynman-Kac method to mitigate the curse of dimensionality - a common challenge in high-dimensional filtering problems.

The authors provide a rigorous theoretical analysis, proving the convergence of their scheme under certain assumptions. They also demonstrate its empirical performance on two example problems.

Technical Explanation

The paper introduces a numerical scheme for approximating the nonlinear filtering density and establishes its convergence rate, both theoretically and empirically.

For the prediction step, which occurs between the noisy and partial measurements at discrete times, the scheme approximates the Fokker-Planck equation using a deep splitting approach. This handles the evolution of the system's state distribution in the absence of new observations.

The update step then performs an exact calculation using Bayes' formula when a new observation becomes available. This results in a classical prediction-update filtering algorithm that can operate online for new observation sequences post-training.

To mitigate the curse of dimensionality, the algorithm employs a sampling-based Feynman-Kac approach.

The authors' convergence proof relies on the Malliavin integration-by-parts formula, a powerful tool from stochastic analysis. As a corollary, they also obtain the convergence rate for the approximation of the Fokker-Planck equation alone, independent of the filtering problem.

Critical Analysis

The paper presents a rigorous theoretical analysis of the proposed numerical scheme, which is a strength of the work. The authors establish convergence under a parabolic Hörmander condition, which is a technical assumption that may limit the generality of the results.

Additionally, the authors only provide empirical evaluation on two example problems. It would be helpful to see the scheme applied to a broader range of filtering problems to better understand its performance characteristics and limitations.

The paper also does not discuss potential challenges or caveats related to the use of the Feynman-Kac sampling approach, which is critical to the scheme's ability to handle high-dimensional problems. Further exploration of the practical aspects of implementing this algorithm would be valuable.

Conclusion

The provided paper introduces a novel numerical scheme for approximating the nonlinear filtering density, a key component of Bayesian filtering. The scheme combines a deep splitting approach for the prediction step and Bayes' formula for the update step, resulting in an online algorithm that can mitigate the curse of dimensionality using a Feynman-Kac sampling method.

The authors provide a strong theoretical foundation for their approach, proving convergence under certain assumptions. However, the practical implications and limitations of the scheme would benefit from further exploration and empirical evaluation on a wider range of filtering problems.