Flexible Parametric Inference for Space-Time Hawkes Processes

Read original: arXiv:2406.06849 - Published 6/18/2024 by Emilia Siviero, Guillaume Staerman, Stephan Cl'emenc{c}on, Thomas Moreau
Total Score

0

Flexible Parametric Inference for Space-Time Hawkes Processes

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper introduces a flexible parametric inference method for space-time Hawkes processes, which are used to model the occurrence of events in space and time.
  • Hawkes processes are a type of self-exciting point process that can capture the clustering and contagion effects often observed in real-world event data, such as earthquakes, social media interactions, or financial transactions.
  • The proposed approach allows for more expressive and adaptable modeling of the spatial and temporal dependencies in the data compared to previous methods.

Plain English Explanation

Hawkes processes are a way to model how events like earthquakes, social media posts, or stock trades happen over time and space. These events often cluster together - for example, an earthquake is more likely to be followed by aftershocks, or a social media post is more likely to spur further interactions. Hawkes processes can capture this "self-exciting" behavior.

This paper introduces a new, more flexible way to model these space-time Hawkes processes. Previous methods were limited in how they could represent the complex patterns we see in real-world event data. The new approach allows the model to better adapt to the specific characteristics of the data, leading to more accurate and insightful analysis.

For example, when studying the spread of information on social media, this flexible Hawkes model could uncover more nuanced patterns in how posts trigger further activity over time and across different locations. Or in seismology, it could provide a richer understanding of how earthquake sequences evolve in space and time.

Technical Explanation

The paper proposes a flexible parametric framework for inference in space-time Hawkes processes. Unlike previous approaches that relied on restrictive parametric forms, this method uses a more expressive model that can better capture the complex spatiotemporal dependencies in the data.

The key innovations are:

  1. Adopting a flexible kernel function to model the spatial and temporal excitation effects, based on Integrated Variational Fourier Features for Efficient Spatial Modelling.
  2. Incorporating covariate information through an additive log-linear intensity function, allowing the model to account for exogenous factors that may influence event occurrence.
  3. Developing an efficient inference procedure using a variational Bayes framework, which approximates the true posterior distribution over the model parameters.

The authors demonstrate the effectiveness of their approach on both synthetic and real-world datasets, showing improved predictive performance compared to existing state-of-the-art methods for space-time Hawkes processes, such as Granger Causal Inference for Multivariate Hawkes Processes and Modeling Randomly Observed Spatiotemporal Dynamical Systems.

Critical Analysis

The paper presents a compelling and well-designed approach for flexible inference in space-time Hawkes processes. The use of a more expressive kernel function and the ability to incorporate covariates are clear strengths that address limitations of prior methods.

One potential area for further research is the extension of this framework to handle irregularly-sampled or partially observed data, as discussed in Non-Parametric Learning of Stochastic Differential Equations from Sparse Observations and Equation Discovery with Bayesian Spike-and-Slab Priors for Efficient High-Dimensional Model Search. This could broaden the applicability of the method to an even wider range of real-world scenarios.

Additionally, the authors could explore the interpretability of the learned model parameters and their potential for providing domain-specific insights, beyond just improved predictive performance.

Conclusion

This paper introduces a flexible and powerful approach for modeling space-time Hawkes processes, which are widely used to study the occurrence of events in diverse fields like seismology, epidemiology, and financial economics. By adopting a more expressive parametric form and leveraging variational inference, the proposed method can better capture the complex spatiotemporal dependencies in event data compared to prior techniques.

The improved modeling capabilities of this framework could lead to better forecasting, anomaly detection, and causal inference in applications where understanding the dynamics of event sequences is crucial. As the authors demonstrate, this flexible parametric inference method represents a significant advance in the state of the art for space-time Hawkes processes.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Flexible Parametric Inference for Space-Time Hawkes Processes
Total Score

0

Flexible Parametric Inference for Space-Time Hawkes Processes

Emilia Siviero, Guillaume Staerman, Stephan Cl'emenc{c}on, Thomas Moreau

Many modern spatio-temporal data sets, in sociology, epidemiology or seismology, for example, exhibit self-exciting characteristics, triggering and clustering behaviors both at the same time, that a suitable Hawkes space-time process can accurately capture. This paper aims to develop a fast and flexible parametric inference technique to recover the parameters of the kernel functions involved in the intensity function of a space-time Hawkes process based on such data. Our statistical approach combines three key ingredients: 1) kernels with finite support are considered, 2) the space-time domain is appropriately discretized, and 3) (approximate) precomputations are used. The inference technique we propose then consists of a $ell_2$ gradient-based solver that is fast and statistically accurate. In addition to describing the algorithmic aspects, numerical experiments have been carried out on synthetic and real spatio-temporal data, providing solid empirical evidence of the relevance of the proposed methodology.

Read more

6/18/2024

🤯

Total Score

0

Granger Causal Inference in Multivariate Hawkes Processes by Minimum Message Length

Katerina Hlavackova-Schindler, Anna Melnykova, Irene Tubikanec

Multivariate Hawkes processes (MHPs) are versatile probabilistic tools used to model various real-life phenomena: earthquakes, operations on stock markets, neuronal activity, virus propagation and many others. In this paper, we focus on MHPs with exponential decay kernels and estimate connectivity graphs, which represent the Granger causal relations between their components. We approach this inference problem by proposing an optimization criterion and model selection algorithm based on the minimum message length (MML) principle. MML compares Granger causal models using the Occam's razor principle in the following way: even when models have a comparable goodness-of-fit to the observed data, the one generating the most concise explanation of the data is preferred. While most of the state-of-art methods using lasso-type penalization tend to overfitting in scenarios with short time horizons, the proposed MML-based method achieves high F1 scores in these settings. We conduct a numerical study comparing the proposed algorithm to other related classical and state-of-art methods, where we achieve the highest F1 scores in specific sparse graph settings. We illustrate the proposed method also on G7 sovereign bond data and obtain causal connections, which are in agreement with the expert knowledge available in the literature.

Read more

4/12/2024

Modeling Randomly Observed Spatiotemporal Dynamical Systems
Total Score

0

Modeling Randomly Observed Spatiotemporal Dynamical Systems

Valerii Iakovlev, Harri Lahdesmaki

Spatiotemporal processes are a fundamental tool for modeling dynamics across various domains, from heat propagation in materials to oceanic and atmospheric flows. However, currently available neural network-based modeling approaches fall short when faced with data collected randomly over time and space, as is often the case with sensor networks in real-world applications like crowdsourced earthquake detection or pollution monitoring. In response, we developed a new spatiotemporal method that effectively handles such randomly sampled data. Our model integrates techniques from amortized variational inference, neural differential equations, neural point processes, and implicit neural representations to predict both the dynamics of the system and the probabilistic locations and timings of future observations. It outperforms existing methods on challenging spatiotemporal datasets by offering substantial improvements in predictive accuracy and computational efficiency, making it a useful tool for modeling and understanding complex dynamical systems observed under realistic, unconstrained conditions.

Read more

6/4/2024

🏋️

Total Score

0

Stationary Kernels and Gaussian Processes on Lie Groups and their Homogeneous Spaces II: non-compact symmetric spaces

Iskander Azangulov, Andrei Smolensky, Alexander Terenin, Viacheslav Borovitskiy

Gaussian processes are arguably the most important class of spatiotemporal models within machine learning. They encode prior information about the modeled function and can be used for exact or approximate Bayesian learning. In many applications, particularly in physical sciences and engineering, but also in areas such as geostatistics and neuroscience, invariance to symmetries is one of the most fundamental forms of prior information one can consider. The invariance of a Gaussian process' covariance to such symmetries gives rise to the most natural generalization of the concept of stationarity to such spaces. In this work, we develop constructive and practical techniques for building stationary Gaussian processes on a very large class of non-Euclidean spaces arising in the context of symmetries. Our techniques make it possible to (i) calculate covariance kernels and (ii) sample from prior and posterior Gaussian processes defined on such spaces, both in a practical manner. This work is split into two parts, each involving different technical considerations: part I studies compact spaces, while part II studies non-compact spaces possessing certain structure. Our contributions make the non-Euclidean Gaussian process models we study compatible with well-understood computational techniques available in standard Gaussian process software packages, thereby making them accessible to practitioners.

Read more

9/16/2024