Forecasting Day-Ahead Electricity Prices in the Integrated Single Electricity Market: Addressing Volatility with Comparative Machine Learning Methods

Read original: arXiv:2408.05628 - Published 8/13/2024 by Ben Harkin, Xueqin Liu
Total Score

0

Forecasting Day-Ahead Electricity Prices in the Integrated Single Electricity Market: Addressing Volatility with Comparative Machine Learning Methods

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Forecasting electricity prices in the Integrated Single Electricity Market (I-SEM) to address volatility using machine learning methods
  • Compares the performance of different machine learning models in forecasting day-ahead electricity prices
  • Focuses on addressing the high volatility and uncertainty in electricity prices

Plain English Explanation

The paper explores using machine learning methods to forecast day-ahead electricity prices in the Integrated Single Electricity Market (I-SEM), which covers the island of Ireland. Electricity prices in this market can be highly volatile and uncertain, making accurate forecasting challenging.

The researchers compare the performance of several machine learning models, including linear regression, random forests, and neural networks, in predicting day-ahead electricity prices. They aim to identify the most effective approach for addressing the high volatility and uncertainty in this market.

Technical Explanation

The paper evaluates the performance of several machine learning models in forecasting day-ahead electricity prices in the I-SEM. The researchers collected historical data on electricity prices, load, and other relevant factors, and split the data into training and testing sets.

They then trained and evaluated the performance of the following models:

  • Linear regression
  • Random forest
  • Multilayer perceptron (neural network)
  • XGBoost
  • Gradient boosting

The models were assessed based on their ability to accurately predict day-ahead electricity prices, as measured by metrics such as mean absolute error (MAE) and root mean squared error (RMSE). The researchers also analyzed the feature importance to understand the key drivers of electricity prices in the I-SEM.

Critical Analysis

The paper provides a comprehensive comparison of various machine learning techniques for forecasting day-ahead electricity prices in the I-SEM. However, the authors acknowledge that the high volatility and uncertainty in the market pose significant challenges, and the models may not always capture all the underlying factors that influence electricity prices.

Additionally, the paper does not discuss the potential limitations of the data used, such as the representativeness of the historical data or the availability of relevant variables. The researchers also do not explore the potential for incorporating additional data sources, such as weather forecasts or market dynamics, to improve the model's performance.

Further research could investigate the integration of different forecasting approaches, such as probabilistic or ensemble methods, to better account for the inherent uncertainty in electricity price forecasting. Additionally, exploring the impact of market events, policy changes, or other external factors on electricity prices could provide valuable insights.

Conclusion

This paper presents a comparative analysis of machine learning methods for forecasting day-ahead electricity prices in the I-SEM, a market characterized by high volatility and uncertainty. The researchers find that advanced techniques, such as random forests and neural networks, can outperform traditional linear regression in this context.

The insights from this study can help electricity market participants, grid operators, and policymakers better understand the drivers of electricity prices and develop more robust forecasting models. Improved price forecasting can support more effective decision-making, risk management, and overall market efficiency in the I-SEM and similar electricity markets.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Forecasting Day-Ahead Electricity Prices in the Integrated Single Electricity Market: Addressing Volatility with Comparative Machine Learning Methods
Total Score

0

Forecasting Day-Ahead Electricity Prices in the Integrated Single Electricity Market: Addressing Volatility with Comparative Machine Learning Methods

Ben Harkin, Xueqin Liu

This paper undertakes a comprehensive investigation of electricity price forecasting methods, focused on the Irish Integrated Single Electricity Market, particularly on changes during recent periods of high volatility. The primary objective of this research is to evaluate and compare the performance of various forecasting models, ranging from traditional machine learning models to more complex neural networks, as well as the impact of different lengths of training periods. The performance metrics, mean absolute error, root mean square error, and relative mean absolute error, are utilized to assess and compare the accuracy of each model. A comprehensive set of input features was investigated and selected from data recorded between October 2018 and September 2022. The paper demonstrates that the daily EU Natural Gas price is a more useful feature for electricity price forecasting in Ireland than the daily Henry Hub Natural Gas price. This study also shows that the correlation of features to the day-ahead market price has changed in recent years. The price of natural gas on the day and the amount of wind energy on the grid that hour are significantly more important than any other features. More specifically speaking, the input fuel for electricity has become a more important driver of the price of it, than the total generation or demand. In addition, it can be seen that System Non-Synchronous Penetration (SNSP) is highly correlated with the day-ahead market price, and that renewables are pushing down the price of electricity.

Read more

8/13/2024

⚙️

Total Score

0

An adaptive standardisation methodology for Day-Ahead electricity price forecasting

Carlos Sebasti'an, Carlos E. Gonz'alez-Guill'en, Jes'us Juan

The study of Day-Ahead prices in the electricity market is one of the most popular problems in time series forecasting. Previous research has focused on employing increasingly complex learning algorithms to capture the sophisticated dynamics of the market. However, there is a threshold where increased complexity fails to yield substantial improvements. In this work, we propose an alternative approach by introducing an adaptive standardisation to mitigate the effects of dataset shifts that commonly occur in the market. By doing so, learning algorithms can prioritize uncovering the true relationship between the target variable and the explanatory variables. We investigate five distinct markets, including two novel datasets, previously unexplored in the literature. These datasets provide a more realistic representation of the current market context, that conventional datasets do not show. The results demonstrate a significant improvement across all five markets using the widely accepted learning algorithms in the literature (LEAR and DNN). In particular, the combination of the proposed methodology with the methodology previously presented in the literature obtains the best results. This significant advancement unveils new lines of research in this field, highlighting the potential of adaptive transformations in enhancing the performance of forecasting models.

Read more

4/29/2024

Bayesian Hierarchical Probabilistic Forecasting of Intraday Electricity Prices
Total Score

0

Bayesian Hierarchical Probabilistic Forecasting of Intraday Electricity Prices

Daniel Nickelsen, Gernot Muller

We present a first study of Bayesian forecasting of electricity prices traded on the German continuous intraday market which fully incorporates parameter uncertainty. A particularly large set of endogenous and exogenous covariables is used, handled through feature selection with Orthogonal Matching Pursuit (OMP) and regularising priors. Our target variable is the IDFull price index, forecasts are given in terms of posterior predictive distributions. For validation we use the exceedingly volatile electricity prices of 2022, which have hardly been the subject of forecasting studies before. As a benchmark model, we use all available intraday transactions at the time of forecast creation to compute a current value for the IDFull. According to the weak-form efficiency hypothesis, it would not be possible to significantly improve this benchmark built from last price information. We do, however, observe statistically significant improvement in terms of both point measures and probability scores. Finally, we challenge the declared gold standard of using LASSO for feature selection in electricity price forecasting by presenting strong statistical evidence that OMP leads to better forecasting performance.

Read more

7/31/2024

Forecasting Electricity Market Signals via Generative AI
Total Score

0

Forecasting Electricity Market Signals via Generative AI

Xinyi Wang, Qing Zhao, Lang Tong

This paper presents a generative artificial intelligence approach to probabilistic forecasting of electricity market signals, such as real-time locational marginal prices and area control error signals. Inspired by the Wiener-Kallianpur innovation representation of nonparametric time series, we propose a weak innovation autoencoder architecture and a novel deep learning algorithm that extracts the canonical independent and identically distributed innovation sequence of the time series, from which samples of future time series are generated. The validity of the proposed approach is established by proving that, under ideal training conditions, the generated samples have the same conditional probability distribution as that of the ground truth. Three applications involving highly dynamic and volatile time series in real-time market operations are considered: (i) locational marginal price forecasting for self-scheduled resources such as battery storage participants, (ii) interregional price spread forecasting for virtual bidders in interchange markets, and (iii) area control error forecasting for frequency regulations. Numerical studies based on market data from multiple independent system operators demonstrate the superior performance of the proposed generative forecaster over leading classical and modern machine learning techniques under both probabilistic and point forecasting metrics.

Read more

7/1/2024