LAPSE:2023.7233
Published Article

LAPSE:2023.7233
Evaluation Metrics for Wind Power Forecasts: A Comprehensive Review and Statistical Analysis of Errors
February 24, 2023
Abstract
Power generation forecasts for wind farms, especially with a short-term horizon, have been extensively researched due to the growing share of wind farms in total power generation. Detailed forecasts are necessary for the optimization of power systems of various sizes. This review and analytical paper is largely focused on a statistical analysis of forecasting errors based on more than one hundred papers on wind generation forecasts. Factors affecting the magnitude of forecasting errors are presented and discussed. Normalized root mean squared error (nRMSE) and normalized mean absolute error (nMAE) have been selected as the main error metrics considered here. A new and unique error dispersion factor (EDF) is proposed, being the ratio of nRMSE to nMAE. The variability of EDF depending on selected factors (size of wind farm, forecasting horizons, and class of forecasting method) has been examined. This is unique and original research, a novelty in studies on errors of power generation forecasts in wind farms. In addition, extensive quantitative and qualitative analyses have been conducted to assess the magnitude of forecasting error depending on selected factors (such as forecasting horizon, wind farm size, and a class of the forecasting method). Based on these analyses and a review of more than one hundred papers, a unique set of recommendations on the preferred content of papers addressing wind farm generation forecasts has been developed. These recommendations would make it possible to conduct very precise benchmarking meta-analyses of forecasting studies described in research papers and to develop valuable general conclusions concerning the analyzed phenomena.
Power generation forecasts for wind farms, especially with a short-term horizon, have been extensively researched due to the growing share of wind farms in total power generation. Detailed forecasts are necessary for the optimization of power systems of various sizes. This review and analytical paper is largely focused on a statistical analysis of forecasting errors based on more than one hundred papers on wind generation forecasts. Factors affecting the magnitude of forecasting errors are presented and discussed. Normalized root mean squared error (nRMSE) and normalized mean absolute error (nMAE) have been selected as the main error metrics considered here. A new and unique error dispersion factor (EDF) is proposed, being the ratio of nRMSE to nMAE. The variability of EDF depending on selected factors (size of wind farm, forecasting horizons, and class of forecasting method) has been examined. This is unique and original research, a novelty in studies on errors of power generation forecasts in wind farms. In addition, extensive quantitative and qualitative analyses have been conducted to assess the magnitude of forecasting error depending on selected factors (such as forecasting horizon, wind farm size, and a class of the forecasting method). Based on these analyses and a review of more than one hundred papers, a unique set of recommendations on the preferred content of papers addressing wind farm generation forecasts has been developed. These recommendations would make it possible to conduct very precise benchmarking meta-analyses of forecasting studies described in research papers and to develop valuable general conclusions concerning the analyzed phenomena.
Record ID
Keywords
deep neural network, ensemble methods, evaluation criteria metrics, forecasting error, hybrid methods, Machine Learning, statistical analysis of errors, wind farm, wind power forecasting, wind turbine
Suggested Citation
Piotrowski P, Rutyna I, Baczyński D, Kopyt M. Evaluation Metrics for Wind Power Forecasts: A Comprehensive Review and Statistical Analysis of Errors. (2023). LAPSE:2023.7233
Author Affiliations
Piotrowski P: Electrical Power Engineering Institute, Warsaw University of Technology, Koszykowa 75 Street, 00-662 Warsaw, Poland [ORCID]
Rutyna I: Electrical Power Engineering Institute, Warsaw University of Technology, Koszykowa 75 Street, 00-662 Warsaw, Poland; Ideas NCBR Sp. z o.o, Nowogrodzka Street 47A, 00-695 Warsaw, Poland [ORCID]
Baczyński D: Electrical Power Engineering Institute, Warsaw University of Technology, Koszykowa 75 Street, 00-662 Warsaw, Poland
Kopyt M: Electrical Power Engineering Institute, Warsaw University of Technology, Koszykowa 75 Street, 00-662 Warsaw, Poland
Rutyna I: Electrical Power Engineering Institute, Warsaw University of Technology, Koszykowa 75 Street, 00-662 Warsaw, Poland; Ideas NCBR Sp. z o.o, Nowogrodzka Street 47A, 00-695 Warsaw, Poland [ORCID]
Baczyński D: Electrical Power Engineering Institute, Warsaw University of Technology, Koszykowa 75 Street, 00-662 Warsaw, Poland
Kopyt M: Electrical Power Engineering Institute, Warsaw University of Technology, Koszykowa 75 Street, 00-662 Warsaw, Poland
Journal Name
Energies
Volume
15
Issue
24
First Page
9657
Year
2022
Publication Date
2022-12-19
ISSN
1996-1073
Version Comments
Original Submission
Other Meta
PII: en15249657, Publication Type: Review
Record Map
Published Article

LAPSE:2023.7233
This Record
External Link

https://doi.org/10.3390/en15249657
Publisher Version
Download
Meta
Record Statistics
Record Views
250
Version History
[v1] (Original Submission)
Feb 24, 2023
Verified by curator on
Feb 24, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2023.7233
Record Owner
Auto Uploader for LAPSE
Links to Related Works
