Wuhan Univ. J. Nat. Sci.
Volume 28, Number 2, April 2023
|Page(s)||169 - 176|
|Published online||23 May 2023|
CLC number: TP 305
Short-Term Wind Power Prediction Method Based on Combination of Meteorological Features and CatBoost
Jilin Province Meteorological Information Network Center, Changchun 130062, Jilin, China
† To whom correspondence should be addressed. E-mail: firstname.lastname@example.org
As one of the hot topics in the field of new energy, short-term wind power prediction research should pay attention to the impact of meteorological characteristics on wind power while improving the prediction accuracy. Therefore, a short-term wind power prediction method based on the combination of meteorological features and CatBoost is presented. Firstly, morgan-stone algebras and sure independence screening(MS-SIS) method is designed to filter the meteorological features, and the influence of the meteorological features on the wind power is explored. Then, a sort enhancement algorithm is designed to increase the accuracy and calculation efficiency of the method and reduce the prediction risk of a single element. Finally, a prediction method based on CatBoost network is constructed to further realize short-term wind power prediction. The National Renewable Energy Laboratory (NREL) dataset is used for experimental analysis. The results show that the short-term wind power prediction method based on the combination of meteorological features and CatBoost not only improve the prediction accuracy of short-term wind power, but also have higher calculation efficiency.
Key words: meteorological features / short-term power load forecasting / CatBoost / wind power
Biography: MOU Xingyu, male, Master, Assistant engineer, research direction: wind power. E-mail: email@example.com
Fundation item: Supported by the National Science and Technology Basic Work Project of China Meteorological Administration(2005DKA31700-06), Innovation Fund of Public Meteorological Service Center of China Meteorological Administration (M2020013)
© Wuhan University 2023
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Under the consensus of the global energy shortage environment and achieving the goal of carbon neutralization, the development and utilization of new energy has become an important way for many countries to solve the energy shortage. Wind energy, as a large-scale commercial green energy, has become an important part of the transformation of energy structure. When wind energy is used as a supplement to alternative energy and basic energy, the randomness of wind direction and wind speed causes large-scale uncertain fluctuations of wind power, which seriously restricts the large-scale development of wind power. In order to ensure the safe and stable operation of the power grid and improve the wind power consumption capacity, there is an urgent need to develop accurate wind power forecasting methods.
Around the short-term accurate wind power forecasting, researchers have carried out more extensive and in-depth research[3,4]. The existing load forecasting methods can be divided into two categories: statistical method[5-7] and deep learning method[8-10]. Statistical methods usually use historical data with time series to predict wind power values. The commonly used statistical methods are regression method and time series method[6, 7] and so on. The statistical method has the problem of poor ability to deal with the nonlinear relationship between data when the load sample is large, so the prediction accuracy is not high. The depth learning method is through the depth neural network combined with a large number of data training and practice, so that the method can learn the relationship between the data to predict the wind power. The methods commonly used in load forecasting are neural network, random forest, extreme learning machine and so on.
With the rapid development of deep learning in recent years, researchers have carried out more extensive and in-depth research on wind short-term power prediction by using this method, and have made great progress. Cherkassky et al established a multi-supported support vector machine (SVM) method and enhanced the parameter optimization, which further improved the accuracy of prediction. However, the gradient explosion and disappearance of traditional neural networks are important factors that limit its development at present. In order to solve this problem, Shahid et al proposed to use long short-term memory (LSTM) method to establish wind power, which effectively solves the gradient problem of traditional neural network. However, the prediction process requires multiple weight parameters, the training of the method is difficult, and the prediction waiting time is long. In order to solve this pain point, the limit gradient lifting algorithm has aroused the much interests among researchers due to its better accuracy than traditional methods and less time cost in model training through parallel operation. At present, this method has been applied in photovoltaic power generation prediction and wind power prediction. For the multi-dimensional model, Zhang et al determined that the wind power data had chaotic characteristics and established the corresponding chaotic model.
Ding et al decomposed the wind power series by improving the complementary set empirical mode, and then predicted the wind power data by using the echo state network. The prediction method in Ref. only considers the problem of wind turbine power, but ignores other meteorological characteristics. In reality, different wind farms are suitable for different model meteorological feature inputs, so corresponding algorithms are required to select appropriate meteorological features as the input variables of the model. CatBoost algorithm can reduce the need for many super parameter tuning and the chance of over fitting, and make the model more versatile. Furthermore, CatBoost can effectively avoid the impact of uneven data distribution on the model with good effect, high precision and strong generalization ability.
In this paper, a short-term wind power forecasting method CatBoost short term wind energy forecast (CBSWF) based on the combination of meteorological characteristics and CatBoost is proposed. First of all, the meteorological characteristics affecting wind power are defined; then the Categorical features is counted, the feature frequency is calculated to generate new exponential features, and the feature dimension is increased by combining categories; then the feature algorithm is used for parameter optimization; finally, the prediction method based on CBSWF method is tested by comparison with other methods. The experimental results show that this method can effectively improve the training time and prediction accuracy of wind power.
In the short-term wind power prediction, wind speed is the main factor that determines the output power of wind farm. Zhu et al found that the wind speed at different heights has a certain impact on the atmospheric characteristics around the wind farm. Then Ma et al pointed out that the wake effect in the fan space is also one of the important factors affecting the wind power, and the wind direction has a great influence on the wind power, so it is necessary to select and model the meteorological characteristics. In short-term wind power forecasting, the commonly-used meteorological characteristics are shown in Table 1.
When dealing with the categorical features in meteorological features, the CBSWF method is replaced by the average value of the label corresponding to the categorical feature. In the decision tree, the average value of the label will be used as the criterion for node splitting. This method is called Greedy Target-based Statistics, or Greedy TS for short, as shown in formula (1):
where x represents the numerical variable, i the category, Y the target variable, j the current sample, and k the training sample. The label averaging method is used to accommodate more information. If the average value of the label is forced to represent the feature, the conditional offset problem will occur when the data structure, the distribution of the training data set and the test data set are different. The CBSWF method improves Greedy TS by adding a priori distribution term, resulting in the impact of noise and low-frequency type data on data distribution:
where l is the added prior term, represents the random arrangement order, and is usually the weight coefficient greater than 0. Aiming at the feature with a small number of categories, the noise data can be reduced. For the regression problem, in general, a priori term can take the mean value of the data set . For binary classification, a priori term is a priori probability of a positive example. It is also valid to use multiple data sets to arrange, but if calculated directly, it may lead to overfitting. CBSWF avoids the problem of over-fitting in the arrangement and calculation of symmetric trees.
Common meteorological features for short-term wind power prediction
Feature screening is a fast and effective dimensionality reduction method for dealing with high-dimensional data. In this paper, a feature screening method MS-SIS based on sure independence screening (SIS) is designed, which can directly deal with the high-dimensional feature screening problem of without dealing with multi-classification discrete variables and covariables. There are covariables in the CBSWF method, which are used to construct a feature screening index to measure the importance of the correlation between the covariable and the response variable C.
where P is the number of dimensions, b represents the random discrete variable, and c is the covariable of b, the total is r.
Based on the characteristic index , let , the important variable is A, the non-important variable is I, and the random sample is taken from , then
Build the filtering process
There exist non-negative numbers and , when .Let , . The filtered subset is calculated by :
There is a positive number , and
which distinguishes the variables in in order of importance:
CBSWF uses Algorithm 1 to overcome the prediction offset problem, as shown as below.
|Algorithm 1: Ordered boosting|
In Algorithm 1, in order to obtain unbiased gradient estimation, CBSWF trains a separate method for each sample , and method is trained by using a training set that does not contain sample .
The gradient estimation of the sample is obtained by , and the gradient is used to train the base learner and get the final method.
Let be the method after building trees, and be the gradient value of training sample after building trees. Then the method is trained to make unbiased to method . For each , a separate method is trained, and the method is never updated with a gradient estimate based on the sample. Use to estimate the gradient of , and use the estimated value to score the result tree. As shown in Algorithm 2, where is the loss function to be optimized, is the label value, and is the formula calculated value.
|Algorithm 2: Updating the models and calculating model values for gradient estimation|
|input: ordered according to ;
the number of tree ;
CBSWF algorithm is to get a strong learner through the serial iteration of a group of classifiers, so as to classify with higher precision. It uses forward distribution algorithm and weak learner uses classification regression tree (CART).
Let be the number of iterations, the strong learner obtained in the previous iteration is , and the loss function is , then the purpose of this iteration is to find the weak learner of the regression tree method and minimize the loss function of this round. Formula (9) represents the of the current iteration.
The negative gradient of the loss function is used to fit the approximate value of the loss of each round, and represents the above gradient in formula (10).
The formula (11) is usually used to approximate .
Finally, as shown in formula (12), we get
The conditional distribution calculated randomly according to is offset from the distribution of the test set, so that there is a deviation between defined by formula (11) and formula (9), which finally affects the generalization ability of method .
The CBSWF method can effectively integrate the information from multiple methods, reduce the prediction risk of a single method, and improve the overall prediction accuracy of the algorithm by using CatBoost fusion MS-SIS method to construct a combination method. Therefore, CBSWF method is combined with MS-SIS feature selection algorithm to construct a combination forecasting method with CatBoost as the underlying algorithm. The corresponding training and forecasting process is shown in Fig. 1.
Forecast training process
1) MS-SIS based feature selection operation is performed on the original feature set.
2) According to the order of MS-SIS, the data set is divided into n training subsets .
3) training subsets are trained by CatBoost to generate n subvariables . The prediction error of each sub-method is evaluated by test set and mean square error, and the calculation formula is as follows:
where is the measured power value of , is the predicted power value of , and N is the number of samples.
4) Data preprocessing including feature selection is carried out on the prediction set, and the processed prediction set is divided into n prediction subsets according to the wind speed at different heights.
5) The generated by the training process corresponds to the prediction error , and then the test samples are calculated to get the final prediction results.
Test is performed on the Win10 operating system and python3.7 and TensorFlow2.0, CPU: i7 12800HX, graphics card: GTX 3070Ti.
The sample data of wind farm A selected in this paper is the measured public data set of a wind turbine group in the United States in 2012 provided by the National Renewable Energy Laboratory (NREL). The installed capacity of the cluster is 18 MW, and the data obtained include six different time series data, such as wind direction, wind speed, air temperature, air pressure, atmospheric density and wind power. The sampling interval is 5 min, without missing value, a total of 105 120 time section data are obtained. In order to fully demonstrate the performance of the method proposed in this paper, relevant experiments are carried out on the measured data and historical numerical weather forecast data of a wind farm B in Northeast China. The installed capacity of the farm is 80 MW, the hub height is 70 m, and the sampling interval is 15 min. The data have a total of 70 000 time sections. Bilinear interpolation and Kriging interpolation methods are used to select missing values for different meteorological elements.
Considering that the sampling interval of the original data is 5 and 15 min, in order to maximize the extraction of hourly features, daily features and monthly features, the number of time steps is 12, the network uses mini-batch input, and the number of samples per input is 72. The method uses 50 epochs iterative training calculations, and the measures of earlystop are taken to reduce the over-fitting and training time, and the mean square error (MSE) is used as the loss function during training. Wind farm A uses the first 80 000 pieces of data as the training set, and the remaining 25 120 pieces of data as the test set; wind farm B uses the first 55 000 pieces of data as the training set, and the remaining 15 000 pieces of data as the test set. The grid search optimization method provided by keras is used to ensure the accuracy of parameter setting. The parameter structure selection are shown in Table 2.
Root mean square error (RMSE)  and mean absolute error (MAE)  are used to evaluate the prediction effect. RMSE mainly reflects the performance of the method to control the absolute error. MAE mainly reflects the actual situation of the prediction error. The specific calculation methods are as follows:
where and are the actual and predicted values of wind power, n is the number of prediction and verification data, and i is the sequence number of prediction points. In addition, all the assessment indicators provided in this paper are normalized by installed capacity.
The prediction ability of the CBSWF method is compared with two groups of prediction algorithms, MLSTM method and CEEMD-FA-ESN method. The parameters of each method are adjusted according to the actual prediction situation to achieve the corresponding optimal prediction effect for comparison. And in order to be more in line with the actual situation, the value that exceeds the maximum generation power in the prediction results is recorded as the maximum generation power and the predicted negative power as 0. Figure 2 shows the time loss of the three prediction methods in the iterative process, which shows that the CBSWF method has the highest time efficiency.
Iterations of the experimental model
The comparison of the prediction results of the three prediction methods for wind farm A and wind farm B is shown in Fig. 3, which shows that for wind farm A and wind farm B, the three methods can better predict the trend of wind power, but the accuracy of CBSWF method is obviously improved and the degree of fit is better than that of other methods.
Comparative analysis of test data for wind farm A ((a), (b)) and wind farm B ((c), (d))
From the comparison of the prediction results of Fig. 3(b) and 3(d) combined with the error comparison of various methods given in Table 3, it is obvious that the prediction accuracy of CBSWF method is higher than that of MLSTM method and CEEMD-FA-ESN method, and the average error of this method in RMSE is 40.97% and 27.24% lower than that of MLSTM method and CEEMD-FA-ESN method, respectively. The corresponding average error of MAE also decreased by 44.42% and 35.2%, respectively. For the sharp rise and fall of the original signal, the fitting effect of this method is still relatively ideal, while the errors of MLSTM method and CEEMD-FA-ESN method are relatively large in the face of these sharp fluctuations. This shows that the MS-SIS method can effectively extract the sequence details of meteorological data and achieve higher prediction accuracy. It further shows that the CBSWF method has obvious advantages in wind power prediction.
Parameter selection of method
Prediction errors of models
In view of the weak correlation of meteorological data and the accuracy of data prediction in the current short-term wind power forecasting, a forecasting method CBSWF which combines the feature selection method of meteorological data with CatBoost is proposed in this paper. The meteorological data are processed based on MS-SIS, and the meteorological features which have great influence on wind power are obtained by the relevant feature selection algorithm, and the coupling relationship between variables is eliminated. In order to take into account the accuracy and efficiency of the algorithm and reduce the prediction risk of a single method, this method uses CatBoost as the underlying algorithm to construct the combination forecasting method CBSWF. The prediction accuracy is improved by sorting the algorithm, and the gradient deviation algorithm is designed to increase the stability of the method, reduce the training time and reduce the amount of calculation. The experimental results show that the CBSWF method has a good performance in predicting the overall trend of wind power and its local details. In the next step of work, it will be considered to further improve the prediction accuracy of wind power by downscaling the data and time through meteorological numerical prediction.
- Li H H, Tan Z F, Chen H T, et al. Integrated heat and power dispatch model for wind-CHP system with solid heat storage device based on robust stochastic theory [J]. Wuhan University Journal of Natural Sciences, 2018, 23(1): 31-42. [CrossRef] [MathSciNet] [Google Scholar]
- Hu Y, Li Q, Fang F, et al. Dynamic interval modeling of ultra-short-term output of wind farm based on finite difference operating domains [J]. Power System Technology, 2022, 46(4): 1346-1357(Ch). [Google Scholar]
- Tang X Z, Gu N W, Huang X Q, et al. Progress on short term wind power forecasting technology [J]. Journal of Mechanical Engineering, 2022, 58(12): 213-236(Ch). [Google Scholar]
- Feng S L, Wang W S, Liu C, et al. Study on the physical approach to wind power prediction [J]. Proceedings of the CSEE, 2010, 30(2): 1-6(Ch). [Google Scholar]
- Lu P, Ye L, Pei M, et al. Coordinated control strategy for active power of wind power cluster based on model predictive control [J]. Proceedings of the CSEE, 2021, 41(17): 5887-5900(Ch). [Google Scholar]
- Sun Y, Li Z Y, Yu X N, et al. Research on ultra-short-term wind power prediction considering source relevance [J]. IEEE Access, 2020, 8: 147703-147710. [CrossRef] [Google Scholar]
- Lu P, Ye L, Zhong W Z, et al. A novel spatio-temporal wind power forecasting framework based on multi-output support vector machine and optimization strategy [J]. Journal of Cleaner Production, 2020, 254: 119993. [CrossRef] [Google Scholar]
- Liu T H, Wei H K, Zhang K J. Wind power prediction with missing data using Gaussian process regression and multiple imputation [J]. Applied Soft Computing, 2018, 71: 905-916. [Google Scholar]
- Liu X, Zhou J, Qian H M. Short-term wind power forecasting by stacked recurrent neural networks with parametric sine activation function [J]. Electric Power Systems Research, 2021, 192: 107011. [CrossRef] [Google Scholar]
- Zhao Z, Wang X S. Ultra-short-term multi-step wind power prediction based on CEEMD and improved time series model[J]. Acta Energiae Solaris Sinica, 2020, 41(7): 352-358(Ch). [Google Scholar]
- Cherkassky V, Ma Y Q. Practical selection of SVM parameters and noise estimation for SVM regression [J]. Neural Networks: The Official Journal of the International Neural Network Society, 2004, 17(1): 113-126. [Google Scholar]
- Zhou D W, Zhao L J, Duan R, et al. Image super-resolution based on recursive residual networks [J]. Acta Automatica Sinica, 2019, 45(6): 1157-1165(Ch). [Google Scholar]
- Shahid F, Zameer A, Muneeb M. A novel genetic LSTM model for wind power forecast [J]. Energy, 2021, 223: 120069. [Google Scholar]
- Meng Y, Chen S L, Wu Z H, et al. A DC arc fault detection method based on CatBoost algorithm for different electrode materials [J]. Journal of Xi'an Jiaotong University, 2022, 56(3): 124-134(Ch). [Google Scholar]
- Munawar U, Wang Z L. A framework of using machine learning approaches for short-term solar power forecasting[J]. Journal of Electrical Engineering & Technology, 2020, 15(2): 561-569. [NASA ADS] [CrossRef] [Google Scholar]
- Liu K W, Pu T J, Zhou H M, et al. A short-term wind power forecasting model based on combination algorithms [J]. Proceedings of the CSEE, 2013, 33(34): 130-135(Ch). [Google Scholar]
- Zhang Q, Tang Z H, Wang G, et al. Ultra-short-term wind power prediction model based on long and short term memory network [J]. Acta Energiae Solaris Sinica, 2021, 42(10): 275-281(Ch). [Google Scholar]
- Ding J L, Chen G C, Yuan K. Short-term wind power prediction based on improved firefly algorithm [J]. Journal of System Simulation, 2019, 31(11): 2509-2516(Ch). [Google Scholar]
- Qian Z, Pei Y, Cao L X, et al. Review of wind power forecasting method [J]. High Voltage Engineering, 2016, 42(4): 1047-1060(Ch). [Google Scholar]
- Dong L M, Zeng W Z, Lei G Q. Coupling CatBoost model with bat algorithm to simulate the pan evaporation in northwest China [J]. Water Saving Irrigation, 2021(2): 63-69(Ch). [Google Scholar]
- Miao F S, Li Y, Gao C, et al. Diabetes prediction method based on CatBoost algorithm [J]. Computer Systems & Applications, 2019, 28(9): 215-218(Ch). [Google Scholar]
- Yao F Q, Sun J W, Dong J H. Estimating daily dew point temperature based on local and cross-station meteorological data using CatBoost algorithm [J]. Computer Modeling in Engineering & Sciences, 2022, 130(2): 671-700. [Google Scholar]
- Zhu R, Xu H, Gong Q, et al. Wind environmental regionalization for development and utilization of wind energy in China [J]. Acta Energiae Solaris Sinica, 2022, 8: 1-14(Ch). [Google Scholar]
- Ma X P, He S E, Yao Y, et al. Virtual inertia estimation of wind farm zones with wind speed uncertainty and correlation[J]. Power System Protection and Control, 2022, 50(10): 123-131(Ch). [Google Scholar]
- Kundu S M, Pal S K. Deprecation based greedy strategy for target set selection in large scale social networks [J]. Information Sciences: An International Journal, 2015, 316: 107-122. [Google Scholar]
- Fan J Q, Lv J C. Sure independence screening for ultrahigh dimensional feature space [J]. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 2008, 70(5): 849-911. [CrossRef] [MathSciNet] [Google Scholar]
- Zhou Q, Ren H J, Li J, et al. Variable weight combination method for mid-long term power load forecasting based on hierarchical structure [J]. Proceedings of the CSEE, 2010, 30(16): 47-52(Ch). [Google Scholar]
- Faber N M. Estimating the uncertainty in estimates of root mean square error of prediction: Application to determining the size of an adequate test set in multivariate calibration [J]. Chemometrics and Intelligent Laboratory Systems, 1999, 49(1): 79-89. [Google Scholar]
- Coyle E J, Lin J H. Stack filters and the mean absolute error criterion [J]. IEEE Transactions on Acoustics, Speech, and Signal Processing, 1988, 36(8): 1244-1254. [Google Scholar]
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.