Short Term Load Forecasting Using Bootstrap Aggregating Based Ensemble Artificial Neural Network

Page: [980 - 992] Pages: 13

  • * (Excluding Mailing and Handling)

Abstract

Background: Short Term Load Forecasting (STLF) can predict load from several minutes to week plays a vital role to address challenges such as optimal generation, economic scheduling, dispatching and contingency analysis.

Methods: This paper uses Multi-Layer Perceptron (MLP) Artificial Neural Network (ANN) technique to perform STFL but long training time and convergence issues caused by bias, variance and less generalization ability, make this algorithm unable to accurately predict future loads.

Results: This issue can be resolved by various methods of Bootstraps Aggregating (Bagging) (like disjoint partitions, small bags, replica small bags and disjoint bags) which help in reducing variance and increasing generalization ability of ANN. Moreover, it results in reducing error in the learning process of ANN. Disjoint partition proves to be the most accurate Bagging method and combining outputs of this method by taking mean improves the overall performance.

Conclusion: This method of combining several predictors known as Ensemble Artificial Neural Network (EANN) outperforms the ANN and Bagging method by further increasing the generalization ability and STLF accuracy.

Keywords: Short term load forecasting, artificial neural network, multi-layer perceptron, bootstrap aggregating, disjoint partition, ensemble artificial neural network.

Graphical Abstract

[1]
Outlook, B.E., 2019 Edition.,
[2]
A. Rehman, and Z. Deyuan, "Investigating the linkage between economic growth, electricity access, energy use, and population growth in Pakistan", Appl. Sci. (Basel), vol. 8, no. 12, p. 2442, 2018.
[http://dx.doi.org/10.3390/app8122442]
[3]
T. Vantuch, "Machine learning based electric load forecasting for short and long-term period", Internet of Things (WF-IoT), In: 2018 IEEE 4th World Forum on. 2018., 2018 IEEE, 2018
[4]
T. Hong, and S. Fan, "Probabilistic electric load forecasting: A tutorial review", Int. J. Forecast. , vol. 32, no. 3, pp. 914-938. 2016
[http://dx.doi.org/10.1016/j.ijforecast.2015.11.011]
[5]
A. Yang, W. Li, and X. Yang, "Short-term electricity load forecasting based on feature selection and least squares support vector machines", Knowl. Base. Syst., vol. 163, pp. 159-173, 2019.
[http://dx.doi.org/10.1016/j.knosys.2018.08.027]
[6]
M.F. Tahir, and M.A. Saqib, "Optimal scheduling of electrical power in energy-deficient scenarios using artificial neural network and Bootstrap aggregating", Int. J. Electr. Power Energy Syst., vol. 83, pp. 49-57, 2016.
[http://dx.doi.org/10.1016/j.ijepes.2016.03.046]
[7]
A.Y. Alani, and I.O. Osunmakinde, "Short-term multiple forecasting of electric energy loads for sustainable demand planning in smart grids for smart homes", Sustainability, vol. 9, no. 11, p. 1972, 2017.
[http://dx.doi.org/10.3390/su9111972]
[8]
A.K. Singh, "Load forecasting techniques and methodologies: A review", In: , 2nd International Conference on Power, Control and Embedded Systems, 2012
[9]
J. Mi, "Short-term power load forecasting method based on improved exponential smoothing grey model", Math. Probl. Eng., 2018.
[http://dx.doi.org/10.1155/2018/3894723]
[10]
A.K. Srivastava, A.S. Pandey, and D. Singh, "Short-term load forecasting methods: A review", In: , 2016 International Conference on Emerging Trends in Electrical Electronics & Sustainable Energy Systems (ICETEESES), 2016.
[http://dx.doi.org/10.1109/ICETEESES.2016.7581373]
[11]
S.N. Fallah, "Computational intelligence on short-term load forecasting: A methodological overview", Energies, vol. 12, no. 3, p. 393, 2019.
[http://dx.doi.org/10.3390/en12030393]
[12]
Faizan. Tahir, "Optimal load shedding using an ensemble of artificial neural networks", Int. J. Electric. Comput. Engineering Syst., vol. 7, no. 2, pp. 39-46, 2016.
[13]
M.U. Fahad, and N. Arbab, "Factor affecting short term load forecasting", J. Clean Energ. Technol., vol. 2, no. 4, pp. 305-309, 2014.
[http://dx.doi.org/10.7763/JOCET.2014.V2.145]
[14]
M. Rothe, D.A. Wadhwani, and D. Wadhwani, "Short term load forecasting using multi parameter regression", arXiv preprint arXiv:0912.1015,, 2009.
[15]
W. Charytoniuk, M.S. Chen, and P.V. Olinda, "Nonparametric regression based short-term load forecasting", IEEE Trans. Power Syst., vol. 13, no. 3, pp. 725-730, 1998.
[http://dx.doi.org/10.1109/59.708572]
[16]
N. Amjady, "Short-term hourly load forecasting using time-series modeling with peak load estimation capability", IEEE Trans. Power Syst., vol. 16, no. 3, pp. 498-505, 2001.
[http://dx.doi.org/10.1109/59.932287]
[17]
D. Akay, and M. Atak, "Grey prediction with rolling mechanism for electricity demand forecasting of Turkey", Energy, vol. 32, no. 9, pp. 1670-1675, 2007.
[http://dx.doi.org/10.1016/j.energy.2006.11.014]
[18]
S. Singh, S. Hussain, and M.A. Bazaz, "Short term load forecasting using artificial neural network", Image Information Processing (ICIIP), In: 2017 Fourth International Conference on. 2017., 2017 IEEE, 2017.
[19]
O.C. Ozerdem, E.O. Olaniyi, and O.K. Oyedotun, "Short term load forecasting using particle swarm optimization neural network", Procedia Comput. Sci., vol. 120, pp. 382-393, 2017.
[http://dx.doi.org/10.1016/j.procs.2017.11.254]
[20]
P. Ray, S.K. Panda, and D.P. Mishra, Short-term load forecasting using genetic algorithm.Computational Intelligence in Data Mining., Springer, 2019, pp. 863-872.
[http://dx.doi.org/10.1007/978-981-10-8055-5_76]
[21]
M.A. Hamid, and T.A. Rahman, "Short term load forecasting using an artificial neural network trained by artificial immune system learning algorithm", Computer Modelling and Simulation (UKSim), In: 12th International Conference on. IEEE, 2010
[22]
A. Khosravi, S. Nahavandi, and D. Creighton, "Short term load forecasting using interval type-2 fuzzy logic systems", Fuzzy Systems (FUZZ), In: 2011 IEEE International Conference on. 2011., 2011 IEEE, 2011.
[23]
D. Chaturvedi, R. Kumar, and P.K. Kalra, “Artificial neural network learning using improved genetic algorithm”, J. Instit. Eng., CP,. vol. 82, pp. 1-8, 2002
[24]
N. Lu, and J. Zhou, "Particle swarm optimization-based RBF neural network load forecasting model."In: , Power and Energy Engineering Conference APPEEC 2009., Asia-Pacific IEEE, 2009.
[25]
ShangDong; "A new ANN optimized by improved PSO algorithm combined with chaos and its application in short-term load forecasting", In: , Computational Intelligence and Security, 2006 International Conference on IEEE, 2006
[26]
A. Kavousi-Fard, T. Niknam, and M. Golmaryami, "Short term load forecasting of distribution systems by a new hybrid modified FA-backpropagation method", J. Intell. Fuzzy Syst., vol. 26, no. 1, pp. 517-522, 2014.
[http://dx.doi.org/10.3233/IFS-131025]
[27]
N. Dong-Xiao, W. Qiang, and L. Jin-Chao, "Short term load forecasting model using support vector machine based on artificial neural network", In: , 2005 International Conference on Machine Learning and Cybernetics, 2005.
[http://dx.doi.org/10.1109/ICMLC.2005.1527685]
[28]
O. Eluyode, and D.T. Akomolafe, "Comparative study of biological and artificial neural networks", European J. Appl. Eng. Scient. Res., vol. 2, no. 1, pp. 36-46, 2013.
[29]
J. Jiang, P. Trundle, and J. Ren, "Medical image analysis with artificial neural networks", Comput. Med. Imaging Graph.,, vol. 34. no. 8, . pp. 617-631, 2010.
[http://dx.doi.org/10.1016/j.compmedimag.2010.07.003] [PMID: 20713305]
[30]
L. Breiman, "Bagging predictors", Mach. Learn., vol. 24, no. 2, pp. 123-140, 1996.
[http://dx.doi.org/10.1007/BF00058655]
[31]
D. Pardoe, M. Ryoo, and R. Miikkulainen, "Evolving neural network ensembles for control problems", In: , Proceedings of the 7th annual conference on Genetic and evolutionary computation
[32]
H. Li, X. Wang, and S. Ding, "Research and development of neural network ensembles: A survey", Artif. Intell. Rev., vol. 49, no. 4, pp. 455-479, 2018.
[http://dx.doi.org/10.1007/s10462-016-9535-1]
[33]
F. Anifowose, J. Labadin, and A. Abdulraheem, "Ensemble model of artificial neural networks with randomized number of hidden neurons", In: ; 8th International Conference on Information Technology in Asia (CITA) IEEE, 2013
[34]
Australian Government,; B.O.M. Data Requests and Enquiries,.2010, Available at:, http://www.bom.gov.au/climate/data-services/data-requests.shtml
[35]
A.E.M. Operator, Load Data., 2018. Available at: , http://www.aemo.com.au/
[36]
F. Abbas, "Short term residential load forecasting: An Improved optimal nonlinear auto regressive (NARX) method with exponential weight decay function", Electronics (Basel), vol. 7, no. 12, p. 432, 2018.
[http://dx.doi.org/10.3390/electronics7120432]
[37]
J. Tang, C. Deng, and G-B. Huang, "Extreme learning machine for multilayer perceptron", IEEE Trans. Neural Netw. Learn. Syst., vol. 27, no. 4, pp. 809-821, 2016.
[http://dx.doi.org/10.1109/TNNLS.2015.2424995 ] [PMID: 25966483]
[38]
Hao Yu, and Bogdan M. Wilamowski,, "Industrial electronics handbook", Levenberg-marquardt training.,, vol. 5, no. 12, . p. 1, 2011.
[http://dx.doi.org/10.1201/b10604-15]
[39]
Ratnadip Adhikar and R.K. Agrawal,, "A homogeneous ensemble of artificial neural networks for time series forecasting", Int. J. Comput. Appl., vol. 32, no. 7, 2011.
[40]
A. Doudkin, and Y. Marushko, "Using ensembles of neural networks for forecasting telemetry data", Commun. Comput. Inf. Sci., vol. 673, pp. 53-62, 2017.
[http://dx.doi.org/10.1007/978-3-319-54220-1_6]
[41]
R. Polikar, "Ensemble based systems in decision making", IEEE Circuits Syst. Mag.. vol. 6, no. 3, pp. 21-45, 2006.
[http://dx.doi.org/10.1109/MCAS.2006.1688199]
[42]
BA1/4hlmann, , Peter. Bagging, boosting and ensemble methods. Handbook of Computational Statistics., Springer: Berlin, Heidelberg, 2012, pp. 985-1022.