Abstract
This chapter presents the work done in the field of Cartesian Genetic Programming evolved Artificial Neural Networks (CGPANN). Three types of CGPANN are presented, the Feed-forward CGPANN (FFCGPAN), Recurrent CGPANN and the CGPANN that has developmental plasticity, also called Plastic CGPANN or PCGPANN. Each of these networks is explained with the help of diagrams. Performance results obtained for a number of benchmark problems using these networks are illustrated with the help of tables. Artificial Neural Networks (ANNs) suffer from the dilemma of how to select complexity of the network for a specific task, what should be the pattern of inter-connectivity, and in case of feedback, what topology will produce the best possible results. Cartesian Genetic Programming (CGP) offers the ability to select not only the desired network complexity but also the inter-connectivity patterns, topology of feedback systems, and above all, decides which input parameters should be weighted more or less and which one to be neglected. In this chapter we discuss how CGP is used to evolve the architecture of Neural Networks for optimum network and characteristics. Don’t you want a system that designs everything for you? That helps you select the optimal network, the inter-connectivity, the topology, the complexity, input parameters selection and input sensitivity? If yes, then CGP evolved Artificial Neural Network (CGPANN) and CGP evolved Recurrent Neural Network (CGPRNN) is the answer to your questions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ali, J., Khan, G.M., Mahmud, S.A.: Enhancing growth curve approach using CGPANN for predicting the sustainability of new food products. In: IFIP International Conference on Artificial Intelligence Applications and Innovations, pp. 286–297. Springer (2014)
Arbab, M.A., Khan, G.M., Sahibzada, A.M.: Cardiac arrhythmia classification using cartesian genetic programming evolved artificial neural network. Exp. Clin. Cardiol. 20(9) (2014)
Bidlo, M.: Evolutionary design of generic combinational multipliers using development. In: International Conference on Evolvable Systems, pp. 77–88. Springer (2007)
Carpenter, G.A., Grossberg, S.: The art of adaptive pattern recognition by a self-organizing neural network. Computer 21(3), 77–88 (1988)
Fekiač, J., Zelinka, I., Burguillo, J.C.: A review of methods for encoding neural network topologies in evolutionary computation. In: Proceedings of 25th European Conference on Modeling and Simulation ECMS 2011, pp. 410–416 (2011)
Gomez, F., Schmidhuber, J., Miikkulainen, R.: Accelerated neural evolution through cooperatively coevolved synapses. J. Mach. Learn. Res. 9(May), 937–965 (2008)
Gomez, F.J., Miikkulainen, R.: Solving non-markovian control tasks with neuroevolution. IJCAI 99, 1356–1361 (1999)
Guo, H., Nandi, A.K.: Breast cancer diagnosis using genetic programming generated feature. Pattern Recognit. 39(5), 980–987 (2006)
Haider, A., Hanif, M.N.: Inflation forecasting in Pakistan using artificial neural networks. Pak. Econ. Soc. Rev. 123–138 (2009)
Iranpour, M., Almassi, S., Analoui, M.: Breast cancer detection from fna using svm and rbf classifier. In: 1st Joint Congress on Fuzzy and Intelligent Systems (2007)
Jordan, M.I.: Attractor dynamics and parallellism in a connectionist sequential machine. In: Proceedings of the 8th Confererence of the Cognitive Science Society, pp. 531–546. Lawrence Erlbaum Associates (1986)
Kamruzzaman, J., Sarker, R.A.: Forecasting of currency exchange rates using ANN: a case study. In: Neural Networks and Signal Processing, 2003. Proceedings of the 2003 International Conference on, vol. 1, pp. 793–797. IEEE (2003, December)
Khan, G.M., Ali, J., Mahmud, S.A.: Wind power forecastingan application of machine learning in renewable energy. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 1130–1137. IEEE (2014)
Khan, G.M., Khattak, A.R., Zafari, F., Mahmud, S.A.: Electrical load forecasting using fast learning recurrent neural networks. In: The 2013 International Joint Conference on Neural Networks (IJCNN), pp. 1–6. IEEE (2013)
Khan, G.M., Nayab, D., Mahmud, S.A., Zafar, H.: Evolving dynamic forecasting model for foreign currency exchange rates using plastic neural networks. In: 2013 12th International Conference on Machine Learning and Applications (ICMLA), vol. 2, pp. 15–20. IEEE (2013)
Khan, G.M., Ullah, F., Mahmud, S.A.: MPEG-4 internet traffic estimation using recurrent CGPANN. In: International Conference on Engineering Applications of Neural Networks, pp. 22–31. Springer (2013)
Khan, G.M., Zafari, F.: Dynamic feedback neuro-evolutionary networks for forecasting the highly fluctuating electrical loads. Genet. Program. Evolvable Mach. 17(4), 391–408 (2016)
Khan, G.M., Zafari, F., Mahmud, S.A.: Very short term load forecasting using cartesian genetic programming evolved recurrent neural networks (CGPRNN). In: 2013 12th International Conference on Machine Learning and Applications (ICMLA), vol. 2, pp. 152–155. IEEE (2013)
Khan, M.M., Ahmad, A.M., Khan, G.M., Miller, J.F.: Fast learning neural networks using cartesian genetic programming. Neurocomputing 121, 274–289 (2013)
Khan, M.M., Khan, G.M., Miller, J.F.: Developmental plasticity in cartesian genetic programming artificial neural networks. In: Proceedings of the 8th International Conference on Informatics in Control, Automation and Robotics (ICINCO 2011), pp. 449–458. SciTePress (2011)
Kryuchin, O.V., Arzamastsev, A.A., Troitzsch, K.G.: The prediction of currency exchange rates using artificial neural networks. Exch. Organ. Behav. Teach. J. 4 (2007)
Liu, K., Subbarayan, S., Shoults, R., Manry, M., Kwan, C., Lewis, F., Naccarino, J.: Comparison of very short-term load forecasting techniques. IEEE Trans. Power Syst. 11(2), 877–882 (1996)
Moriarty, D.E.: Symbiotic evolution of neural networks in sequential decision tasks. Ph.D. thesis, University of Texas at Austin USA (1997)
Nayab, D., Khan, G.M., Mahmud, S.A.: Prediction of foreign currency exchange rates using cgpann. In: International Conference on Engineering Applications of Neural Networks, pp. 91–101. Springer (2013)
Pan, Z., Nie, L.: Evolving both the topology and weights of neural networks. Parallel Algorithms Appl. 9(3–4), 299–307 (1996)
Papadrakakis, M., Papadopoulos, V., Lagaros, N.D.: Structural reliability analyis of elastic-plastic structures using neural networks and monte carlo simulation. Comput. Methods Appl. Mech. Eng. 136(1–2), 145–163 (1996)
Philip, A.A., Taofiki, A.A., Bidemi, A.A.: Artificial neural network model for forecasting foreign exchange rate. World Comput. Sci. Inf. Technol. J. (WCSIT) 1 (3) 110–118 (2011)
Pujol, J.C.F., Poli, R.: Evolving the topology and the weights of neural networks using a dual representation. Appl. Intell. 8(1), 73–84 (1998)
Refenes, A.N., Azema-Barac, M., Chen, L., Karoussos, S.: Currency exchange rate prediction and neural network design strategies. Neural Comput. Appl. 1(1), 46–58 (1993)
Rehman, M., Ali, J., Khan, G.M., Mahmud, S.A.: Extracting trends ensembles in solar irradiance for green energy generation using neuro-evolution. In: IFIP International Conference on Artificial Intelligence Applications and Innovations, pp. 456–465. Springer (2014)
Rehman, M., Khan, G.M., Mahmud, S.A.: Foreign currency exchange rates prediction using cgp and recurrent neural network. IERI Procedia 10, 239–244 (2014)
Sadeghi, B.: A bp-neural network predictor model for plastic injection molding process. J. Mater. Process. Technol. 103(3), 411–416 (2000)
Sarangi, P.P., Sahu, A., Panda, M.: A hybrid differential evolution and back-propagation algorithm for feedforward neural network training. Int. J. Comput. Appl. 84(14) (2013)
Singh, D., Singh, S.: A self-selecting neural network for short-term load forecasting. Electr. Power Compon. Syst. 29(2), 117–130 (2001)
Stanley, K.O., Miikkulainen, R.: Efficient reinforcement learning through evolving neural network topologies. In: Proceedings of the 4th Annual Conference on Genetic and Evolutionary Computation, pp. 569–577. Morgan Kaufmann Publishers Inc. (2002)
Wieland, A.P.: Evolving neural network controllers for unstable systems. In: IJCNN-91-Seattle International Joint Conference on Neural Networks, 1991, vol. 2, pp. 667–673. IEEE (1991)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this chapter
Cite this chapter
Khan, G.M., Ahmad, A.M. (2018). Breaking the Stereotypical Dogma of Artificial Neural Networks with Cartesian Genetic Programming. In: Stepney, S., Adamatzky, A. (eds) Inspired by Nature. Emergence, Complexity and Computation, vol 28. Springer, Cham. https://doi.org/10.1007/978-3-319-67997-6_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-67997-6_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-67996-9
Online ISBN: 978-3-319-67997-6
eBook Packages: EngineeringEngineering (R0)