Abstract
On-line System identification of linear time-varying (LTV) systems whose system parameters change in time has been studied lately. One neural network based such on-line identification method was studied by the author with a generalized ADAptive LINear Element (ADALINE). Since the ADALINE is slow in convergence, which is not suitable for identification of LTV system, two techniques were proposed to speed up convergence of learning. One idea was to introduce a momentum term to the weight adjustment during convergence period. The other technique was to train the generalized ADALINE network with data from a sliding window of the system’s input output data. The second technique took multiple epochs to train which was considered as a shortcoming. In this paper, simulation study towards optimizing the momentum term and learning rate parameter will be presented. Simulation results show that once the momentum factor and learning rate are tuned properly, time varying parameters of LTV systems can be identified quite effectively; which, in turn, sows that the fined tuned GADLINE is quite suitable for online system identification and real time adaptive control applications due to its low computational demand.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Abonyi, J., Szeifert, F.: System Identification Using Delaunay Tessellation of Self-Organizing Maps. In: The 6th International Conference on Neural Networks and Soft Computing, ICNNSC, Poland, Zakopane, pp. 11–15 (2002)
Atencia, M., Sandoval, G.: Gray Box Identification with Hopfield Neural Networks. Revista Investigacion Operacional 25(1), 54–60 (2004)
Bhama, S., Singh, H.: Single Layer Neural Network for Linear System Identification Using Gradient Descent Technique. IEEE Trans. on Neural Networks 4(5), 884–888 (1993)
Chu, S.R., Shoureshi, R., Tenorio, M.: Neural Networks for System Identification. IEEE Control Systems Magazine, 31–34 (1990)
Gretton, A., Doucet, A., Herbrich, R., Rayner, P., Schölkopf, B.: Support Vector Regression for Black-Box System Identification. In: The 11th IEEE Workshop on Statistical Signal Processing (2001)
Haykin, S.: Neural Networks: A Comprehensive Foundation. Prentice-Hall, Englewood Cliffs (1999)
Hopfield, J.: Neural Networks and Physical Systems with Emergent Collective Computational Abilities. Proc. Nat. Acad. Sci. 79, 2554–2558 (1982)
Ljung, L.: System Identification-Theory for the User. Prentice-Hall, Englewood Cliffs (1999)
Mehrotra, K., Mohan, C., Ranka, S.: Elements of Artificial Neural Networks. MIT Press, Cambridge (1997)
Narendra, K.S., Parthasarathy, K.: Identification and Control of Dynamical Systems Using Neural Networks. IEEE Transactions on Neural Networks 1, 1–27 (1990)
Qin, S.Z., Su, H.T., McAvoy, T.J.: Comparison of Four Neural Net Learning Methods for Dynamic System Identification. IEEE Trans. on Neural Networks 2, 52–262 (1992)
Rumelhart, H.D.E., Williams, R.J.: Learning Internal Representations by Error Propagation. In: Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. I. MIT Press, Cambridge (1986)
Sjöberg, J., Hjalmerson, H., Ljung, L.: Neural Networks in System Identification. In: Preprints 10th IFAC symposium on SYSID, Copenhagen, Denmark, vol. 2, pp. 49–71 (1994)
Söderström, T., Stoica, P.: System Identification. Prentice Hall, Englewood Cliffs (1989)
Valverde, R.: Dynamic Systems Identification Using RBF Neural Networks. Universidad Carlos III de Madrid. Technical Report (1999)
Widrow, B., Lehr, M.A.: 30 Years of Adaptive Neural Networks: Perceptron, Madaline, and Backpropagation. Proc. IEEE 78(9), 1415–1442 (1990)
Wenle, Z.: System Identification Based on a Generalized ADALINE Neural Network. In: Proceedings of the 2007 American Control Conference, New York City, pp. 4792–4797 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, W. (2009). On Momentum and Learning Rate of the Generalized ADLINE Neural Network for Time Varying System Identification. In: Yu, W., He, H., Zhang, N. (eds) Advances in Neural Networks – ISNN 2009. ISNN 2009. Lecture Notes in Computer Science, vol 5551. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01507-6_113
Download citation
DOI: https://doi.org/10.1007/978-3-642-01507-6_113
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01506-9
Online ISBN: 978-3-642-01507-6
eBook Packages: Computer ScienceComputer Science (R0)