Abstract
The use of artificial neural networks (ANN) in fault detection analysis is widespread. This paper aims to provide an overview on its application in the field of fault identification and diagnosis (FID), as well as the guiding elements behind their successful implementations in engineering-related applications. In most of the reviewed studies, the ANN architecture of choice for FID problem-solving is the multilayer perceptron (MLP). This is likely due to its simplicity, flexibility, and established usage. Its use managed to find footing in a variety of fields in engineering very early on, even before the technology was as polished as it is today. Recurrent neural networks, while having overall stronger potential for solving dynamic problems, are only suggested for use after a simpler implementation in MLP was attempted. Across various ANN applications in FID, it is observed that preprocessing of the inputs is extremely important in obtaining the proper features for use in training the network, particularly when signal analysis is involved. Normalization is practically a standard for ANN use, and likely many other decision-based learning methods due to its ease of use and high impact on speed of convergence. A simple demonstration of ANN’s ease of use in solving a unique FID problem was also shown.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Pandya DH, Upadhyay SH, Harsha SP (2012) ANN based fault diagnosis of rolling element bearing using time-frequency domain feature. Int J Eng Sci Technol 4(6):2878–2886
Zhou J et al (2014) Fault detection and identification spanning multiple processes by integrating PCA with neural network. Appl Soft Comput 14:4–11
Gastaldello D et al (2012) Fault location in underground systems using artificial neural networks and PSCAD/EMTDC. In: IEEE 16th international conference on intelligent engineering systems (INES) 2012. IEEE, Lisbon, pp 423–427
Samanta B, Al-Balushi KR, Al-Araimi SA (2004) Bearing fault detection using artificial neural networks and genetic algorithm. EURASIP J Adv Signal Process 2004(3):785672
Kumar A (2003) Neural network based detection of local textile defects. Pattern Recognit 36(7):1645–1659
Mekki H, Mellit A, Salhi H (2016) Artificial neural network-based modelling and fault detection of partial shaded photovoltaic modules. Simul Model Pract Theory 67(Supplement C):1–13
Hwang BC, Saif M, Jamshidi M (1993) Neural based fault detection and identification for a nuclear reactor. IFAC Proc Vol 26(2, Part 5):547–550
Patton RJ, Frank PM, Clark RN (2013) Issues of fault diagnosis for dynamic systems. Springer, Berlin
Rajakarunakaran S et al (2008) Artificial neural network approach for fault detection in rotary system. Appl Soft Comput 8(1):740–748
Taqvi S et al (2017) Artificial neural network for anomalies detection in distillation column. In: Modeling, design and simulation of systems: 17th Asia simulation conference, AsiaSim 2017, Melaka, Malaysia. Springer, Singapore
López-Mata E et al (2016) Development of a direct-solution algorithm for determining the optimal crop planning of farms using deficit irrigation. Agric Water Manag 171:173–187
Choudhury S, Jain M, Shah S (2008) Stiction-definition, modelling, detection and quantification. J Process Control 18(3–4):232–243
Chen J, Patton RJ (1999) Robust model-based fault diagnosis for dynamic systems. Kluwer, New York, p 354
Schmitz GPJ, Aldrich C, Gouws FS (1999) ANN-DT: an algorithm for extraction of decision trees from artificial neural networks. IEEE Trans Neural Netw 10(6):1392–1401
Muhammad T, Halim Z (2016) Employing artificial neural networks for constructing metadata-based model to automatically select an appropriate data visualization technique. Appl Soft Comput 49(Supplement C):365–384
Zhang G, Eddy Patuwo B, Hu MY (1998) Forecasting with artificial neural networks: the state of the art. Int J Forecast 14(1):35–62
Dougherty M (1995) A review of neural networks applied to transport. Transp Res Part C Emerg Technol 3(4):247–260
Jayas DS, Paliwal J, Visen NS (2000) Review paper (AE—automation and emerging technologies): multi-layer neural networks for image analysis of agricultural products. J Agric Eng Res 77(2):119–128
Catelani M, Gori M (1996) On the application of neural networks to fault diagnosis of electronic analog circuit. Measurement 17(2):73–80
Aminian M, Aminian F (2000) Neural-network based analog-circuit fault diagnosis using wavelet transform as preprocessor. IEEE Trans Circuits Syst II Analog Digit Signal Process 47(2):151
Spina R, Upadhyaya S (1997) Linear circuit fault diagnosis using neuromorphic analyzers. IEEE Trans Circuits Syst II Analog Digit Signal Process 44(3):188–196
Dreiseitl S, Ohno-Machado L (2002) Logistic regression and artificial neural network classification models: a methodology review. J Biomed Inform 35(5):352–359
Patan K (2008) Artificial neural networks for the modelling and fault diagnosis of technical processes. Springer, Berlin
Hussain M (1999) Review of the applications of neural networks in chemical process control—simulation and online implementation. Artif Intell Eng 13(1):55–68
Bhat NV et al (1990) Modeling chemical process systems via neural computation. IEEE Control Syst Mag 10(3):24–30
Miller WT, Werbos PJ, Sutton RS (1995) Neural networks for control. MIT Press, Cambridge
Antsaklis PJ (1990) Neural networks for control systems. IEEE Trans Neural Netw 1(2):242–244
Koivo HN (1994) Artificial neural networks in fault diagnosis and control. Control Eng Pract 2(1):89–101
Narendra KS, Parthasarathy K (1990) Identification and control of dynamical systems using neural networks. IEEE Trans Neural Netw 1(1):4–27
Nelles O (2013) Nonlinear system identification: from classical approaches to neural networks and fuzzy models. Springer, Berlin
Rutkowski L, Rutkowski L (2004) New soft computing techniques for system modeling, pattern classification and image processing. Springer, Berlin
Zhang J, Man K (1998) Time series prediction using RNN in multi-dimension embedding phase space. In: 1998 IEEE international conference on systems, man, and cybernetics. IEEE
Haykin S (1994) Neural networks: a comprehensive foundation. Prentice Hall PTR, Upper Saddle River
Janczak A (2004) Identification of nonlinear systems using neural networks and polynomial models: a block-oriented approach, vol 310. Springer, Berlin
Patan K, Parisini T (2005) Identification of neural dynamic models for fault detection and isolation: the case of a real sugar evaporation process. J Process Control 15(1):67–79
Frank PM, Köppen-Seliger B (1997) New developments using AI in fault diagnosis. Eng Appl Artif Intell 10(1):3–14
Calado J et al (2001) Soft computing approaches to fault diagnosis for dynamic systems. Eur J Control 7(2–3):248–286
Korbicz J et al (2012) Fault diagnosis: models, artificial intelligence, applications. Springer, Berlin
Zhang J, Roberts PD (1992) On-line process fault diagnosis using neural network techniques. Trans Inst Meas Control 14(4):179–188
Svozil D, Kvasnicka V, Pospichal J (1997) Introduction to multi-layer feed-forward neural networks. Chemometr Intell Lab Syst 39(1):43–62
Stinchcombe M, White H (1989) Universal approximation using feedforward networks with non-sigmoid hidden layer activation functions. In: International 1989 joint conference on neural networks, Washington DC, USA, vol 1, pp 613–617
Nawi NM, Atomi WH, Rehman MZ (2013) The effect of data pre-processing on optimized training of artificial neural networks. Procedia Technol 11(Supplement C):32–39
Al-Naser M, Elshafei M, Al-sarkhi A (2016) Artificial neural network application for multiphase flow patterns detection: a new approach. J Petrol Sci Eng 145:548–564
Gertler J (1998) Fault detection and diagnosis in engineering systems. Marcel Dekker, New York
Isermann R, Ballé P (1997) Trends in the application of model-based fault detection and diagnosis of technical processes. Control Eng Pract 5(5):709–719
Venkatasubramanian V, Rengaswamy R, Kavuri SN (2003) A review of process fault detection and diagnosis: part II: qualitative models and search strategies. Comput Chem Eng 27(3):313–326
Venkatasubramanian V et al (2003) A review of process fault detection and diagnosis: part III: process history based methods. Comput Chem Eng 27(3):327–346
Venkatasubramanian V (2003) A review of process fault detection and diagnosis: part I: quantitative model-based methods. Comput Chem Eng 27(3):293–311
Basheer IA, Hajmeer M (2000) Artificial neural networks: fundamentals, computing, design, and application. J Microbiol Methods 43(1):3–31
Śmieja FJ (1993) Neural network constructive algorithms: trading generalization for learning efficiency? Circuits Syst Signal Process 12(2):331–374
Westreich D, Lessler J, Funk MJ (2010) Propensity score estimation: neural networks, support vector machines, decision trees (CART), and meta-classifiers as alternatives to logistic regression. J Clin Epidemiol 63(8):826–833
Santín D, Delgado FJ, Valiño A (2004) The measurement of technical efficiency: a neural network approach. Appl Econ 36(6):627–635
Gurney K (1997) An introduction to neural networks. UCL Press, London
Demuth HB, Beale MH (2000) Neural network toolbox; for use with MATLAB; computation, visualization, programming; user's guide, version 4. Math Works
Reed RD, Marks RJ (1998) Neural smithing: supervised learning in feedforward artificial neural networks. MIT Press, Cambridge, p 346
Setiono R (1997) Extracting rules from neural networks by pruning and hidden-unit splitting. Neural Comput 9(1):205–225
Garson G (1991) Interpreting neural-network connections. AI Expert 6:46–51
Haykin SS, Haykin SS (2009) Neural networks and learning machines, 3rd edn. Prentice Hall, New York
Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. Trans Neural Netw 5(2):157–166
Hagan M, Demuth H, Beale M, Jesús O (2014) Neural network design. University of Colorado, Boulder
Chen L (2009) Curse of dimensionality. In: Liu L, ÖZsu MT (eds) Encyclopedia of database systems. Springer, Boston, pp 545–546
Smith LI (2002) A tutorial on Principal Components Analysis. Computer Science Technical Report No. OUCS-2002-12. http://hdl.handle.net/10523/7534. Accessed 2 Feb 2018
Merry RJE (2005) Wavelet theory and applications: a literature study, p 41. https://pure.tue.nl/ws/files/4376957/612762.pdf. Accessed 20 Dec 2017
Dolley Shukla JS (2013) Wavelets: basic concepts. Int J Electr Electron Eng Telecommun 4:33
Mallat SG (1989) A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans Pattern Anal Mach Intell 11(7):674–693
Sharma R et al (2004) Neural network applications for detecting process faults in packed towers. Chem Eng Process 43(7):841–847
Paya BA, Esat II, Badi MNM (1997) Artificial neural network based fault diagnostics of rotating machinery using wavelet transforms as a preprocessor. Mech Syst Signal Process 11(5):751–765
Banjanovic-Mehmedovic L et al (2017) Neural network based data-driven modelling of anomaly detection in thermal power plant. Automatika 58:69–79
Misra M et al (2002) Multivariate process monitoring and fault diagnosis by multi-scale PCA. Comput Chem Eng 26(9):1281–1293
Feng Z, Xu T (2011) Comparison of SOM and PCA-SOM in fault diagnosis of ground-testing bed. Procedia Eng 15(Supplement C):1271–1276
Ziani R et al (2012) Bearing fault diagnosis using neural network and genetic algorithms with the trace criterion. In: Fakhfakh T et al (eds) Condition monitoring of machinery in non-stationary operations: proceedings of the second international conference “condition monitoring of machinery in non-stationary operations” CMMNO’2012. Springer, Berlin, pp 89–96
Behbahani RM, Jazayeri-Rad H, Hajmirzaee S (2009) Fault detection and diagnosis in a sour gas absorption column using neural networks. Chem Eng Technol 32(5):840–845
Manssouri I, Chetouani Y, Kihel BE (2008) Using neural networks for fault detection in a distillation column. Int J Comput Appl Technol 32(3):181–186
Jamil M, Sharma SK, Singh R (2015) Fault detection and classification in electrical power transmission system using artificial neural network. SpringerPlus 4(1):334
Abbasi Nozari H et al (2012) Model-based robust fault detection and isolation of an industrial gas turbine prototype using soft computing techniques. Neurocomputing 91:29–47
Taqvi SA, Tufa LD, Zabiri H et al (2018) Fault detection in distillation column using NARX neural network. Neural Comput Applic. https://doi.org/10.1007/s00521-018-3658-z
Kiakojoori S, Khorasani K (2016) Dynamic neural networks for gas turbine engine degradation prediction, health monitoring and prognosis. Neural Comput Appl 27(8):2157–2192
Tidriri K et al (2016) Bridging data-driven and model-based approaches for process fault diagnosis and health monitoring: a review of researches and future challenges. Annu Rev Control 42:63–81
LeCun Y et al (1998) Efficient BackProp. In: Orr GB, Müller K-R (eds) Neural networks: tricks of the trade. Springer, Berlin, pp 9–50
Starr KD, Petersen H, Bauer M (2016) Control loop performance monitoring—ABB’s experience over two decades. IFAC-PapersOnLine 49(7):526–532
Kline DM, Berardi VL (2005) Revisiting squared-error and cross-entropy functions for training neural network classifiers. Neural Comput Appl 14(4):310–318
Shoukat Choudhury MAA, Thornhill NF, Shah SL (2005) Modelling valve stiction. Control Eng Pract 13(5):641–658
Choudhury MAAS, Kariwala V, Shah SL, Douke H, Takada H, Thornhill NF (2005) A simple test to confirm control valve stiction. IFAC Proc 38(1):81–86. https://doi.org/10.3182/20050703-6-CZ-1902.01589
Jelali M, Huang B (2010) Detection and diagnosis of stiction in control loops: state of the art and advanced methods. Springer, London
Farenzena M, Trierweiler JO (2009) A novel technique to estimate valve stiction based on pattern recognition. In: de Brito Alves RM, do Nascimento CAO, Biscaia EC (eds) Computer aided chemical engineering. Elsevier, Amsterdam, pp 1191–1196
Venceslau AR, Guedes LA, Silva DR (2012) Artificial neural network approach for detection and diagnosis of valve stiction. In: 2012 IEEE 17th conference on emerging technologies and factory automation (ETFA). IEEE
Bacci di Capaci R, Scali C (2018) Review and comparison of techniques of analysis of valve stiction: from modeling to smart diagnosis. Chem Eng Res Des 130:230–265
Acknowledgements
The authors would like to thank MOSTI Grant Science Fund 0153AB-B67 for the funding provided for this work. The authors would also like to thank Universiti Teknologi PETRONAS (UTP) for the support provided for this research.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Mohd Amiruddin, A.A.A., Zabiri, H., Taqvi, S.A.A. et al. Neural network applications in fault diagnosis and detection: an overview of implementations in engineering-related systems. Neural Comput & Applic 32, 447–472 (2020). https://doi.org/10.1007/s00521-018-3911-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-018-3911-5