[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Domain-invariant feature fusion networks for semi-supervised generalization fault diagnosis

Published: 01 November 2023 Publication History

Abstract

Machinery fault diagnosis based on deep learning methods is cost-effective to guarantee safety and reliability of mechanical systems. Due to the variability of machinery working condition and difficulty of data obtaining under different health states, it is desirable to enhance the generalization capability to unseen working conditions for the fault diagnosis models trained by available data sets under limited number of working conditions. Considering that labeling industrial data is also a laborious work, this paper proposes a novel semi-supervised domain generalization model, termed domain-invariant feature fusion networks (DIFFN) for intelligent fault diagnosis under unseen target working conditions. The main contributions are that, intra-domain-invariant features are considered to capture the intrinsic semantic information within the domain and are fused with inter-domain-invariant features to enhance the discrimination and generalization abilities in fault diagnosis. First, a domain-invariant representation learning method is established to learn the inter- and intra-domain-invariant features using two network branches and fuse them via a fusion module. Second, a mutual learning strategy is designed to enable the network branches and the fusion module to learn from each other, thereby improving the discrimination of the extracted features for accurate fault diagnosis. Lastly, a feature divergence maximization strategy is embedded between the two network branches to improve the generalization ability of the fault diagnosis model. Experiments on two bearing data sets demonstrate that the proposed model has better diagnostic accuracy and stability over state-of-the-art semi-supervised domain generalization methods, indicating its great potential for application in generalization fault diagnosis of machinery under unseen target working conditions.

Highlights

DIFFN is proposed to realize semi-supervised generalization fault diagnosis.
Inter- and intra-domain-invariant features are sufficiently exploited.
A mutual learning strategy is designed to promote the discrimination of features.
Feature divergence maximization strategy enhances the feature diversification.
Bearing generalization diagnosis experiments validate the superiority of DIFFN.

References

[1]
Z. An, S. Li, J. Wang, X. Jiang, A novel bearing intelligent fault diagnosis framework under time-varying working conditions using recurrent neural network, ISA Trans. 100 (2020) 155–170.
[2]
M. Bui, T. Tran, A. Tran, D. Phung, Exploiting domain-specific features to enhance domain generalization, in: Proceedings of the Conference on Neural Information Processing Systems, 2021, pp. 21189–21201.
[3]
Y. Chen, X. Liang, M.J. Zuo, Sparse time series modeling of the baseline vibration from a gearbox under time-varying speed condition, Mech. Syst. Signal Process. 134 (2019).
[4]
Y. Chen, M. Rao, K. Feng, M.J. Zuo, Physics-informed LSTM hyperparameters selection for gearbox fault detection, Mech. Syst. Signal Process. 171 (2022).
[5]
L. Chen, Q. Li, C. Shen, J. Zhu, D. Wang, M. Xia, Adversarial domain-invariant generalization: a generic domain-regressive framework for bearing fault diagnosis under unseen conditions, IEEE Trans. Ind. Inf. 18 (2021) 1790–1800.
[6]
J. Dai, J. Wang, W. Huang, J. Shi, Z. Zhu, Machinery health monitoring based on unsupervised feature learning via generative adversarial networks, IEEE ASME Trans. Mechatron. 25 (2020) 2252–2263.
[7]
Y. Ding, M. Jia, Y. Cao, P. Ding, X. Zhao, C. Lee, Domain generalization via adversarial out-domain augmentation for remaining useful life prediction of bearings under unseen conditions, Knowl.-Based Syst. 261 (2022).
[8]
N. Ding, H. Li, Q. Xin, B. Wu, D. Jiang, Multi-source domain generalization for degradation monitoring of journal bearings under unseen conditions, Reliab. Eng. Syst. Saf. 230 (2023).
[9]
Y. Ding, L. Wang, B. Liang, S. Liang, Y. Wang, F. Chen, Domain generalization by learning and removing domain-specific features, in: Proceedings of the Conference on Neural Information Processing Systems, 2022, pp. 24226–24239.
[10]
K. Feng, Q. Ni, M. Beer, H. Du, C. Li, A novel similarity-based status characterization methodology for gear surface wear propagation monitoring, Tribol. Int. 174 (2022).
[11]
K. Feng, J.C. Ji, Q. Ni, A novel gear fatigue monitoring indicator and its application to remaining useful life prediction for spur gear in intelligent manufacturing systems, Int. J. Fatig. 168 (2023).
[12]
Y. Feng, J. Chen, Z. Yang, X. Song, Y. Chang, S. He, E. Xu, Z. Zhou, Similarity-based meta-learning network with adversarial domain adaptation for cross-domain fault identification, Knowl.-Based Syst. 217 (2021).
[13]
Y. Ganin, E. Ustinova, H. Ajakan, P. Germain, H. Larochelle, F. Laviolette, M. Marchand, V. Lempitsky, Domain-adversarial training of neural networks, J. Mach. Learn. Res. 17 (2016) 2030–2096.
[14]
S. Gawde, S. Patil, S. Kumar, P. Kamat, K. Kotecha, A. Abraham, Multi-fault diagnosis of industrial rotating machines using data-driven approach: a review of two decades of research, Eng. Appl. Artif. Intell. 123 (2023).
[15]
H.A. Ghani, M.R.A. Malek, M.F.K. Azmi, M.J. Muril, A. Azizan, A review on sparse fast Fourier transform applications in image processing, Int. J. Electr. Comput. Eng. 10 (2020) 1346–1351.
[16]
I. Goodfellow, J. Pouget-Abadie, M. Mirza, X. Bing, D. Warde-Farley, S. Ozair, A. Courville, Y. Bengio, Generative adversarial nets, in: Proceedings of the Conference on Neural Information Processing Systems, 2014, pp. 2672–2680.
[17]
T. Han, Y. Li, M. Qian, A hybrid generalization network for intelligent fault diagnosis of rotating machinery under unseen working conditions, IEEE Trans. Instrum. Meas. 70 (2021).
[18]
D. Hoang, H. Kang, A survey on deep learning based bearing fault diagnosis, Neurocomputing 335 (2019) 327–335.
[19]
C. Hu, Y. Wang, J. Gu, Cross-domain intelligent fault classification of bearings based on tensor-aligned invariant subspace learning and two-dimensional convolutional neural networks, Knowl.-Based Syst. 209 (2020).
[20]
M. Ji, G. Peng, S. Li, F. Cheng, Z. Chen, Z. Li, H. Du, A neural network compression method based on knowledge-distillation and parameter quantization for the bearing fault diagnosis, Appl. Soft Comput. 127 (2022).
[21]
S. Jia, Y. Li, X. Wang, D. Sun, Z. Deng, Deep causal factorization network: a novel domain generalization method for cross-machine bearing fault diagnosis, Mech. Syst. Signal Process. 192 (2023).
[22]
J. Jiao, M. Zhao, J. Lin, Unsupervised adversarial adaptation network for intelligent fault diagnosis, IEEE Trans. Ind. Electron. 67 (2019) 9904–9913.
[23]
J. Kim, M. Hyun, I. Chung, N. Kwak, Feature fusion for online mutual knowledge distillation, in: Proceedings of the 25th International Conference on Pattern Recognition, 2021, pp. 4619–4625.
[24]
C. Lessmeier, J.K. Kimotho, D. Zimmer, W. Sextro, Condition monitoring of bearing damage in electromechanical drive systems by using motor current signals of electric motors: a benchmark data set for data-driven classification, in: Proceedings of PHM Society European Conference, 2016, 3, no. 1.
[25]
X. Li, W. Zhang, H. Ma, Z. Luo, X. Li, Domain generalization in rotating machinery fault diagnostics using deep neural networks, Neurocomputing 403 (2020) 409–420.
[26]
J. Li, C. Shen, L. Kong, D. Wang, M. Xia, Z. Zhu, A new adversarial domain generalization network based on class boundary feature detection for bearing fault diagnosis, IEEE Trans. Instrum. Meas. 71 (2022).
[27]
Y. Liao, R. Huang, J. Li, Z. Chen, W. Li, Deep semisupervised domain generalization network for rotary machinery fault diagnosis under variable speed, IEEE Trans. Instrum. Meas. 69 (2020) 8064–8075.
[28]
X. Liu, S. Liu, J. Xiang, R. Sun, Y. Wei, An ensemble and shared selective adversarial network for partial domain fault diagnosis of machinery, Eng. Appl. Artif. Intell. 113 (2022).
[29]
Z. Liu, L. Jiang, H. Wei, L. Chen, X. Li, Optimal transport-based deep domain adaptation approach for fault diagnosis of rotating machine, IEEE Trans. Instrum. Meas. 70 (2021).
[30]
W. Lu, J. Wang, H. Li, Y. Chen, X. Xie, Domain-invariant Feature Exploration for Domain Generalization, 2022,. arXiv:2207.12020.
[31]
Y. Qin, C. Li, F. Cao, H. Chen, A fault dynamic model of high-speed angular contact ball bearings, Mech. Mach. Theor. 143 (2020).
[32]
M. Ragab, Z. Chen, W. Zhang, E. Eldele, M. Wu, C. Kwoh, X. Li, Conditional contrastive domain generalization for fault diagnosis, IEEE Trans. Instrum. Meas. 71 (2022).
[33]
H. Ren, J. Wang, J. Dai, Z. Zhu, J. Liu, Dynamic balanced domain-adversarial networks for cross-domain fault diagnosis of train bearings, IEEE Trans. Instrum. Meas. 71 (2022).
[34]
S. Schwendemann, Z. Amjad, A. Sikora, Bearing fault diagnosis with intermediate domain based layered maximum mean discrepancy: a new transfer learning approach, Eng. Appl. Artif. Intell. 105 (2021).
[35]
C. Shen, Y. Qi, J. Wang, G. Cai, Z. Zhu, An automatic and robust features learning method for rotating machinery fault diagnosis based on contractive autoencoder, Eng. Appl. Artif. Intell. 76 (2018) 170–184.
[36]
Y. Shi, A. Deng, M. Deng, M. Xu, Y. Liu, X. Ding, W. Bian, Domain augmentation generalization network for real-time fault diagnosis under unseen working conditions, Reliab. Eng. Syst. Saf. 235 (2023).
[37]
Y. Shi, A. Deng, M. Deng, J. Li, M. Xu, S. Zhang, X. Ding, S. Xu, Domain transferability-based deep domain generalization method towards actual Fault Diagnosis scenarios, IEEE Trans. Ind. Inf. 19 (2022) 7355–7366.
[38]
G.L. Suryawanshi, S.K. Patil, R.G. Desavale, Dynamic model to predict vibration characteristics of rolling element bearings with inclined surface fault, Measurement 184 (2021).
[39]
G. Tang, C. Yi, L. Liu, X. Yang, D. Xu, Q. Zhou, J. Lin, A novel transfer learning network with adaptive input length selection and lightweight structure for bearing fault diagnosis, Eng. Appl. Artif. Intell. 123 (2023).
[40]
M. Xia, T. Li, L. Xu, L. Liu, C.W. De Silva, Fault diagnosis for rotating machinery using multiple sensors and convolutional neural networks, IEEE ASME Trans. Mechatron. 23 (2017) 101–110.
[41]
J. Yang, W. Bao, Y. Liu, X. Li, J. Wang, Y. Niu, J. Li, Joint pairwise graph embedded sparse deep belief network for fault diagnosis, Eng. Appl. Artif. Intell. 99 (2021).
[42]
K. Zhao, H. Jiang, K. Wang, Z. Pei, Joint distribution adaptation network with adversarial learning for rolling bearing fault diagnosis, Knowl.-Based Syst. 222 (2021).
[43]
C. Zhao, W. Shen, A domain generalization network combing invariance and specificity towards real-time intelligent fault diagnosis, Mech. Syst. Signal Process. 173 (2022).
[44]
C. Zhao, W. Shen, Adversarial mutual information-guided single domain generalization network for intelligent fault diagnosis, IEEE Trans. Ind. Inf. 19 (2023) 2909–2918.
[45]
H. Zhao, R.T. Des Combes, K. Zhang, G. Gordon, On learning invariant representations for domain adaptation, in: Proceedings of the 36th International Conference on Machine Learning, 2019, pp. 7523–7532.
[46]
Y. Zhang, T. Xiang, T.M. Hospedales, H. Lu, Deep mutual learning, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 4320–4328.
[47]
H. Zheng, R. Wang, Y. Yang, Y. Li, M. Xu, Intelligent fault identification based on multisource domain generalization towards actual diagnosis scenario, IEEE Trans. Ind. Electron. 67 (2019) 1293–1304.

Index Terms

  1. Domain-invariant feature fusion networks for semi-supervised generalization fault diagnosis
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Please enable JavaScript to view thecomments powered by Disqus.

          Information & Contributors

          Information

          Published In

          cover image Engineering Applications of Artificial Intelligence
          Engineering Applications of Artificial Intelligence  Volume 126, Issue PD
          Nov 2023
          1653 pages

          Publisher

          Pergamon Press, Inc.

          United States

          Publication History

          Published: 01 November 2023

          Author Tags

          1. Domain generalization
          2. Fault diagnosis
          3. Domain-invariant feature
          4. Mutual learning
          5. Unseen working conditions

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • 0
            Total Citations
          • 0
            Total Downloads
          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 28 Jan 2025

          Other Metrics

          Citations

          View Options

          View options

          Figures

          Tables

          Media

          Share

          Share

          Share this Publication link

          Share on social media