[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Domain adaptation network base on contrastive learning for bearings fault diagnosis under variable working conditions

Published: 01 February 2023 Publication History

Abstract

Unsupervised domain adaptation (UDA)-based methods have made great progress in bearing fault diagnosis under variable working conditions. However, most existing UDA-based methods focus only on minimizing the discrepancy of two working conditions. The similarity of fault features extracted from the bearing vibration signal is ignored. The samples near the distribution boundaries learned by the network might be misclassified. As a result, even if the marginal distributions is aligned well, the diagnosis result may not be satisfactorily. Therefore, this paper proposes a domain adaptation network base on contrastive learning (DACL) to achieve the aim of bearing fault diagnosis cross different working conditions and reduce the probability of samples being classified near or on the boundary of each class to improve diagnosis accuracy. The method is made up of a feature mining module and an adversarial domain adaptation module. In the feature mining module, a one-dimensional Convolutional Neural Network (1-D CNN) is utilized to extract features from raw vibration signals. The adversarial domain adaptation module followed is designed to learn domain-shared discriminant features for aligning marginal distribution. Meanwhile, the contrastive estimation term is designed to quantize the similarity of data distribution and increase the distance between samples of different health conditions, declining the probability of samples near the boundary and improving diagnosis performance. At last, an adaptive factor is introduced to measure the relative importance of transferring and discriminating abilities of the method. The effectiveness of the proposed method is confirmed by examining various fault diagnosis scenarios with domain discrepancies across the source and target domains, using experimental data from two bearing systems.

Highlights

An adversarial domain adaptation network base on contrastive learning is proposed.
Designing a contrastive estimation term to reduce the misclassification rate.
The importance of transferring and discriminating abilities are dynamically measured.
Providing a solution for bearing fault diagnosis under variable working conditions.

References

[1]
An Y., Zhang K., Liu Q., Chai Y., Huang X., Rolling bearing fault diagnosis method base on periodic sparse attention and LSTM, IEEE Sensors Journal 22 (12) (2022) 12044–12053,.
[2]
Chen T., Kornblith S., Norouzi M., Hinton G.E., A simple framework for contrastive learning of visual representations, 2020, CoRR, abs/2002.05709. arXiv:2002.05709.
[3]
Cui M., Wang Y., Lin X., Zhong M., Fault diagnosis of rolling bearings based on an improved stack autoencoder and support vector machine, IEEE Sensors Journal 21 (4) (2021) 4927–4937,.
[4]
Du Y., Zhang R., Zhang X., Yao Y., yang Lu H., Wang C., Learning transferable and discriminative features for unsupervised domain adaptation, Intelligent Data Analysis 26 (2022) 407–425.
[5]
Ganin Y., Ustinova E., Ajakan H., Germain P., Larochelle H., Laviolette F., Marchand M., Lempitsky V., Domain-adversarial training of neural networks, Journal of Machine Learning Research 17 (1) (2016) 2096–2030.
[6]
Guo L., Lei Y., Xing S., Yan T., Li N., Deep convolutional transfer learning network: A new method for intelligent fault diagnosis of machines with unlabeled data, IEEE Transactions on Industrial Electronics 66 (9) (2019) 7316–7325,.
[7]
Guo S., Zhang B., Yang T., Lyu D., Gao W., Multitask convolutional neural network with information fusion for bearing fault diagnosis and localization, IEEE Transactions on Industrial Electronics 67 (9) (2020) 8005–8015,.
[8]
Guo Y., Zhao X., Shangguan W.-B., Li W., Lü H., Zhang C., Fault characteristic frequency analysis of elliptically shaped bearing, Measurement 155 (2020),.
[9]
Hadsell R., Chopra S., LeCun Y., Dimensionality reduction by learning an invariant mapping, in: 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR’06), Vol. 2, 2006, pp. 1735–1742,.
[10]
Han Y., Ding N., Geng Z., Wang Z., Chu C., An optimized long short-term memory network based fault diagnosis model for chemical processes, Journal of Process Control 92 (4) (2020) 161–168,.
[11]
Jiao J., Lin J., Zhao M., Liang K., Double-level adversarial domain adaptation network for intelligent fault diagnosis, Knowledge-Based Systems 205 (2020),.
[12]
Jiao J., Zhao M., Lin J., Ding C., Classifier inconsistency-based domain adaptation network for partial transfer intelligent diagnosis, IEEE Transactions on Industrial Informatics 16 (9) (2020) 5965–5974,.
[13]
Jiao J., Zhao M., Lin J., Liang K., A comprehensive review on convolutional neural network in machine fault diagnosis, Neurocomputing 417 (2020) 36–63,.
[14]
Kunli M., Yunxin W., Fault diagnosis of rolling element bearing based on vibration frequency analysis, in: 2011 third international conference on measuring technology and mechatronics automation, Vol. 2, 2011, pp. 198–201,.
[15]
Lee K.B., Cheon S., Kim C.O., A convolutional neural network for fault classification and diagnosis in semiconductor manufacturing processes, IEEE Transactions on Semiconductor Manufacturing 30 (2) (2017) 135–142,.
[16]
Lei Z., Wen G., Dong S., Huang X., Zhou H., Zhang Z., Chen X., An intelligent fault diagnosis method based on domain adaptation and its application for bearings under polytropic working conditions, IEEE Transactions on Instrumentation and Measurement 70 (2021) 1–14,.
[17]
Li X., Zhang W., Deep learning-based partial domain adaptation method on intelligent machinery fault diagnostics, IEEE Transactions on Industrial Electronics 68 (5) (2021) 4351–4361,.
[18]
Li T., Zhao Z., Sun C., Yan R., Chen X., Domain adversarial graph convolutional network for fault diagnosis under variable working conditions, IEEE Transactions on Instrumentation and Measurement 70 (2021) 1–10,.
[19]
Liu Z.-H., Jiang L.-B., Wei H.-L., Chen L., Li X.-H., Optimal transport-based deep domain adaptation approach for fault diagnosis of rotating machine, IEEE Transactions on Instrumentation and Measurement 70 (2021) 1–12,.
[20]
Liu Z.-H., Lu B.-L., Wei H.-L., Chen L., Li X.-H., Rätsch M., Deep adversarial domain adaptation model for bearing fault diagnosis, IEEE Transactions on Systems, Man, and Cybernetics: Systems 51 (7) (2021) 4217–4226,.
[21]
Liu Z.-H., Lu B.-L., Wei H.-L., Chen L., Li X.-H., Wang C.-T., A stacked auto-encoder based partial adversarial domain adaptation model for intelligent fault diagnosis of rotating machines, IEEE Transactions on Industrial Informatics 17 (10) (2021) 6798–6809,.
[22]
Long M., Cao Y., Cao Z., Wang J., Jordan M.I., Transferable representation learning with deep adaptation networks, IEEE Transactions on Pattern Analysis and Machine Intelligence 41 (12) (2019) 3071–3085,.
[23]
Long M., Zhu H., Wang J., Jordan M.I., Deep transfer learning with joint adaptation networks, in: ICML, 2017.
[24]
Lu W., Liang B., Cheng Y., Meng D., Yang J., Zhang T., Deep model based domain adaptation for fault diagnosis, IEEE Transactions on Industrial Electronics 64 (3) (2017) 2296–2305,.
[25]
Qian W., Li S., Yi P., Zhang K., A novel transfer learning method for robust fault diagnosis of rotating machines under variable working conditions, Measurement 138 (2019) 514–525,.
[26]
Sejdinovic D., Sriperumbudur B., Gretton A., Fukumizu K., Equivalence of distance-based and RKHS-based statistics in hypothesis testing, The Annals of Statistics 41 (5) (2013),.
[27]
Shao H., Xia M., Han G., Zhang Y., Wan J., Intelligent fault diagnosis of rotor-bearing system under varying working conditions with modified transfer convolutional neural network and thermal images, IEEE Transactions on Industrial Informatics 17 (5) (2021) 3488–3496,.
[28]
Sun B., Feng J., Saenko K., Correlation alignment for unsupervised domain adaptation, 2017, ArXiv, abs/1612.01939.
[29]
Sun C., Ma M., Zhao Z., Chen X., Sparse deep stacking network for fault diagnosis of motor, IEEE Transactions on Industrial Informatics 14 (7) (2018) 3261–3270,.
[30]
Sun W., Paiva A.R., Xu P., Sundaram A., Braatz R.D., Fault detection and identification using Bayesian recurrent neural networks, Computers and Chemical Engineering 141 (2020),.
[31]
Sun W., Shao S., Zhao R., Yan R., Zhang X., Chen X., A sparse auto-encoder-based deep neural network approach for induction motor faults classification, Measurement 89 (2016) 171–178,.
[32]
Wang, J., Feng, W., Chen, Y., Yu, H., Huang, M., & Yu, P. S. (2018). Visual domain adaptation with manifold embedded distribution alignment. In Proceedings of the 26th ACM international conference on multimedia.
[33]
Wen L., Gao L., Li X., A new deep transfer learning based on sparse auto-encoder for fault diagnosis, IEEE Transactions on Systems, Man, and Cybernetics: Systems 49 (1) (2019) 136–144,.
[34]
Xiang S., Qin Y., Zhu C., Wang Y., Chen H., Long short-term memory neural network with weight amplification and its application into gear remaining useful life prediction, Engineering Applications of Artificial Intelligence 91 (4) (2020) 103587,.
[35]
Xie J., Zhang L., Duan L., Wang J., On cross-domain feature fusion in gearbox fault diagnosis under various operating conditions based on transfer component analysis, in: 2016 IEEE international conference on prognostics and health management, ICPHM, 2016, pp. 1–6,.
[36]
Yang B., Lei Y., Jia F., Xing S., An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings, Mechanical Systems and Signal Processing 122 (2019) 692–706,.
[37]
Yang J., Xie G., Yang Y., Zhang Y., Liu W., Deep model integrated with data correlation analysis for multiple intermittent faults diagnosis, ISA Transactions 95 (2019) 306–319,.
[38]
Yu J., Zhou X., One-dimensional residual convolutional autoencoder based feature learning for gearbox fault diagnosis, IEEE Transactions on Industrial Informatics 16 (10) (2020) 6347–6358,.
[39]
Zhang W., Li X., Ma H., Luo Z., Li X., Federated learning for machinery fault diagnosis with dynamic validation and self-supervision, Knowledge-Based Systems 213 (2021),.
[40]
Zhang W., Li X., Ma H., Luo Z., Li X., Open-set domain adaptation in machinery fault diagnostics using instance-level weighted adversarial learning, IEEE Transactions on Industrial Informatics 17 (11) (2021) 7445–7455,.
[41]
Zhang R., Tao H., Wu L., Guan Y., Transfer learning with neural networks for bearing fault diagnosis in changing working conditions, IEEE Access 5 (2017) 14347–14357,.
[42]
Zhang Z., Zhao Z., Li X., Zhang X., Wang S., Yan R., Chen X., Faster multiscale dictionary learning method with adaptive parameter estimation for fault diagnosis of traction motor bearings, IEEE Transactions on Instrumentation and Measurement 70 (2021) 1–13,.
[43]
Zhou D., Zhao Y., Wang Z., He X., Gao M., Review on diagnosis techniques for intermittent faults in dynamic systems, IEEE Transactions on Industrial Electronics 67 (3) (2020) 2337–2347,.

Cited By

View all
  • (2024)DACAExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124944256:COnline publication date: 5-Dec-2024
  • (2024)Revolution and peak discrepancy-based domain alignment method for bearing fault diagnosis under very low-speed conditionsExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124084251:COnline publication date: 24-Jul-2024
  • (2024)Cloud-edge collaborative transfer fault diagnosis of rotating machinery via federated fine-tuning and target self-adaptationExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123859250:COnline publication date: 18-Jul-2024
  • Show More Cited By

Index Terms

  1. Domain adaptation network base on contrastive learning for bearings fault diagnosis under variable working conditions
            Index terms have been assigned to the content through auto-classification.

            Recommendations

            Comments

            Please enable JavaScript to view thecomments powered by Disqus.

            Information & Contributors

            Information

            Published In

            cover image Expert Systems with Applications: An International Journal
            Expert Systems with Applications: An International Journal  Volume 212, Issue C
            Feb 2023
            1623 pages

            Publisher

            Pergamon Press, Inc.

            United States

            Publication History

            Published: 01 February 2023

            Author Tags

            1. Domain adaptation
            2. Contrastive learning
            3. Rolling bearing
            4. Variable working condition
            5. Fault diagnosis

            Qualifiers

            • Research-article

            Contributors

            Other Metrics

            Bibliometrics & Citations

            Bibliometrics

            Article Metrics

            • Downloads (Last 12 months)0
            • Downloads (Last 6 weeks)0
            Reflects downloads up to 04 Jan 2025

            Other Metrics

            Citations

            Cited By

            View all
            • (2024)DACAExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124944256:COnline publication date: 5-Dec-2024
            • (2024)Revolution and peak discrepancy-based domain alignment method for bearing fault diagnosis under very low-speed conditionsExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124084251:COnline publication date: 24-Jul-2024
            • (2024)Cloud-edge collaborative transfer fault diagnosis of rotating machinery via federated fine-tuning and target self-adaptationExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123859250:COnline publication date: 18-Jul-2024
            • (2024)An auto-regulated universal domain adaptation network for uncertain diagnostic scenarios of rotating machineryExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123836249:PCOnline publication date: 17-Jul-2024
            • (2024)A synchronization-induced cross-modal contrastive learning strategy for fault diagnosis of electromechanical systems under semi-supervised learning with current signalExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123801249:PCOnline publication date: 17-Jul-2024
            • (2024)Attention-based ConvNeXt with a parallel multiscale dilated convolution residual module for fault diagnosis of rotating machineryExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123764249:PCOnline publication date: 17-Jul-2024
            • (2024)Deep semi-supervised transfer learning method on few source data with sensitivity-aware decision boundary adaptation for intelligent fault diagnosisExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123714249:PCOnline publication date: 17-Jul-2024
            • (2024)Domain adaptation with label-aligned sampling (DALAS) for cross-domain fault diagnosis of rotating machinery under class imbalanceExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.122910243:COnline publication date: 25-Jun-2024
            • (2024)Causal explaining guided domain generalization for rotating machinery intelligent fault diagnosisExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.122806243:COnline publication date: 25-Jun-2024
            • (2024)Novel dual-network autoencoder based adversarial domain adaptation with Wasserstein divergence for fault diagnosis of unlabeled dataExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.122393238:PFOnline publication date: 15-Mar-2024
            • Show More Cited By

            View Options

            View options

            Media

            Figures

            Other

            Tables

            Share

            Share

            Share this Publication link

            Share on social media