Abstract
During robot operation, robot components like links and joints may experience collisions or excess loads that can lead to structural damages or cracks. A crack in a structural component can degrade the overall performance of the structure. This study examines the influence of cracks on the vibration characteristics of a baseline robot link. The approach uses the finite element method to simulate the dynamics of planar robot link models with and without artificial cracks with different sizes, locations, and orientations in the ABAQUS software. The robot link models include one intact model and five defective models with cracks. A rectangular crack with a fixed length of 1 mm and a varying width from 0.001 to 0.1 mm is applied to a specific location along the robot link. Finite element analysis and machine learning are used to simulate and characterize the vibration of each robot link with one fixed end and one free end. The vibration responses are measured at the free end. The measured vibration data are then transformed into two-dimensional (2D) image data using the Gramian Angular Summation Field method. A convolutional neural network is then trained with the image data for crack detection and analysis. The results indicate that the proposed method demonstrates 98.25% accuracy on the data generated by the simulation experiments.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
The data presented in this study are available on request from the corresponding author.
References
Qiao G, Weiss BA (2019) Industrial robot accuracy degradation monitoring and quick health assessment. J Manuf Sci Eng 141(7):071006
Boldsaikhan E (2020) Measuring and estimating rotary joint axes of an articulated robot. IEEE Trans Instrum Meas 69(10):8279–8287
Hasan A, Tahavori M, Midtiby HS (2023) Model-based fault diagnosis algorithms for robotic systems. IEEE Access 11:2250–2258
Djordjević V, Stojanović V, Pršić D, Dubonjić L, Morato MM (2022) Observer-based fault estimation in steer-by-wire vehicle. Eng Today 1(1):7–17
Zhuang Z, Tao H, Chen Y, Stojanovic V, Paszke W (2022) An optimal iterative learning control approach for linear systems with nonuniform trial lengths under input constraints. IEEE Transactions on Systems, Man, and Cybernetics: Systems
Biglari H, Golmohammadi M, Hayati S, Hemmati S (2021) Vibration reduction of a flexible robot link using a frictional damper. J Vib Control 27(9–10):985–997
Sarkhel P, Dikshit MK, Pathak VK, Saxena KK, Prakash C, Buddhi D (2023) Robust deflection control and analysis of a fishing rod-type flexible robotic manipulator for collaborative robotics. Robot Auton Syst 159:104293
Xu P, Yao X, Liu S, Wang H, Liu K, Kumar AS, Lu WF, Bi G (2021) Stiffness modeling of an industrial robot with a gravity compensator considering link weights. Mech Mach Theory 161:104331
Frej A, Chiementin X, Fakher C, Bolaers F, Haddar M (2023) Dynamic modeling and vibration analysis for defect identification of single-stage gearboxes in the joints of industrial robots with six DOF. Proc Inst Mech Eng Part C 09544062231152347
Yan Y, Guo Y, Liu X (2023) Tooth root crack detection of planet gear in industrial robot RV reducer. Meas Control 00202940231180619
Shi M, Rong B, Liang J, Zhao W, Pan H (2023) Dynamics analysis and vibration suppression of a spatial rigid-flexible link manipulator based on transfer matrix method of multibody system. Nonlinear Dyn 111(2):1139–1159
Ambaye GA, Lemu HG (2021) Dynamic analysis of spur gear with backlash using ADAMS. Mater Today Proc 38:2959–2967
Kouritem SA, Abouheaf MI, Nahas N, Hassan M (2022) A multi-objective optimization design of industrial robot arms. Alex Eng J 61(12):12847–12867
Hu M, Wang H, Pan X, Liao L, Sun H (2022) Elastic deformation modeling of series robots with consideration of gravity. Intell Serv Robot 15(3):351–362
Seth A, Kuruvilla JK, Sharma S, Duttagupta J, Jaiswal A (2022) Design and simulation of 6-DOF cylindrical robotic manipulator using finite element analysis. Mater Today Proc 62:1521–1525
Ambaye GA, Lemu HG (2021) Effect of backlash on transmission error and time varying mesh stiffness. In: Advanced manufacturing and automation, Springer, vol X 10, pp 18–28
Guo S, He Y, Shi L, Pan S, Tang K, Xiao R, Guo P (2017) Modal and fatigue analysis of critical components of an amphibious spherical robot. Microsyst Technol 23:2233–2247
Phanden RK, Sharma P, Dubey A (2021) A review on simulation in digital twin for aerospace, manufacturing and robotics. Mater Today Proc 38:174–178
Sha G, Radzieński M, Cao M, Ostachowicz W (2019) A novel method for single and multiple damage detection in beams using relative natural frequency changes. Mech Syst Signal Process 132:335–352
Altunışık AC, Okur FY, Karaca S, Kahya V (2019) Vibration-based damage detection in beam structures with multiple cracks: modal curvature vs modal flexibility methods. Nondestruct Test Eval 34(1):33–53
Song M, Gong Y, Yang J, Zhu W, Kitipornchai S (2020) Nonlinear free vibration of cracked functionally graded graphene platelet-reinforced nanocomposite beams in thermal environments. J Sound Vib 468:115115
Sahu S, Das P (2020) Experimental and numerical studies on vibration of laminated composite beam with transverse multiple cracks. Mech Syst Signal Process 135:106398
Wei C, Shang X (2019) Analysis on nonlinear vibration of breathing cracked beam. J Sound Vib 461:114901
Long H, Liu Y, Liu K (2019) Nonlinear vibration analysis of a beam with a breathing crack. Appl Sci 9(18):3874
Tam M, Yang Z, Zhao S, Yang J (2019) Vibration and buckling characteristics of functionally graded graphene nanoplatelets reinforced composite beams with open edge cracks. DMaterials 12(9):1412
Chinka SSB, Putti SR, Adavi BK (2021) Modal testing and evaluation of cracks on cantilever beam using mode shape curvatures and natural frequencies. In: Structures, Elsevier, vol 32, pp 1386–1397
Taima MS, El-Sayed TA, Shehab MB, Farghaly SH, Hand RJ (2022) Vibration analysis of cracked beam based on Reddy beam theory by finite element method. J Vib Control 10775463221122122
Zhao K, Liu Y, Du J (2023) Vibration characteristics and power flow analysis of a constant cracked beam with general boundary conditions. Int J Appl Mech
Teyi N, Singh S (2022) A review of application of data science tools in crack identification and localization. Procedia Struct Integr 39:608–623
Zeng J, Chen K, Ma H, Duan T, Wen B (2019) Vibration response analysis of a cracked rotating compressor blade during run-up process. Mech Syst Signal Process 118:568–583
Mian T, Choudhary A, Fatima S (2023) Multi-sensor fault diagnosis for misalignment and unbalance detection using machine learning. IEEE Transactions on Industry Applications
Mian T, Choudhary A, Fatima S (2023) Vibration and infrared thermography based multiple fault diagnosis of bearing using deep learning. Nondestruct Test Eval 38(2):275–296
Tao H, Qiu J, Chen Y, Stojanovic V, Cheng L (2023) Unsupervised cross-domain rolling bearing fault diagnosis based on time-frequency information fusion. J Frankl Inst 360(2):1454–1477
Bukovsky I (2021) Deterministic behavior of temperature field in turboprop engine via shallow neural networks. Neural Comput Appl 33(19):13145–13161
Asteris PG, Mokos VG (2020) Concrete compressive strength using artificial neural networks. Neural Comput Appl 32(15):11807–11826
Kalaiselvi T, Padmapriya S, Somasundaram K, Praveenkumar S (2022) E-tanh: a novel activation function for image processing neural network models. Neural Comput Appl 34(19):16563–16575
Rodriguez-Conde I, Campos C, Fdez-Riverola F (2022) Optimized convolutional neural network architectures for efficient on-device vision-based object detection. Neural Comput Appl 34(13):10469–10501
Alsalemi A, Amira A, Malekmohamadi H, Diao K (2023) Lightweight Gramian angular field classification for edge internet of energy applications. Clust Comput 26(2):1375–1387
Qin Z, Zhang Y, Meng S, Qin Z, Choo K-KR (2020) Imaging and fusing time series for wearable sensor-based human activity recognition. Inf Fusion 53:80–87
Abidi A, Ienco D, Abbes AB, Farah IR (2023) Combining 2d encoding and convolutional neural network to enhance land cover mapping from satellite image time series. Eng Appl Artif Intell 122:106152
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. Preprint arXiv:1409.1556
Amin A, Bibo A, Panyam M, Tallapragada P (2023) Vibration based fault diagnostics in a wind turbine planetary gearbox using machine learning. Wind Eng 47(1):175–189
Rao SS (2019) Vibration of continuous systems. Wiley, USA
Lee U (2009) Spectral element method in structural dynamics. Wiley, Republic of Korea
Sarvestan V, Mirdamadi HR, Ghayour M (2017) Vibration analysis of cracked Timoshenko beam under moving load with constant velocity and acceleration by spectral finite element method. Int J Mech Sci 122:318–330
Boldsaikhan E, Corwin E, Antonette L, Arbegast W (2011) The use of neural network and discrete Fourier transform for real-time evaluation of friction stir welding. App Soft Comput 11(8):4839–4846
Emmanuel S, Yihun Y, Nili Ahmedabadi Z, Boldsaikhan E (2021) Planetary gear train microcrack detection using vibration data and convolutional neural networks. Neural Comput Appl 33:17223–17243
Funding
The article received no funding from any private or government organization.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ambaye, G., Boldsaikhan, E. & Krishnan, K. Robot arm damage detection using vibration data and deep learning. Neural Comput & Applic 36, 1727–1739 (2024). https://doi.org/10.1007/s00521-023-09150-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-023-09150-3