Abstract
Machine vision measurement is an ideal method for real-time non-contact measurement of hot forgings, where image segmentation is the most important issue in extracting contours and effective areas. However, existing image segmentation methods have limitations of poor performance or complex algorithms with high computational costs, thus are not suitable for real-time processing of hot forging images in industrial processing. This paper proposes an efficient and robust passive visual image segmentation approach by extracting edges of forging images based on discrete grayscale surface continuity, by which experiments on forging positioning and dimension measurement are conducted to prove the performance and feasibility of the image segmentation approach. In this paper, three types of edges by the geometric continuity of the equivalent grayscale surface for forging images are proposed, so that segmentation can be realized by extracting feature edges directly, or combined with the Snakes model. Continuity edges directly related to the geometric characteristics of grayscale surface for forging images, the extracted primary and secondary edges, subsequently the edge-based segmentation approach, can be identified as suitable and stable for forgings with different thermal radiations and dimensions. The experimental results show that the proposed image segmentation approach based on continuity edges works well for segmenting forging images of different temperatures and dimensions, which provides good results in real-time dimension and positioning measurement experiments for hot forging.
Similar content being viewed by others
References
Jia Z, Wang B, Liu W, Sun Y (2010) An improved image acquiring method for machine vision measurement of hot formed parts. J Mater Process Technol 210(2):267–271. https://doi.org/10.1016/j.jmatprotec.2009.09.009
Liu Y, Jia Z, Liu W, Wang L, Fan C, Xu P, Zhao K (2016) An improved image acquisition method for measuring hot forgings using machine vision. Sens Actuators A 238:369–378. https://doi.org/10.1016/j.sna.2015.11.035
Wong A, Sahoo P (1989) A gray-level threshold selection method based on maximum entropy principle. IEEE Trans Syst Man Cybern 19(4):866–871. https://doi.org/10.1109/21.35351
Saha P, Udupa J (2001) Optimum image thresholding via class uncertainty and region homogeneity. IEEE Trans Pattern Anal Mach Intell 23(7):689–706. https://doi.org/10.1109/34.935844
Mahmood N, Shah A, Waqas A, Abubakar A, Kamran S, Zaidi S (2015) Image segmentation methods and edge detection: An application to knee joint articular cartilage edge detection. J Theor Appl Inf Technol 71(1):87–96
Martel A, Gallego-Ortiz C, Lu Y (2016) Breast segmentation in MRI using Poisson surface reconstruction initialized with random forest edge detection. In Medical Imaging 2016: Image Processing (Vol. 9784, pp. 351–356). SPIE. https://doi.org/10.1117/12.2214416
Bagga P, Makhesana M, Patel K (2021) A novel approach of combined edge detection and segmentation for tool wear measurement in machining. Prod Eng Res Devel 15:519–533. https://doi.org/10.1007/s11740-021-01035-5
Adams R, Bischof L (1994) Seeded region growing. IEEE Trans Pattern Anal Mach Intell 16(6):641–647. https://doi.org/10.1109/34.295913
Hojjatoleslami S, Kittler J (1998) Region growing: a new approach. IEEE Trans Image Process 7(7):1079–1084. https://doi.org/10.1109/83.701170
Tremeau A, Borel N (1997) A region growing and merging algorithm to color segmentation. Pattern Recogn 30(7):1191–1203. https://doi.org/10.1016/S0031-3203(96)00147-1
Horowitz S (1974) Picture segmentation by a directed split-and-merge procedure. Proc. 2nd IJCPR., Copenhagen, 1974.
Ohlander R, Price K, Reddy D (1978) Picture segmentation using a recursive region splitting method. Comput Graphics Image Process 8(3):313–333. https://doi.org/10.1016/0146-664X(78)90060-6
Mukherjee D, Pal P, Das J (1996) Sonar Image Segmentation by Fuzzy C-Means. Signal Process 54(3):295–301
Jeon B, Jung Y, Hong K (2006) Image segmentation by unsupervised sparse clustering. Pattern Recogn Lett 27(14):1650–1664. https://doi.org/10.1016/j.patrec.2006.03.011
Udupa J, Wei L, Samarasekera S, Miki Y, van Buchem M, Grossman R (1997) Multiple sclerosis lesion quantification using fuzzy-connectedness principles. IEEE Trans Med Imaging 16(5):598–609. https://doi.org/10.1109/42.640750
Geman S, Geman D (1984) Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans Pattern Anal Mach Intell 6:721–741. https://doi.org/10.1109/TPAMI.1984.4767596
Besag J (1986) On the statistical analysis of dirty pictures. J R Stat Soc Ser B Stat Methodol 48(3):259–279. https://doi.org/10.1111/j.2517-6161.1986.tb01412.x
Zhang J (1992) The mean field theory in EM procedures for Markov random fields. IEEE Trans Signal Process 40(10):2570–2583. https://doi.org/10.1109/78.157297
Holland J (1973) Genetic algorithms and the optimal allocation of trials. SIAM J Comput 2(2):88–105. https://doi.org/10.1137/0202009
Langer M, He Z, Rahayu W, Xue Y (2020) Distributed training of deep learning models: A taxonomic perspective. IEEE Trans Parallel Distrib Syst 31(12):2802–2818. https://doi.org/10.1109/TPDS.2020.3003307
Krizhevsky A, Sutskever I, Hinton G (2012) Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems, 25. https://doi.org/10.1145/3065386
Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3431–3440). https://doi.org/10.1109/tpami.2016.2572683
Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, 28.
He K, Gkioxari G, Dollár P, Girshick R (2017) Mask r-cnn. In Proceedings of the IEEE international conference on computer vision (pp. 2961–2969). https://doi.org/10.1109/TPAMI.2018.2844175
Zhou Y, Chen H, Li Y, Liu Q, Xu X, Wang S, Yap P, Shen D (2021) Multi-task learning for segmentation and classification of tumors in 3d automated breast ultrasound images. Med Image Anal 70:101918. https://doi.org/10.1016/j.media.2020.101918
Sinha A, Dolz J (2020) Multi-scale self-guided attention for medical image segmentation. IEEE J Biomed Health Inform 25(1):121–130. https://doi.org/10.1109/JBHI.2020.2986926
Yin X, Sun L, Fu Y, Lu R, Zhang Y (2022) U-Net-Based medical image segmentation. J Healthcare Eng 2022. https://doi.org/10.1155/2022/4189781.
Guan J, Yang X, Ding L, Cheng X, Lee V, Jin C (2021) Automated pixel-level pavement distress detection based on stereo vision and deep learning. Autom Constr 129:103788. https://doi.org/10.1016/j.autcon.2021.103788
Wang Z, Qin Y, Chen W (2021) Vision measurement of gear pitting based on DCGAN and U-Net. J Mech Sci Technol 35:2771–2779. https://doi.org/10.1007/s12206-021-0601-5
Dworkin S, Nye T (2006) Image processing for machine vision measurement of hot formed parts. J Mater Process Technol 174(1–3):1–6. https://doi.org/10.1016/j.jmatprotec.2004.10.019
Nie S, Tang J, Guo B, Li Q, Wu S, Song S (2005) Research on the heavy forgings dimensional metrology based on CCD. Suxing Gongcheng Xuebao(Journal of Plasticity Engineering), 12, 85–88.
Li Z, Xia Q, Pan Y, Wu Z (2012) Internal Contour Extraction Algorithm Based on Quadratic B-spline for Images of Hot Long Shaft Forgings. Adv Mater Res 472:2274–2278. https://doi.org/10.4028/www.scientific.net/AMR.472-475.2274
Wang D, Wang W (2015) Kinematic differential geometry and saddle synthesis of linkages. John Wiley & Sons
Funding
This work was supported in part by the Liaoning Technology Research Project of ‘Jiebang Guashuai’—Development and application of intelligent main bearing for large MW offshore wind power (No. 2021JH1/10400099). Delun WANG has received research support from the research project.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study’s conception and design. Material preparation, data collection, and analysis were performed by Xiaoyu PAN and Delun WANG. The first draft of the manuscript was written by Xiaoyu PAN and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Pan, X., Wang, D. A dimension and positioning measurement approach for hot forgings based on image segmentation by edgings of grayscale surface continuity. Int J Adv Manuf Technol 130, 3031–3052 (2024). https://doi.org/10.1007/s00170-023-12719-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00170-023-12719-w