Abstract
Measurement of anatomical structures from ultrasound images requires the expertise of experienced clinicians. Moreover, there are artificial factors that make an automatic measurement complicated. In this paper, we aim to present a novel end-to-end deep learning network to automatically measure the fetal head circumference (HC), biparietal diameter (BPD), and occipitofrontal diameter (OFD) length from 2D ultrasound images. Fully convolutional neural networks (FCNNs) have shown significant improvement in natural image segmentation. Therefore, to overcome the potential difficulties in automated segmentation, we present a novelty FCNN and add a regression branch for predicting OFD and BPD in parallel. In the segmentation branch, a feature pyramid inside our network is built from low-level feature layers for a variety of fetal head in ultrasound images, which is different from traditional feature pyramid building methods. In order to select the most useful scale and reduce scale noise, attention mechanism is taken for the feature’s filter. In the regression branch, for the accurate estimation of OFD and BPD length, a new region of interest (ROI) pooling layer is proposed to extract the elliptic feature map. We also evaluate the performance of our method on large dataset: HC18. Our experimental results show that our method can achieve better performance than the existing fetal head measurement methods.
Similar content being viewed by others
References
Loughna P, Chitty L, Evans T, Chudleigh T (2009) Fetal size and dating: charts recommended for clinical obstetric practice. Ultrasound 17(3):160–166
Rueda S, Fathima S, Knight CL, Yaqub M, Papageorghiou AT, Rahmatullah B, Foi A, Maggioni M, Pepe A, Tohka J (2014) Evaluation and comparison of current fetal ultrasound image segmentation methods for biometric measurements: a grand challenge. IEEE Trans Med Imaging 33(4):797
Sylvia R, Sana F, Knight CL, Mohammad Y, Papageorghiou AT, Bahbibi R, Alessandro F, Matteo M, Antonietta P, Jussi T (2014) Evaluation and comparison of current fetal ultrasound image segmentation methods for biometric measurements: a grand challenge. IEEE Trans Med Imaging 33 (4):797– 813
Verburg BO, Steegers EAP, Ridder D, Snijders MRJM, Smith E, Hofman A, Moll HA, Jaddoe VWV, Witteman JCM (2008) New charts for ultrasound dating of pregnancy and assessment of fetal growth: longitudinal data from a population-based cohort study. Ultrasound Obst Gyn 31(4):388–396
Noble JA (2010) Ultrasound image segmentation and tissue characterization. Proc Inst Mech Eng H 224(2):307–316
Ciurte A, bresson X, Cuadra MB (2012) A semi-supervised patch-based approach for segmentation of fetal ultrasound imaging. In: ISBI Challenge Us: Biometric Measurements from Fetal Ultrasound Images
Wu L, Xin Y, Li S, Wang T, Heng P-A, Ni D (2017) Cascaded fully convolutional networks for automatic prenatal ultrasound image segmentation. In: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), IEEE, pp 663–666
Foi A, Maggioni M, Pepe A, Tohka J (2012) Head contour extraction from fetal ultrasound images by difference of Gaussians revolved along elliptical paths. In: Challenge Us: Biometric Measurements from Fetal Ultrasound Images Isbi
Stebbing RV, McManigle JE (2012) A boundary fragment model for head segmentation in fetal ultrasound. In: Proceedings of Challenge US: Biometric Measurements from Fetal Ultrasound Images, ISBI 2012, pp 9–11
Lu W, Tan J (2008) Detection of incomplete ellipse in images with strong noise by iterative randomized hough transform (irht). Pattern Recogn 41(4):1268–1279
Satwika IP, Habibie I, Ma’sum MA, Febrian A, Budianto E (2014) Particle swarm optimation based 2-dimensional randomized hough transform for fetal head biometry detection and approximation in ultrasound imaging. In: Advanced computer Science and Information Systems (ICACSIS), 2014 International Conference on, IEEE, pp 468–473
He K, Gkioxari G, Dollar P, Girshick R (2017) Mask r-cnn. IEEE Trans Pattern Anal Mach Intell PP(99):1–1
Ponomarev GV, Gelfand MS, Kazanov MD (2012) A multilevel thresholding combined with edge detection and shape-based recognition for segmentation of fetal ultrasound images. In: Proceedings of Challenge Us: Biometric Measurements from Fetal Ultrasound Images, ISBI 2012, Citeseer, vol 2012 , pp 17–19
Carneiro G, Georgescu B, Good S, Comaniciu D (2008) Detection of fetal anatomies from ultrasound images using a constrained probabilistic boosting tree. IEEE Trans Medical Imaging 27(9):1342–1355
Zalud I, Good S, Carneiro G, Georgescu B, Aoki K, Green L, Shahrestani F, Okumura R (2009) Fetal biometry: a comparison between experienced sonographers and automated measurements. J Matern-Fetal Neo Med 22(1):43–50
Ni D, Yang Y, Li S, Qin J, Ouyang S, Wang T, Heng PA (2013) Learning based automatic head detection and measurement from fetal ultrasound images via prior knowledge and imaging parameters. In: Biomedical Imaging (ISBI), 2013 IEEE 10th International Symposium on, IEEE, pp 772– 775
Jatmiko W, Habibie I, Ma’sum MA, Rahmatullah R, Satwika IP (2015) Automated telehealth system for fetal growth detection and approximation of ultrasound images. Int J Smart Sens Intell Syst 8(1)
van den Heuvel TL, de Bruijn D, de Korte CL, van Ginneken B (2018) Automated measurement of fetal head circumference using 2d ultrasound images. PloS One 13(8):e0200412
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: International Conference on Neural Information Processing Systems, pp 1097–1105
Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: International Conference on Learning Representations
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778
Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp 3431–3440
Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, New York, pp 234–241
Alison NJ (2016) Reflections on ultrasound image analysis. Med Image Anal 33:33–37
Litjens G, Kooi T, Bejnordi BE, Aaa S, Ciompi F, Ghafoorian M, Jawm VDL, Van GB, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42 (9):60–88
Shen D, Wu G, Suk HI (2017) Deep learning in medical image analysis. Annu Rev Biomed Eng 19(1):221–248
Chen L, Yang Y, Wang J, Xu W, Yuille AL (2016) Attention to scale: scale-aware semantic image segmentation. In: Computer vision and pattern recognition, pp 3640–3649
Li H, Xiong P, An J, Wang L (2018) Pyramid attention network for semantic segmentation, arXiv:1805.10180
Kingma D, Ba J (2014) Adam: A method for stochastic optimization, Comput Sci
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Li, P., Zhao, H., Liu, P. et al. Automated measurement network for accurate segmentation and parameter modification in fetal head ultrasound images. Med Biol Eng Comput 58, 2879–2892 (2020). https://doi.org/10.1007/s11517-020-02242-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11517-020-02242-5