[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Springer Nature Link
Log in

Transfer Learning-Hierarchical Segmentation on COVID CT Scans

  • Published:
New Generation Computing Aims and scope Submit manuscript

Abstract

COVID-19—A pandemic declared by WHO in 2019 has spread worldwide, leading to many infections and deaths. The disease is fatal, and the patient develops symptoms within 14 days of the window. Diagnosis based on CT scans involves rapid and accurate detection of symptoms, and much work has already been done on segmenting infections in CT scans. However, the existing work on infection segmentation must be more efficient to segment the infection area. Therefore, this work proposes an automatic Deep Learning based model using Transfer Learning and Hierarchical techniques to segment COVID-19 infections. The proposed architecture, Transfer Learning with Hierarchical Segmentation Network (TLH-Net), comprises two encoder–decoder architectures connected in series. The encoder–decoder architecture is similar to the U-Net except for the modified 2D convolutional block, attention block and spectral pooling. In TLH-Net, the first part segments the lung contour from the CT scan slices, and the second part generates the infection mask from the lung contour maps. The model trains with the loss function TV_bin, penalizing False-Negative and False-Positive predictions. The model achieves a Dice Coefficient of 98.87% for Lung Segmentation and 86% for Infection Segmentation. The model was also tested with the unseen dataset and has achieved a 56% Dice value.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availibility Statement

The datasets analyzed for the current study are:

1. CT Scan Dataset:

https://drive.google.com/file/d/1nD8IgsqyKdcgxuI4lJ65ePS6pyv1dB3s/view 2. Open-Source Dataset:

https://figshare.com/articles/dataset/MedSeg_Covid_Dataset_1/13521488/2

References

  1. Chan, J.F.W., Yip, C.C.Y., To, K.K.W., Tang, T.H.C., Wong, S.C.Y., Leung, K.H., et al.: Improved molecular diagnosis of COVID-19 by the novel, highly sensitive and specific COVID-19-RdRp/Hel real-time reverse transcription-PCR assay validated in vitro and with clinical specimens. J. Clin. Microbiol. 58(5), e00310-20 (2020)

    Article  Google Scholar 

  2. Lai, C.K.C., Lam, W.: Laboratory testing for the diagnosis of COVID-19. Biochem. Biophys. Res. Commun. 538, 226–230 (2021)

    Article  Google Scholar 

  3. He, J.L., Luo, L., Luo, Z.D., Lyu, J.X., Ng, M.Y., Shen, X.P., et al.: Diagnostic performance between CT and initial real-time RT-PCR for clinically suspected 2019 coronavirus disease (COVID-19) patients outside Wuhan. China. Respiratory medicine. 168, 105980 (2020)

    Article  Google Scholar 

  4. Zhang, Q., Ren, X., Wei, B.: Segmentation of infected region in CT images of COVID-19 patients based on QC-HC U-net. Sci. Rep. 11(1), 1–11 (2021)

    Google Scholar 

  5. Ai, T., Yang, Z., Hou, H., Zhan, C., Chen, C., Lv, W., et al.: Correlation of Chest CT and RT-PCR Testing for Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases. Radiology 296(2), E32–E40 (2020)

    Article  Google Scholar 

  6. Long, C., Xu, H., Shen, Q., Zhang, X., Fan, B., Wang, C., et al.: Diagnosis of the Coronavirus disease (COVID-19): rRT-PCR or CT? Eur. J. Radiol. 126, 108961 (2020)

    Article  Google Scholar 

  7. Liu, J., Dong, B., Wang, S., Cui, H., Fan, D.P., Ma, J., et al.: COVID-19 lung infection segmentation with a novel two-stage cross-domain transfer learning framework. Med. Image Anal. 74, 102205 (2021)

    Article  Google Scholar 

  8. Althnian, A., AlSaeed, D., Al-Baity, H., Samha, A., Dris, A.B., Alzakari, N., et al.: Impact of Dataset Size on Classification Performance: An Empirical Evaluation in the Medical Domain. Appl. Sci. 11(2), 796 (2021)

    Article  Google Scholar 

  9. Zhou, T., Canu, S., Ruan, S.: Automatic COVID-19 CT segmentation using U-Net integrated spatial and channel attention mechanism. Int. J. Imaging Syst. Technol. 31(1), 16–27 (2021)

    Article  Google Scholar 

  10. Cheng, Z., Qu, A., He, X.: Contour-aware semantic segmentation network with spatial attention mechanism for medical image. Vis. Comput. 38(3), 749–762 (2022)

    Article  Google Scholar 

  11. Punn, N.S., Agarwal, S.: CHS-Net: A Deep Learning Approach for Hierarchical Segmentation of COVID-19 via CT Images. Neural Process. Lett. 54(5), 3771–3792 (2022)

    Article  Google Scholar 

  12. Kamble, B., Sahu, S.P., Doriya, R.: A Review on Lung and Nodule Segmentation Techniques. In: Advances in Data and Information Sciences. Springer Singapore. p. 555–565 (2020)

  13. Zhang, Y., Liao, Q., Yuan, L., Zhu, H., Xing, J., Zhang, J.: Exploiting Shared Knowledge From Non-COVID Lesions for Annotation-Efficient COVID-19 CT Lung Infection Segmentation. IEEE J. Biomed. Health Inform. 25(11), 4152–4162 (2021)

    Article  Google Scholar 

  14. van Opbroek, A., Ikram, M.A., Vernooij, M.W., de Bruijne, M.: Transfer Learning Improves Supervised Image Segmentation Across Imaging Protocols. IEEE Trans. Med. Imaging 34(5), 1018–1030 (2014)

    Article  Google Scholar 

  15. Ronneberger, O., Fischer, P., Brox, T.: U-Net: Convolutional Networks for Biomedical Image Segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) Medical Image Computing and Computer-Assisted Intervention - MICCAI 2015, vol. 9351, pp. 234–241. Springer International Publishing (2015)

    Google Scholar 

  16. Yin, X.X., Sun, L., Fu, Y., Lu, R., Zhang, Y.: U-Net-Based Medical Image Segmentation. Journal of Healthcare Engineering. Apr;p. 1–16 (2022)

  17. Ma, J., Wang, Y., An, X., Ge, C., Yu, Z., Chen, J., et al.: Toward data-efficient learning: A benchmark for COVID-19 CT lung and infection segmentation. Med. Phys. 48(3), 1197–1210 (2021)

    Article  Google Scholar 

  18. Wang, Y., Zhang, Y., Liu, Y., Tian, J., Zhong, C., Shi, Z., et al.: Does non-COVID-19 lung lesion help? investigating transferability in COVID-19 CT image segmentation. Comput. Methods Programs Biomed. 202, 106004 (2021)

    Article  Google Scholar 

  19. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the Inception Architecture for Computer Vision. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE. p. 2818–2826 (2016)

  20. Zeng, Z., Xie, W., Zhang, Y., Lu, Y.: RIC-Unet: An Improved Neural Network Based on Unet for Nuclei Segmentation in Histology Images. IEEE Access. 7, 21420–21428 (2019)

    Article  Google Scholar 

  21. Mu, N., Wang, H., Zhang, Y., Jiang, J., Tang, J.: Progressive global perception and local polishing network for lung infection segmentation of COVID-19 CT images. Pattern Recogn. 120, 108168 (2021)

    Article  Google Scholar 

  22. Tekchandani, H., Verma, S., Londhe, N.D.: Automated Lymph Nodes Classification using Factorized Convolution-based CNN. In: 2021 Fourth International Conference on Electrical, Computer and Communication Technologies (ICECCT). IEEE. p. 1–6 (2021)

  23. Li, Y., Xia, L.: Coronavirus Disease 2019 (COVID-19): Role of Chest CT in Diagnosis and Management. Am. J. Roentgenol. 214(6), 1280–1286 (2020)

    Article  Google Scholar 

  24. An, J.G., et al Z.: COVID-19 CT lung and infection segmentation dataset. Zenodo. https://zenodo.org/record/3757476. Accessed: 20 Oct 2022

  25. Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K. et al.: Attention U-Net: Learning Where to Look for the Pancreas. (2018 July)

  26. Punn, N.S., Agarwal, S.: Inception U-Net Architecture for Semantic Segmentation to Identify Nuclei in Microscopy Cell Images. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM). 16(1):1–15 (2020 Feb)

  27. Saeedizadeh, N., Minaee, S., Kafieh, R., Yazdani, S., Sonka, M.: COVID TV-Unet: Segmenting COVID-19 chest CT images using connectivity imposed Unet. Computer Methods and Programs in Biomedicine Update. 1, 100007 (2021)

    Article  Google Scholar 

  28. Rasamoelina, A.D., Adjailia, F., Sincak, P.A., Review of Activation Function for Artificial Neural Network. In,: IEEE 18th World Symposium on Applied Machine Intelligence and Informatics (SAMI). IEEE 2020, 281–286 (2020)

  29. MedSeg, Jenssen, H.B., Sakinis, T.: COVID-19 CT segmentation dataset - MedSeg Covid Dataset 1. Figshare. [Accessed : 20-10-2022]. https://figshare.com/articles/dataset/MedSeg_Covid_Dataset_1/13521488/2

  30. MedSeg.: COVID-19 - Medical segmentation - medicalsegmentation.com. [Accessed 04-08-2022]. https://medicalsegmentation.com/covid19/

  31. Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science and Engineering, National Institute of Technology, Karnataka, Surathkal, 575025, India

    Swati Singh, Alwyn Roshan Pais & Lavina Jean Crasta

Authors
  1. Swati Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alwyn Roshan Pais
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lavina Jean Crasta
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lavina Jean Crasta.

Ethics declarations

Conflict of interest:

The authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, S., Pais, A.R. & Crasta, L.J. Transfer Learning-Hierarchical Segmentation on COVID CT Scans. New Gener. Comput. 42, 551–577 (2024). https://doi.org/10.1007/s00354-024-00240-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00354-024-00240-x

Keywords

Search

Navigation