[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content

Advertisement

Springer Nature Link
Log in

Diagnosis and detection of diabetic retinopathy based on transfer learning

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Diabetes Mellitus (DM) is a chronic condition that affects the blood glucose metabolism of various organs and tissues throughout the body. It can result in microvascular disorders such as coronary heart disease and cerebral hemorrhage. One significant complication is retinopathy, which, in severe cases, can lead to blindness. Early screening and detection are crucial as the disease process is irreversible. In this study, we developed a model for early screening of Diabetes Retinopathy (DR) using color fundus photography images. Our approach involved employing CLAHE, grayscale image transformation methods, and transfer learning to improve diagnostic efficiency when working with limited data. The APTOS 2019 dataset, consisting of3662 retinal images, was used in this research. Four different preprocessing methods were applied to the retinal images, including removing the black edge, resizing, and normalization (Method I), adding contrast constrained adaptive histogram equalization (CLAHE) to Method I (Method II), adding grayscale transformation to Method I (Method III), and adding CLAHE and grayscale transformations to Method I (Method IV). Data augmentation techniques such as random brightness and contrast transformations, flipping, image cropping, and mix-up algorithms were utilized for data enhancement. The ResNet50 and InceptionV3 models based on convolutional neural networks were employed to build the model for learning retinal images under three scenarios: (1) learning from scratch, (2) transfer learning with fixed weights and training only the fully connected layer, and (3) transfer learning with loaded weights, followed by fine-tuning of the entire network based on the input data. The classification performance of the models was evaluated using metrics such as AUC, accuracy, F1 score, precision, and recall. For the ResNet50 model, the accuracy rates for learning from scratch, fixed weight, and fine-tuning weight were 75.41%, 54.64%, and 81.97%, respectively. When using the InceptionV3 model, the accuracy rates were 76.50%, 10.38%, and 83.61%, respectively. Fine-tuning was conducted on data II, III, and IV using the InceptionV3 model, resulting in accuracies of 81.42%, 80.87%, and 83.61%, respectively. Comparisons between models using the same data and training methods revealed that models employing the InceptionV3 structure achieved higher accuracy than those using ResNet50 (83.61% vs. 81.97%). The results indicate that the InceptionV3-based CNN, coupled with transfer learning and appropriate data pre-processing methods, exhibited superior performance in accurately detecting diabetic retinopathy, as measured by accuracy, AUC, F1 score, and other evaluation metrics. This research holds significant value in enabling efficient early diagnosis of DR lesions and conducting an intelligent and efficient graded diagnosis of the DR progression, thereby providing the groundwork for timely intervention.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Data availability

The data that support the findings of this study are openly available on Kaggle, [https://www.kaggle.com/].

References

  1. Arpaci I, Huang S, Al-Emran M, Al-Kabi MN, Peng M (2021) Predicting the COVID-19 infection with fourteen clinical features using machine learning classification algorithms. Multimed Tools Appl 80:11943–11957. https://doi.org/10.1007/s11042-020-10340-7

    Article  Google Scholar 

  2. Esteva A et al (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542:115–118. https://doi.org/10.1038/nature21056

    Article  Google Scholar 

  3. Liu Y et al (2017) Detecting cancer metastases on gigapixel pathology images. arXiv e-prints, arXiv:1703.02442. 

  4. Ardila D et al (2019) End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography. Nat Med 25:954–961. https://doi.org/10.1038/s41591-019-0447-x

    Article  Google Scholar 

  5. Xu X, Zhang L, Li J, Guan Y, Zhang L (2020) A hybrid global-local representation CNN model for automatic cataract grading. IEEE J Biomed Health Inform 24:556–567. https://doi.org/10.1109/JBHI.2019.2914690

    Article  Google Scholar 

  6. Varadarajan AV et al (2020) Predicting optical coherence tomography-derived diabetic macular edema grades from fundus photographs using deep learning. Nat Commun 11:130. https://doi.org/10.1038/s41467-019-13922-8

    Article  Google Scholar 

  7. Bodapati JD et al (2020) Blended multi-modal deep convnet features for diabetic retinopathy severity prediction. Electronics 9:914. https://doi.org/10.3390/electronics9060914

    Article  Google Scholar 

  8. Chaturvedi SS, Gupta K, Ninawe V, Prasad PS (2020) Automated diabetic retinopathy grading using deep convolutional neural network. arXiv [eess.IV]. https://doi.org/10.48550/arXiv.2004.06334

  9. Dinç B, Kaya Y (2023) A novel hybrid optic disc detection and fovea localization method integrating region-based convnet and mathematical approach. Wirel Pers Commun 129:2727–2748. https://doi.org/10.1007/s11277-023-10255-0

    Article  Google Scholar 

  10. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2015) Rethinking the inception architecture for computer vision. arXiv [cs.CV]. https://doi.org/10.48550/arXiv.1512.00567

  11. Mitani A et al (2020) Detection of anemia from retinal fundus images via deep learning. Nat Biomed Eng 4:18–27. https://doi.org/10.1038/s41551-019-0487-z

    Article  Google Scholar 

  12. Sayres R et al (2019) Using a deep learning algorithm and integrated gradients explanation to assist grading for diabetic retinopathy. Ophthalmology 126:552–564. https://doi.org/10.1016/j.ophtha.2018.11.016

    Article  Google Scholar 

  13. Kermany DS et al (2018) Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172. https://doi.org/10.1016/j.cell.2018.02.010

  14. Gulshan V et al (2016) Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316:2402–2410. https://doi.org/10.1001/jama.2016.17216

    Article  Google Scholar 

  15. Wang Y et al (2021) Deep learning-based detection and stage grading for optimizing diagnosis of diabetic retinopathy. Diabetes Metab Res Rev 37:e3445. https://doi.org/10.1002/dmrr.3445

    Article  Google Scholar 

  16. Islam MT, Al-Absi HRH, Ruagh EA, Alam T (2021) DiaNet: a deep learning based architecture to diagnose diabetes using retinal images only. IEEE Access 9:15686–15695. https://doi.org/10.1109/ACCESS.2021.3052477

    Article  Google Scholar 

  17. Ting DSW et al (2017) Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA 318:2211–2223. https://doi.org/10.1001/jama.2017.18152

    Article  Google Scholar 

  18. Gargeya R, Leng T (2017) Automated identification of diabetic retinopathy using deep learning. Ophthalmology 124:962–969. https://doi.org/10.1016/j.ophtha.2017.02.008

    Article  Google Scholar 

  19. Abràmoff MD et al (2016) Improved automated detection of diabetic retinopathy on a publicly available dataset through integration of deep learning. Invest Ophthalmol Vis Sci 57:5200–5206. https://doi.org/10.1167/iovs.16-19964

    Article  Google Scholar 

  20. Gupta S, Thakur S, Gupta A (2022) Optimized hybrid machine learning approach for smartphone-based diabetic retinopathy detection. Multimed Tools Appl 81:14475–14501. https://doi.org/10.1007/s11042-022-12103-y

    Article  Google Scholar 

  21. Kaya Y (2020) A novel method for optic disc detection in retinal images using the cuckoo search algorithm and structural similarity index. Multimed Tools Appl 79:23387–23400. https://doi.org/10.1007/s11042-020-09080-5

    Article  Google Scholar 

  22. Wu D, Ming Z, Jyh-Charn L, Bauman W (2006) On the adaptive detection of blood vessels in retinal images. IEEE Trans Biomed Eng 53:341–343. https://doi.org/10.1109/TBME.2005.862571

    Article  Google Scholar 

  23. Das D, Biswas SK, Bandyopadhyay S (2022) A critical review on the diagnosis of diabetic retinopathy using machine learning and deep learning. Multimed Tools Appl 81:25613–25655. https://doi.org/10.1007/s11042-022-12642-4

    Article  Google Scholar 

  24. AbdelMaksoud E, Barakat S, Elmogy M (2022) A computer-aided diagnosis system for detecting various diabetic retinopathy grades based on a hybrid deep learning technique. Med Biol Eng Comput 60:2015–2038. https://doi.org/10.1007/s11517-022-02564-6

    Article  Google Scholar 

  25. Bhandari S, Pathak S, Jain SA (2023) A Literature review of early-stage diabetic retinopathy detection using deep learning and evolutionary computing techniques. Arch Comput Methods Eng 30:799–810. https://doi.org/10.1007/s11831-022-09816-6

    Article  Google Scholar 

  26. Dugas E, Jorge J, Cukierski W (2015) Diabetic retinopathy detection. https://www.kaggle.com/c/diabetic-retinopathy-detection

  27. Porwal P et al (2020) IDRiD: Diabetic retinopathy - segmentation and grading challenge. Med Image Anal 59:101561. https://doi.org/10.1016/j.media.2019.101561

    Article  Google Scholar 

  28. Decencière E et al (2014) Feedback on a publicly distributed image database: the messidor database. Image Anal Stereol 33:231–234. https://doi.org/10.5566/ias.1155

    Article  Google Scholar 

  29. Karthik SDM (2019) APTOS 2019 blindness detection. https://www.kaggle.com/c/aptos2019-blindness-detection

  30. Islam MT, Imran SA, Arefeen A, Hasan M, Shahnaz C (2019) In: 2019 IEEE International Conference on Signal Processing, Information, Communication & Systems (SPICSCON), pp 59–63. https://doi.org/10.1109/SPICSCON48833.2019.9065162

  31. Wu Z et al (2020) Coarse-to-fine classification for diabetic retinopathy grading using convolutional neural network. Artif Intell Med 108:101936. https://doi.org/10.1016/j.artmed.2020.101936

    Article  Google Scholar 

  32. Das D, Biswas SK, Bandyopadhyay S (2023) Detection of diabetic retinopathy using convolutional neural networks for feature extraction and classification (DRFEC). Multimed Tools Appl 82:29943–30001. https://doi.org/10.1007/s11042-022-14165-4

    Article  Google Scholar 

  33. Bhimavarapu U, Battineni G (2022) Deep learning for the detection and classification of diabetic retinopathy with an improved activation function. Healthcare (Basel) 11. https://doi.org/10.3390/healthcare11010097

  34. Lam C, Yi D, Guo M, Lindsey T (2017) Automated detection of diabetic retinopathy using deep learning. AMIA Jt Summits Transl Sci Proc 2018:147–155. https://doi.org/10.1109/C2I456876.2022.10051419

    Google Scholar 

  35. Hassan D et al (2022) Combining transfer learning with retinal lesion features for accurate detection of diabetic retinopathy. Front Med (Lausanne) 9:1050436. https://doi.org/10.3389/fmed.2022.1050436

    Article  Google Scholar 

  36. Reguant R, Brunak S, Saha S (2021) Understanding inherent image features in CNN-based assessment of diabetic retinopathy. Sci Rep 11:9704. https://doi.org/10.1038/s41598-021-89225-0

    Article  Google Scholar 

  37. Dong B et al (2022) A multi-branch convolutional neural network for screening and staging of diabetic retinopathy based on wide-field optical coherence tomography angiography. IRBM 43:614–620. https://doi.org/10.1016/j.irbm.2022.04.004

    Article  Google Scholar 

  38. Seth S, Agarwal B (2018) A hybrid deep learning model for detecting diabetic retinopathy. J Stat Manag Syst 21:569–574. https://doi.org/10.1080/09720510.2018.1466965

    Article  Google Scholar 

  39. Chen W, Yang B, Li J, Wang J (2020) An approach to detecting diabetic retinopathy based on integrated shallow convolutional neural networks. IEEE Access 8:178552–178562. https://doi.org/10.1109/ACCESS.2020.3027794

    Article  Google Scholar 

Download references

Funding

This research is funded by the National Education Science Planning Projects of the Ministry of Education of the People's Republic of China "National General Project, international comparative study of the training mode of medical postgraduates in the field of artificial intelligence, BIA230221, supported by the High-performance Computing Platform of Tianjin Medical University.

Author information

Author notes

  1. Kailai Liu and Ting Si contributed equally to this work.

Authors and Affiliations

  1. College of Biomedical Engineering and Technology, Tianjin Medical University, Tianjin, China

    Kailai Liu, Ting Si, Yiran Wang & Jiarui Si

  2. School of Basic Medical Sciences, Tianjin Medical University, Tianjin, China

    Chuanyi Huang

  3. School of Medical Humanities, Tianjin Medical University, Tianjin, China

    Huan Feng

Authors
  1. Kailai Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ting Si
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chuanyi Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yiran Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Huan Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jiarui Si
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiarui Si.

Ethics declarations

Conflicts of interests

Declarations of no conflicts of interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, K., Si, T., Huang, C. et al. Diagnosis and detection of diabetic retinopathy based on transfer learning. Multimed Tools Appl 83, 82945–82961 (2024). https://doi.org/10.1007/s11042-024-18792-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-024-18792-x

Keywords

Search

Navigation