[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content

Advertisement

Springer Nature Link
Log in

Enhancing deep learning pre-trained networks on diabetic retinopathy fundus photographs with SLIC-G

  • Original Article
  • Published:
Medical & Biological Engineering & Computing Aims and scope Submit manuscript

Abstract

Diabetic retinopathy disease contains lesions (e.g., exudates, hemorrhages, and microaneurysms) that are minute to the naked eye. Determining the lesions at pixel level poses a challenge as each pixel does not reflect any semantic entities. Furthermore, the computational cost of inspecting each pixel is expensive because the number of pixels is high even at low resolution. In this work, we propose a hybrid image processing method. Simple Linear Iterative Clustering with Gaussian Filter (SLIC-G) for the purpose of overcoming pixel constraints. The SLIC-G image processing method is divided into two stages: (1) simple linear iterative clustering superpixel segmentation and (2) Gaussian smoothing operation. In such a way, a large number of new transformed datasets are generated and then used for model training. Finally, two performance evaluation metrics that are suitable for imbalanced diabetic retinopathy datasets were used to validate the effectiveness of the proposed SLIC-G. The results indicate that, in comparison to prior published works’ results, the proposed SLIC-G shows better performance on image classification of class imbalanced diabetic retinopathy datasets. This research reveals the importance of image processing and how it influences the performance of deep learning networks. The proposed SLIC-G enhances pre-trained network performance by eliminating the local redundancy of an image, which preserves local structures, but avoids over-segmented, noisy clips. It closes the research gap by introducing the use of superpixel segmentation and Gaussian smoothing operation as image processing methods in diabetic retinopathy–related tasks.

Graphical abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. World Health Organization (2022) Diabetes. https://www.who.int/news-room/fact-sheets/detail/diabetes?fbclid=IwAR3YsEEjLrwLy8VXNZqX_acZysSInaguNgAz8YjUlLB8Tvh_wiIwHt2lNk4. Accessed 21 Mar 2023

  2. International Diabetes Federation and The Fred Hollows Foundation (2015) Diabetes eye health: a guide for health care professionals. International Diabetes Federation, Brussels, Belgium

    Google Scholar 

  3. Sarki R, Ahmed K, Wang H, Zhang Y (2020) Automatic detection of diabetic eye disease through deep learning using fundus images: a survey. IEEE Access 8:151133–151149

    Article  Google Scholar 

  4. Alyoubi WL, Shalash WM, Abulkhair MF (2020) Diabetic retinopathy detection through deep learning techniques: a review. Inf Med Unlocked 20:100377

    Article  Google Scholar 

  5. Asiri N, Hussain M, Al Adel F, Alzaidi N (2019) Deep learning based computer-aided diagnosis systems for diabetic retinopathy: a survey. Artif Intell Med 99:101701

    Article  PubMed  Google Scholar 

  6. Nielsen KB, Lautrup ML, Andersen JK, Savarimuthu TR, Grauslund J (2019) Deep learning–based algorithms in screening of diabetic retinopathy: a systematic review of diagnostic performance. Ophthalmol Retina 3(4):294–304

    Article  PubMed  Google Scholar 

  7. MacDonald G (2013) Why do we need image processing? J Biomol Tech 24(Suppl):S9

    PubMed Central  Google Scholar 

  8. Nixon M, Aguado A (2019) Feature extraction and image processing for computer vision. Academic Press

    Google Scholar 

  9. Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Süsstrunk S (2012) SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell 34(11):2274–2282

    Article  PubMed  Google Scholar 

  10. Gao Z, Wang J, Wang X, Dong X, Li Y (2021) A review of segmentation and classification for retinal optical coherence tomography images. In: 2021 IEEE 2nd International Conference on Pattern Recognition and Machine Learning (PRML). IEEE, pp 129-135

  11. Shaharum SM, Hashim NH, Abdul Karim MS, Mohd Faudzi AA (2019) Automatic detection of diabetic retinopathy retinal images using artificial neural network. In: Proceedings of the 10th National Technical Seminar on Underwater System Technology 2018. Springer, pp 495–503

    Chapter  Google Scholar 

  12. Li G, Zheng S, Li X (2017) Exudate detection in fundus images via convolutional neural network. In: International Forum on Digital TV and Wireless Multimedia Communications. Springer, pp 193–202

    Google Scholar 

  13. Zhang L, Li J, Han H, Liu B, Yang J, Wang Q (2017) Automatic cataract detection and grading using deep convolutional neural network. In: 2017 IEEE 14th International Conference on Networking, Sensing and Control (ICNSC). IEEE, pp 60-65

  14. Sisodia DS, Nair S, Khobragade P (2017) Diabetic retinal fundus images: preprocessing and feature extraction for early detection of diabetic retinopathy. Biomed Pharmacol J 10(2):615–626

    Article  Google Scholar 

  15. Umapathy A, Sreenivasan A, Nairy DS, Natarajan S, Rao BN (2019) Image processing, textural feature extraction and transfer learning based detection of diabetic retinopathy. In: Proceedings of the 2019 9th international conference on bioscience, biochemistry and bioinformatics, pp 17–21

  16. Ran J, Niu K, He Z, Zhang H, Song H (2018) Cataract detection and grading based on combination of deep convolutional neural network and random forests. In: 2018 International Conference on Network Infrastructure and Digital Content (IC-NIDC). IEEE, pp 155-159

  17. Orlando JI, Prokofyeva E, Del Fresno M, Blaschko MB (2018) An ensemble deep learning based approach for red lesion detection in fundus images. Comput Methods Programs Biomed 153:115–127

    Article  PubMed  Google Scholar 

  18. Mansour RF (2018) Deep-learning-based automatic computer-aided diagnosis system for diabetic retinopathy. Biomed Eng Lett 8(1):41–57

    Article  PubMed  Google Scholar 

  19. Gondal WM, Köhler JM, Grzeszick R, Fink GA, Hirsch M (2017) Weakly-supervised localization of diabetic retinopathy lesions in retinal fundus images. In: 2017 IEEE International Conference on Image Processing (ICIP). IEEE, pp 2069-2073

  20. Quellec G, Charrière K, Boudi Y, Cochener B, Lamard M (2017) Deep image mining for diabetic retinopathy screening. Med Image Anal 39:178–193

    Article  PubMed  Google Scholar 

  21. Van Grinsven MJ, van Ginneken B, Hoyng CB, Theelen T, Sánchez CI (2016) Fast convolutional neural network training using selective data sampling: application to hemorrhage detection in color fundus images. IEEE Trans Med Imaging 35(5):1273–1284

    Article  PubMed  Google Scholar 

  22. Ren X, Malik J (2003) Learning a classification model for segmentation. In: IEEE International Conference on Computer Vision, vol 2. IEEE Computer Society, pp 10-10

  23. Stutz D, Hermans A, Leibe B (2018) Superpixels: an evaluation of the state-of-the-art. Comput Vis Image Underst 166:1–27

    Article  Google Scholar 

  24. Wang M, Liu X, Gao Y, Ma X, Soomro NQ (2017) Superpixel segmentation: a benchmark. Signal Proc Image Commun 56:28–39

  25. Li Z, Chen J (2015) Superpixel segmentation using linear spectral clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1356-1363

  26. Wang X, Guo Y, Wang Y, Yu J (2019) Automatic breast tumor detection in ABVS images based on convolutional neural network and superpixel patterns. Neural Comput Applic 31(4):1069–1081

    Article  Google Scholar 

  27. Lee S-A, Cho HC, Cho H-C (2021) A novel approach for increased convolutional neural network performance in gastric-cancer classification using endoscopic images. IEEE Access 9:51847–51854

    Article  Google Scholar 

  28. Bama S, Velumani R, Prakash N, Hemalakshmi G, Mohanarathinam A (2021) Automatic segmentation of melanoma using superpixel region growing technique. Mater Today Proc 45:1726–1732

    Article  Google Scholar 

  29. Ortiz-Toro C, García-Pedrero A, Lillo-Saavedra M, Gonzalo-Martín C (2022) Automatic detection of pneumonia in chest X-ray images using textural features. Comput Biol Med 145:105466

    Article  PubMed  PubMed Central  Google Scholar 

  30. Kaggle (2022) Kaggle. https://www.kaggle.com/c/aptos2019-blindness-detection. Accessed 21 Mar 2023

  31. Grand Challenge. (2022). Diabetic retinopathy. Segmentation and grading challenge. https://idrid.grand-challenge.org/

    Google Scholar 

  32. Woods JW (2011) Multidimensional signal, image, and video processing and coding. Academic Press

    Google Scholar 

  33. Lemaitre G, Nogueira F, Oliveira D, Aridas C (2016) imblearn.metrics.geometric_mean_score. http://glemaitre.github.io/imbalanced-learn/generated/imblearn.metrics.geometric_mean_score.html?fbclid=IwAR3NeuMfjgebxsNfDvDsDciP8_6471qBj2p9vx9Z0YiH0t48VytmYo-L3Jw. Accessed 21 Mar 2023

  34. Pedregosa F et al (2011) Scikit-learn: machine learning in Python. J Mach Learn Res 12:2825–2830

    Google Scholar 

  35. PyTorch (2022) PyTorch. https://pytorch.org/. Accessed 21 Mar 2023

  36. Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708

  37. Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T et al (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861

  38. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556

  39. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  40. Hagos MT, Kant S (2019) Transfer learning based detection of diabetic retinopathy from small dataset. arXiv preprint arXiv:1905.07203

  41. Iglovikov V, Shvets A (2018) Ternausnet: U-net with vgg11 encoder pre-trained on imagenet for image segmentation. arXiv preprint arXiv:1801.05746

  42. Saini M, Susan S (2022) Diabetic retinopathy screening using deep learning for multi-class imbalanced datasets. Comput Biol Med 149:105989

    Article  PubMed  Google Scholar 

  43. Macsik P, Pavlovicova J, Goga J, Kajan S (2022) Local binary CNN for diabetic retinopathy classification on fundus images. Acta Polytech Hung 19(7):27–45

  44. Adriman R, Muchtar K, Maulina N (2021) Performance evaluation of binary classification of diabetic retinopathy through deep learning techniques using texture feature. Procedia Comput Sci 179:88–94

    Article  Google Scholar 

  45. Gayathri S, Gopi VP, Palanisamy P (2020) A lightweight CNN for diabetic retinopathy classification from fundus images. Biomed Signal Process Control 62:102115

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Science and Engineering, School of Computer Science, University of Nottingham Malaysia, Semenyih, Malaysia

    Wei Xiang Lim & Zhiyuan Chen

Authors
  1. Wei Xiang Lim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhiyuan Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhiyuan Chen.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lim, W.X., Chen, Z. Enhancing deep learning pre-trained networks on diabetic retinopathy fundus photographs with SLIC-G. Med Biol Eng Comput 62, 2571–2583 (2024). https://doi.org/10.1007/s11517-024-03093-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11517-024-03093-0

Keywords

Search

Navigation