[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

A novel end-to-end deep convolutional neural network based skin lesion classification framework

Published: 02 July 2024 Publication History

Abstract

Background:

Skin diseases are reported to contribute 1.79% of the global burden of disease. The accurate diagnosis of specific skin diseases is known to be a challenging task due, in part, to variations in skin tone, texture, body hair, etc. Classification of skin lesions using machine learning is a demanding task, due to the varying shapes, sizes, colors, and vague boundaries of some lesions. The use of deep learning for the classification of skin lesion images has been shown to help diagnose the disease at its early stages. Recent studies have demonstrated that these models perform well in skin detection tasks, with high accuracy and efficiency.

Objective:

Our paper proposes an end-to-end framework for skin lesion classification, and our contributions are two-fold. Firstly, two fundamentally different algorithms are proposed for segmenting and extracting features from images during image preprocessing. Secondly, we present a deep convolutional neural network model, S-MobileNet that aims to classify 7 different types of skin lesions.

Methods:

We used the HAM10000 dataset, which consists of 10000 dermatoscopic images from different populations and is publicly available through the International Skin Imaging Collaboration (ISIC) Archive. The image data was preprocessed to make it suitable for modeling. Exploratory data analysis (EDA) was performed to understand various attributes and their relationships within the dataset. A modified version of a Gaussian filtering algorithm and SFTA was applied for image segmentation and feature extraction. The processed dataset was then fed into the S-MobileNet model. This model was designed to be lightweight and was analyzed in three dimensions: using the Relu Activation function, the Mish activation function, and applying compression at intermediary layers. In addition, an alternative approach for compressing layers in the S-MobileNet architecture was applied to ensure a lightweight model that does not compromise on performance.

Results:

The model was trained using several experiments and assessed using various performance measures, including, loss, accuracy, precision, and the F1-score. Our results demonstrate an improvement in model performance when applying a preprocessing technique. The Mish activation function was shown to outperform Relu. Further, the classification accuracy of the compressed S-MobileNet was shown to outperform S-MobileNet.

Conclusions:

To conclude, our findings have shown that our proposed deep learning-based S-MobileNet model is the optimal approach for classifying skin lesion images in the HAM10000 dataset. In the future, our approach could be adapted and applied to other datasets, and validated to develop a skin lesion framework that can be utilized in real-time.

References

[1]
Abbas Q., Ramzan F., Ghani M.U., Acral melanoma detection using dermoscopic images and convolutional neural networks, Visual Computing for Industry, Biomedicine, and Art 4 (1) (2021) 1–12.
[2]
Adegun A.A., Viriri S., Deep learning-based system for automatic melanoma detection, IEEE Access 8 (2019) 7160–7172.
[3]
Adegun A., Viriri S., Deep learning techniques for skin lesion analysis and melanoma cancer detection: a survey of state-of-the-art, Artificial Intelligence Review 54 (2) (2021) 811–841.
[4]
Ajith A., Goel V., Vazirani P., Roja M.M., Digital dermatology: Skin disease detection model using image processing, in: 2017 international conference on intelligent computing and control systems (ICICCS), IEEE, 2017, pp. 168–173.
[5]
Al-Areqi F., Konyar M.Z., Effectiveness evaluation of different feature extraction methods for classification of covid-19 from computed tomography images: A high accuracy classification study, Biomedical Signal Processing and Control 76 (2022).
[6]
Al-Masni M.A., Al-Antari M.A., Choi M.-T., Han S.-M., Kim T.-S., Skin lesion segmentation in dermoscopy images via deep full resolution convolutional networks, Computer Methods and Programs in Biomedicine 162 (2018) 221–231.
[7]
Albahar M.A., Skin lesion classification using convolutional neural network with novel regularizer, IEEE Access 7 (2019) 38306–38313.
[8]
ALEnezi N.S.A., A method of skin disease detection using image processing and machine learning, Procedia Computer Science 163 (2019) 85–92.
[9]
Ali M.S., Miah M.S., Haque J., Rahman M.M., Islam M.K., An enhanced technique of skin cancer classification using deep convolutional neural network with transfer learning models, Machine Learning with Applications 5 (2021).
[10]
Alsaade F.W., Aldhyani T.H., Al-Adhaileh M.H., Developing a recognition system for diagnosing melanoma skin lesions using artificial intelligence algorithms, Computational and Mathematical Methods in Medicine 2021 (2021).
[11]
Barcelos C.A.Z., Pires V., An automatic based nonlinear diffusion equations scheme for skin lesion segmentation, Applied Mathematics and Computation 215 (1) (2009) 251–261.
[12]
Bhadula S., Sharma S., Juyal P., Kulshrestha C., Machine learning algorithms based skin disease detection, International Journal of Innovative Technology and Exploring Engineering (IJITEE) 9 (2) (2019) 4044–4049.
[13]
Brownlee J., Basics of linear algebra for machine learning, Machine Learning Mastery (2018).
[14]
Cai L., Gao J., Zhao D., A review of the application of deep learning in medical image classification and segmentation, Annals of Translational Medicine 8 (11) (2020).
[15]
Cai S., Shu Y., Chen G., Ooi B.C., Wang W., Zhang M., Effective and efficient dropout for deep convolutional neural networks, 2019, arXiv preprint arXiv:1904.03392.
[16]
Chatterjee S., Dey D., Munshi S., Gorai S., Extraction of features from cross correlation in space and frequency domains for classification of skin lesions, Biomedical Signal Processing and Control 53 (2019).
[17]
Costa A.F., Humpire-Mamani G., Traina A.J.M., An efficient algorithm for fractal analysis of textures, in: 2012 25th SIBGRAPI conference on graphics, patterns and images, IEEE, 2012, pp. 39–46.
[18]
D’Haeyer J.P., Gaussian filtering of images: A regularization approach, Signal Processing 18 (2) (1989) 169–181.
[19]
Diepgen T.L., Mahler V., The epidemiology of skin cancer, British Journal of Dermatology 146 (2002) 1–6.
[20]
Fitriyah H., Wihandika R.C., An analysis of rgb, hue and grayscale under various illuminations, in: 2018 international conference on sustainable information engineering and technology (SIET), IEEE, 2018, pp. 38–41.
[21]
George Y., Aldeen M., Garnavi R., Psoriasis image representation using patch-based dictionary learning for erythema severity scoring, Computerized Medical Imaging and Graphics 66 (2018) 44–55.
[22]
Glowacz A., Glowacz Z., Recognition of images of finger skin with application of histogram, image filtration and K-NN classifier, Biocybernetics and Biomedical Engineering 36 (1) (2016) 95–101.
[23]
Goyal M., Oakley A., Bansal P., Dancey D., Yap M.H., Skin lesion segmentation in dermoscopic images with ensemble deep learning methods, IEEE Access 8 (2019) 4171–4181.
[24]
Gutman D., Codella N.C., Celebi E., Helba B., Marchetti M., Mishra N., et al., Skin lesion analysis toward melanoma detection: A challenge at the international symposium on biomedical imaging (ISBI) 2016, hosted by the international skin imaging collaboration (ISIC), 2016, arXiv preprint arXiv:1605.01397.
[25]
He X., Wang Y., Zhao S., Chen X., Joint segmentation and classification of skin lesions via a multi-task learning convolutional neural network, Expert Systems with Applications (2023).
[26]
Hekler A., Utikal J.S., Enk A.H., Hauschild A., Weichenthal M., Maron R.C., et al., Superior skin cancer classification by the combination of human and artificial intelligence, European Journal of Cancer 120 (2019) 114–121.
[27]
Heller N., Bussmann E., Shah A., Dean J., Papanikolopoulos N., Computer aided diagnosis of skin lesions from morphological features, 2018.
[28]
Hoang L., Lee S.-H., Lee E.-J., Kwon K.-R., Multiclass skin lesion classification using a novel lightweight deep learning framework for smart healthcare, Applied Sciences 12 (5) (2022) 2677.
[29]
Hossain S.I., de Herve J.d.G., Hassan M.S., Martineau D., Petrosyan E., Corbin V., et al., Exploring convolutional neural networks with transfer learning for diagnosing lyme disease from skin lesion images, Computer Methods and Programs in Biomedicine 215 (2022).
[30]
Hossain S.I., Nguifo E.M., de Herve J.d.G., Early diagnosis of lyme disease by recognizing erythema migrans skin lesion from images utilizing deep learning techniques, in: Deep learning with weak or few labels in medical image analysis, 2022.
[31]
Howard A.G., Zhu M., Chen B., Kalenichenko D., Wang W., Weyand T., et al., Mobilenets: Efficient convolutional neural networks for mobile vision applications, 2017, arXiv preprint arXiv:1704.04861.
[32]
Hu L., Chen Q., Qiao L., Du L., Ye R., Automatic detection of melanins and sebums from skin images using a generative adversarial network, Cognitive Computation 14 (5) (2022) 1599–1608.
[33]
Iqbal A., Sharif M., Khan M.A., Nisar W., Alhaisoni M., Ff-unet: a U-shaped deep convolutional neural network for multimodal biomedical image segmentation, Cognitive Computation 14 (4) (2022) 1287–1302.
[34]
Kadampur M.A., Al Riyaee S., Skin cancer detection: Applying a deep learning based model driven architecture in the cloud for classifying dermal cell images, Informatics in Medicine Unlocked 18 (2020).
[35]
Kareem R.S.A., Ramanjineyulu A.G., Rajan R., Setiawan R., Sharma D.K., Gupta M.K., et al., Multilabel land cover aerial image classification using convolutional neural networks, Arabian Journal of Geosciences 14 (17) (2021) 1–18.
[36]
Khan M.A., Javed M.Y., Sharif M., Saba T., Rehman A., Multi-model deep neural network based features extraction and optimal selection approach for skin lesion classification, in: 2019 international conference on computer and information sciences (ICCIS), IEEE, 2019, pp. 1–7.
[37]
Krizhevsky A., Sutskever I., Hinton G.E., Imagenet classification with deep convolutional neural networks, Communications of the ACM 60 (6) (2017) 84–90.
[38]
Kumar A., Sodhi S.S., Comparative analysis of gaussian filter, median filter and denoise autoenocoder, in: 2020 7th international conference on computing for sustainable global development (INDIACom), IEEE, 2020, pp. 45–51.
[39]
Lin Z., Gao Y., Sang J., Investigating and explaining the frequency bias in image classification, 2022, arXiv preprint arXiv:2205.03154.
[40]
Lu D., Weng Q., A survey of image classification methods and techniques for improving classification performance, International Journal of Remote Sensing 28 (5) (2007) 823–870.
[41]
Mendonça T., Ferreira P.M., Marques J.S., Marcal A.R., Rozeira J., PH 2-a dermoscopic image database for research and benchmarking, in: 2013 35th annual international conference of the IEEE engineering in medicine and biology society (EMBC), IEEE, 2013, pp. 5437–5440.
[42]
Misra D., Mish: A self regularized non-monotonic neural activation function, 2019, arXiv preprint arXiv:1908.08681. 4, 10–48550.
[43]
Mittal N., Tanwar S., Khatri S.K., Identification & enhancement of different skin lesion images by segmentation techniques, in: 2017 6th international conference on reliability, infocom technologies and optimization (trends and future directions) (ICRITO), IEEE, 2017, pp. 609–614.
[44]
Nasiri S., Jung M., Helsper J., Fathi M., Deep-CLASS at ISIC machine learning challenge 2018, 2018, arXiv preprint arXiv:1807.08993.
[45]
Okuboyejo, D. A., Olugbara, O. O., & Odunaike, S. A. (2013). Automating skin disease diagnosis using image classification. In Proceedings of the world congress on engineering and computer science, Vol. 2 (pp. 850–854).
[46]
Pacheco A.G., Lima G.R., Salomão A.S., Krohling B., Biral I.P., de Angelo G.G., et al., PAD-UFES-20: A skin lesion dataset composed of patient data and clinical images collected from smartphones, Data in Brief 32 (2020).
[47]
Patnaik S.K., Sidhu M.S., Gehlot Y., Sharma B., Muthu P., Automated skin disease identification using deep learning algorithm, Biomedical & Pharmacology Journal 11 (3) (2018) 1429.
[48]
Premaladha J., Ravichandran K., Novel approaches for diagnosing melanoma skin lesions through supervised and deep learning algorithms, Journal of Medical Systems 40 (4) (2016) 1–12.
[49]
Ronneberger O., Fischer P., Brox T., U-net: Convolutional networks for biomedical image segmentation, in: International conference on medical image computing and computer-assisted intervention, Springer, 2015, pp. 234–241.
[50]
Roy K., Chaudhuri S.S., Ghosh S., Dutta S.K., Chakraborty P., Sarkar R., Skin disease detection based on different segmentation techniques, in: 2019 international conference on opto-electronics and applied optics (optronix), IEEE, 2019, pp. 1–5.
[51]
Ruder S., An overview of gradient descent optimization algorithms, 2016, arXiv preprint arXiv:1609.04747.
[52]
Russakovsky O., Deng J., Su H., Krause J., Satheesh S., Ma S., et al., ImageNet Large Scale Visual Recognition Challenge, International Journal of Computer Vision (IJCV) 115 (3) (2015) 211–252,.
[53]
Saarela M., Geogieva L., Robustness, stability, and fidelity of explanations for a deep skin cancer classification model, Applied Sciences 12 (19) (2022) 9545.
[54]
Sae-Lim W., Wettayaprasit W., Aiyarak P., Convolutional neural networks using MobileNet for skin lesion classification, in: 2019 16th international joint conference on computer science and software engineering (JCSSE), IEEE, 2019, pp. 242–247.
[55]
Shanthi T., Sabeenian R., Anand R., Automatic diagnosis of skin diseases using convolution neural network, Microprocessors and Microsystems 76 (2020).
[56]
Simonyan K., Zisserman A., Very deep convolutional networks for large-scale image recognition, 2014, arXiv preprint arXiv:1409.1556.
[57]
Srinivasu P.N., SivaSai J.G., Ijaz M.F., Bhoi A.K., Kim W., Kang J.J., Classification of skin disease using deep learning neural networks with MobileNet V2 and LSTM, Sensors 21 (8) (2021) 2852.
[58]
Sulthana A.R., Gupta M., Subramanian S., Mirza S., Improvising the performance of image-based recommendation system using convolution neural networks and deep learning, Soft Computing 24 (19) (2020) 14531–14544.
[59]
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., et al. (2015). Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1–9).
[60]
Tschandl P., The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions, 2018,.
[61]
Tschandl P., Rosendahl C., Kittler H., The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions, Scientific Data 5 (1) (2018) 1–9.
[62]
Tushabe, F., Mwebaze, E., & Kiwanuka, F. (2011). An image-based diagnosis of virus and bacterial skin infections. In The international conference on complications in interventional radiology (pp. 1–7).
[63]
Wang Y.-N., Tian X., Zhong G., FFNet: Feature fusion network for few-shot semantic segmentation, Cognitive Computation 14 (2) (2022) 875–886.
[64]
Waweru A.K., Ahmed K., Miao Y., Kawan P., Deep learning in skin lesion analysis towards cancer detection, in: 2020 24th international conference information visualisation (IV), IEEE, 2020, pp. 740–745.
[65]
Xu N., Li C., Image feature extraction in detection technology of breast tumor, Journal of King Saud University-Science 32 (3) (2020) 2170–2175.
[66]
Yu, S., Lee, D., & Yu, H. (2021). Convolutional neural networks with compression complexity pooling for out-of-distribution image detection. In Proceedings of the twenty-ninth international conference on international joint conferences on artificial intelligence (pp. 2435–2441).
[67]
Zafar M., Amin J., Sharif M., Anjum M.A., Mallah G.A., Kadry S., DeepLabv3+-based segmentation and best features selection using slime mould algorithm for multi-class skin lesion classification, Mathematics 11 (2) (2023) 364.
[68]
Zafar K., Gilani S.O., Waris A., Ahmed A., Jamil M., Khan M.N., et al., Skin lesion segmentation from dermoscopic images using convolutional neural network, Sensors 20 (6) (2020) 1601.
[69]
Zhang Z., Ye S., Liu Z., Wang H., Ding W., Deep hyperspherical clustering for skin lesion medical image segmentation, IEEE Journal of Biomedical and Health Informatics (2023).
[70]
Zhou Y., Huang K., Cheng C., Wang X., Hussain A., Liu X., FastAdaBelief: improving convergence rate for belief-based adaptive optimizers by exploiting strong convexity, IEEE Transactions on Neural Networks and Learning Systems (2022).

Cited By

View all
  • (2024)LW-XNet for segmentation and classification of skin lesions from dermoscopy imagesExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124826255:PDOnline publication date: 21-Nov-2024
  • (2024)Fusion of transformer attention and CNN features for skin cancer detectionApplied Soft Computing10.1016/j.asoc.2024.112013164:COnline publication date: 1-Oct-2024
  • (2024)Multi-functional scar tissue discrimination platform construction and exploration of molecular mechanism for scar formationApplied Intelligence10.1007/s10489-024-05625-554:22(11295-11310)Online publication date: 1-Nov-2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Expert Systems with Applications: An International Journal
Expert Systems with Applications: An International Journal  Volume 246, Issue C
Jul 2024
1587 pages

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 02 July 2024

Author Tags

  1. Skin lesion
  2. Image segmentation
  3. Classification
  4. Deep learning
  5. Convolution neural network
  6. MobileNet

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)LW-XNet for segmentation and classification of skin lesions from dermoscopy imagesExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124826255:PDOnline publication date: 21-Nov-2024
  • (2024)Fusion of transformer attention and CNN features for skin cancer detectionApplied Soft Computing10.1016/j.asoc.2024.112013164:COnline publication date: 1-Oct-2024
  • (2024)Multi-functional scar tissue discrimination platform construction and exploration of molecular mechanism for scar formationApplied Intelligence10.1007/s10489-024-05625-554:22(11295-11310)Online publication date: 1-Nov-2024

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media