[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3340037.3340057acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicmhiConference Proceedingsconference-collections
research-article

Skin Lesion Boundary Detection with Neural Networks on iOS Devices

Published: 17 May 2019 Publication History

Abstract

Automated skin lesion boundary detection has become a common issue in Health Care. On the one hand, a broad variety of image processing algorithms already exist and they are power consuming on mobile devices. On the other hand, the use of machine learning algorithms is on the rise and new frameworks have been developed to use these techniques with improved on-device-performance. Since iOS 11.0, Apple is providing a Core Machine Learning Interface to use machine learning models. Moreover, conversion tools allow integration of 3rd party models into iOS applications. In this paper, we present an overview of available frameworks for iOS devices as well as their limitations and evaluate in practice the performance and maturity level of Neural Network frameworks for skin lesion boundary detection using only freely available pictures.

References

[1]
Apple Inc., Core ML, https://developer.apple.com/documentation/coreml, 2017. Accessed on 08.01.2018.
[2]
L. Wang, P.C. Pedersen, D.M. Strong, B. Tulu, E. Agu, R. Ignotz, Smartphone-based wound assessment system for patients with diabetes. IEEE Transactions on Biomedical Engineering 2015b; 62(2):477--488.
[3]
B.J. Erickson, P. Korfiatis, Z. Akkus, T. Kline, and K. Philbrick. Toolkits and libraries for deep learning. Journal of digital imaging, 2017; 30(4):400--405.
[4]
O. Abuzaghleh, B.D. Barkana, M. Faezipour, Non-invasive real-time automated skin lesion analysis system for melanoma early detection and prevention. IEEE journal of translational engineering in health and medicine, 2015; 3:1--12
[5]
P. Babu, G. Vimalarani, Boundary tracing algorithm for automatic skin lesion detection in macroscopic images. World Engineering & Applied Sciences Journal 2017; 8(1):25--33.
[6]
R. Mukherjee, D.D. Manohar, D.K. Das, A. Achar, A. Mitra, C. Chakraborty, Automated tissue classification framework for reproducible chronic wound assessment. BioMed research international 2014.
[7]
P. Kuan, S. Chua, E. Safawi, H. Wang, W. Tiong, A comparative study of the classification of skin burn depth in human. Journal of Telecommunication, Electronic and Computer Engineering (JTEC) 2017;9(2-10):15--23.
[8]
F. Eibe, M. Hall, I. Witten, J. Pal, The weka workbench. Online Appendix for Data Mining: Practical Machine Learning Tools and Techniques 2016; 4.
[9]
M.F.A. Fauzi, I. Khansa, K. Catignani, G. Gordillo, C.K. Sen, M.N. Gurcan, Computerized segmentation and measurement of chronic wound images. Computers in biology and medicine, 2015; 60:74--85.
[10]
F.J. Veredas, R.M. Luque-Baena, F.J. Martín-Santos, J.C. Morilla-Herrera, L. Morente, Wound image evaluation with machine learning. Neurocomputing 2015; 164:112--122.
[11]
K. Sakthivel, R. Nallusamy, C. Kavitha, Color image segmentation using svm pixel classification image. World Academy of Science, Engineering and Technology, International Journal of Computer, Electrical, Automation, Control and Information Engineering 2015; 8(10):1919--1925.
[12]
H. Gómez-Moreno, S. Maldonado-Bascón, F. López-Ferreras, F. Acevedo-Rodríguez, P. Martìn-Martín, Edge detection by using the support vector machines. European Conference on Circuit Theory and Design, 2001.
[13]
H. Gómez-Moreno, S. Maldonado-Bascón, F. López-Ferreras, P. Gil-Jiménez, A new and improved edge detector using the support vector machines, https://pdfs.semanticscholar.org/1857/0a140e98df1c77f8bc1ce1ffba94e097ff5b.pdf. Accessed on 28.02.2018
[14]
J.B. Sorensen, Support vector machines for pixel classification-application in microscopy images, 2014.
[15]
B. Belem, Non-invasive wound assessment by image analysis. Ph.D. thesis; School of Computing, Medical Imaging Group; 2004.
[16]
B. Schnalzer, B. Alcalde, Skin Lesion Detection with Support Vector Machines on iOS devices, To appear in MedInfo2019
[17]
G. Litjens, T. Kooi, B.E. Bejnordi, A.A.A. Setio,F. Ciompi, M. Ghafoorian, J.A. van der Laak, B. van Ginneken, C.I. Sánchez, A survey on deep learning in medical image analysis. Medical image analysis 2017; 42:60--88.
[18]
C. Wang, X. Yan, M. Smith, K. Kochhar, M. Rubin, S.M. Warren, J. Wrobel, H. Lee, A unified framework for automatic wound segmentation and analysis with deep convolutional neural networks. Engineering in Medicine and Biology Society (EMBC), 2015 37th Annual International Conference of the IEEE. IEEE; 2015a. p. 2415--2418.
[19]
J. Long, E. Shelhamer, T. Darrell, Fully convolutional networks for semantic segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition. 2015; 3431--3440.
[20]
Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, T. Darrell, Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:14085093 2014.
[21]
GitHub, Inc., Model Zoo. https://github.com/BVLC/caffe /wiki/Model-Zoo; 2018. Accessed on 28.02.2018.
[22]
R. Girshick, I. Radosavovic, G. Gkioxari, P. Dollfiar, K. He, Detectron. https://github.com/facebookresearch/detectron; 2018.
[23]
K.R. Foster, R. Koprowski, and J.D. Skufca. Machine learning, medical diagnosis, and biomedical engineering research-commentary. Biomedical engineering online, 2014; 13(1):94.
[24]
The MathWorks, The mathworks. Inc, Natick, MA 1998;5:333.
[25]
Apple Inc., Converting Trained Models to Core ML. https://developer.apple.com/documentation/coreml/coverting_trained_models_to_core_ml; 2017. Accessed on 08.01.2018.
[26]
Apple Inc., Vision. https://developer.apple.com/documentation/vision; 2017. Accessed on 28.02.2018.
[27]
Berkeley AI Research. Caffe. http://caffe.berkeleyvision.org/. Accessed on 13.06.2018.
[28]
Berkeley AI Research. Caffe ModelZoo. http://caffe.berkeleyvision.org/model_zoo.html. Accessed on 13.06.2018.
[29]
F. Chollet et al. Keras. https://keras.io. Accessed on 19.06.2018.
[30]
Australian Government. Skin tears. https://www.dva.gov.au/providers/provider-programs/wound-care/skin-tears. Accessed on 19.06.2018.
[31]
DermNet New Zealand Trust. Dermatology image library. https://www.dermnetnz.org/image-library/. Accessed on 19.06.2018.
[32]
Jail Medicine (2013). Abscess Incision and Drainage, a Photographic Tutorial. http://www.jailmedicine.com/tag/mrsa/. Accessed on 19.06.2018.
[33]
Nigeria Galleria. Open Wound. https://www.nigeriagalleria.com/Community-Health/Open-Wound.html. Accessed on 19.06.2018.
[34]
S. Thomas, Medetec Wound Database: stock pictures of wounds. http://www.medetec.co.uk/files/medetec-image-databases.html; 2018. Accessed on 22.02.2018.
[35]
U.S. National Library of Medicine, Lister Hill National Center for Biomedical Communications. MedPix. https://medpix.nlm.nih.gov/search?allen=true&allt=true&alli=true&query=wound. Accessed on 19.06.2018.
[36]
R. Wartala. Praxiseinstieg Deep Learning: Mit Python, Caffe, TensorFlow und Spark eigene Deep-Learning-Anwendungen erstellen. O'Reilly, 2017.
[37]
The Gradient (2018). Semantic Segmentation. https://thegradient.pub/semantic-segmentation/. Accessed on 08.08.2018.

Cited By

View all

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICMHI '19: Proceedings of the 3rd International Conference on Medical and Health Informatics
May 2019
207 pages
ISBN:9781450371995
DOI:10.1145/3340037
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

  • University of Electronic Science and Technology of China: University of Electronic Science and Technology of China

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 May 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Computer-Assisted Image Processing
  2. Machine Learning
  3. Wounds and Injuries

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICMHI 2019

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 126
    Total Downloads
  • Downloads (Last 12 months)6
  • Downloads (Last 6 weeks)2
Reflects downloads up to 19 Dec 2024

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media