[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3626203.3670528acmconferencesArticle/Chapter ViewAbstractPublication PagespearcConference Proceedingsconference-collections
research-article

Performance and Accuracy Evaluation of an Image Classifier using Multiple Machine Learning Models and Multiple GPUs

Published: 17 July 2024 Publication History

Abstract

A performance and accuracy comparison is presented using six different machine learning models with five different NVIDIA GPUs to perform image classification of flower images. The image classifier is an adaptation based on the 2019 machine learning work by Bonner for flower image prediction. The image classifier was run employing six machine learning models using five types of GPUs accessed via Google Colaboratory and the University of Tennessee ISAAC Open OnDemand environment. In the Google Colaboratory environment, 16 GB NVIDIA T4 and P100 GPUs were used. A 32 GB NVIDIA V100S, 48 GB NVIDIA A40, and 80 GB NVIDIA H100 were used in the ISAAC Open OnDemand environment. Both environments were used to perform model load and training, perform image classifier runs, and generate results. Each environment that provided GPU access had its own challenges for access and running the models which will be discussed. The machine learning models each have their own advantages and disadvantages described in detail in their related publications with the focus of this work on results and analysis on accuracy of training, accuracy of flower image prediction, resource utilization, and performance. Our paper describes the image classifier, the machine learning approach using multiple models, GPUs used, analysis of performance, accuracy of results, conclusions, and suggestions for future work.

References

[1]
Anaconda Authors. 2016. Anaconda Software Distribution. https://anaconda.com/
[2]
Anne Bonner. 2019. How to Build an Image Classifier with Greater than 97% Accuracy. freecodecamp.org. Retrieved March 3, 2024 from https://www.freecodecamp.org/news/how-to-build-the-best-image-classifier-3c72010b3d55/
[3]
Anne Bonner. 2019. Image Classifier Pytorch. Retrieved March 4, 2024 from https://github.com/bonn0062/image_classifier_pytorch
[4]
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition. Ieee, IEEE, Miami, FL, USA, 248–255.
[5]
Open OnDemand Developers. 2024. Open OnDemand User Guide on ISAAC-NG. Office of Innovative Technologies, UTK. Retrieved March 4, 2024 from https://oit.utk.edu/hpsc/isaac-open/open-ondemand-user-guide/
[6]
Google. 2024. Google Colaboratory. Alphabet, Inc. Retrieved March 4, 2024 from https://colab.research.google.com/
[7]
Victor Hazlewood and Logan Scott. 2024. ML Flower Image Classifier GPU Performance and Accuracy Evaluation. University of Tennessee. Retrieved March 8, 2024 from https://tiny.utk.edu/pearc24-hazlewood-scott
[8]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE Computer Society, Las Vegas, NV, USA, 770–778.
[9]
Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q Weinberger. 2017. Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE Computer Society, Honolulu, HI, USA, 4700–4708.
[10]
Jupyter. 2014. Project Jupyter. Project Jupyter. Retrieved March 4, 2024 from https://jupyter.org/
[11]
TorchVision maintainers and contributors. 2016. TorchVision: PyTorch’s Computer Vision library. Linux Foundation.
[12]
Maria-Elena Nilsback and Andrew Zisserman. 2008. 102 Category Flower Dataset. Department of Engineering Science, University of Oxford. Retrieved March 4, 2024 from https://www.robots.ox.ac.uk/ vgg/data/flowers/102/
[13]
Karen Simonyan and Andrew Zisserman. 2015. Very Deep Convolutional Networks for Large-Scale Image Recognition. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds.). ICLR, San Diego, CA, USA, 1–14. http://arxiv.org/abs/1409.1556
[14]
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jon Shlens, and Zbigniew Wojna. 2016. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE Computer Society, Las Vegas, NV, USA, 2818–2826.
[15]
Torch Contributors. 2017. Models and pre-trained weights. PyTorch. https://pytorch.org/vision/stable/models.html.
[16]
Saining Xie, Ross Girshick, Piotr Dollár, Zhuowen Tu, and Kaiming He. 2017. Aggregated residual transformations for deep neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE Computer Society, Honolulu, HI, USA, 1492–1500.
[17]
Sergey Zagoruyko and Nikos Komodakis. 2016. Wide Residual Networks. CoRR abs/1605.07146 (2016), 1–15. arXiv:1605.07146http://arxiv.org/abs/1605.07146

Index Terms

  1. Performance and Accuracy Evaluation of an Image Classifier using Multiple Machine Learning Models and Multiple GPUs

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    PEARC '24: Practice and Experience in Advanced Research Computing 2024: Human Powered Computing
    July 2024
    608 pages
    ISBN:9798400704192
    DOI:10.1145/3626203
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 17 July 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Benchmark
    2. GPU
    3. image classification
    4. machine learning

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    PEARC '24
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 133 of 202 submissions, 66%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 49
      Total Downloads
    • Downloads (Last 12 months)49
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 13 Dec 2024

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media