Abstract
Nowadays, recognition of plant, leaf, and flower images is one of the most challenging issues due to the wide variety of classes on earth, which are based on amount of texture, color distinctiveness, shape distinctiveness, and different sizes. This paper proposes a hybrid method, known as Modified Deep-Convolution Neural Network Model (MDCNN) for the segmentation and recognition of flower images that employs Deep Convolution Neural Network with a combination of color model and image processing. Initially, L*a*b color space conversion is applied to reduce the multi-dimensions and geometry of images in which the red-green axis, blue-yellow axis, and luminosity are represented by chromaticity layers a*, b* and L* respectively. Moreover, the model also takes an input of different flower images and converts the RGB color model into the L*a*b color model while reducing the effort of image segmentation. That is performed by the canny edge detection algorithm. Moreover, a deep convolutional neural network with hidden layer is designed for classification and prediction of flowers with five different classes like daisy, dandelion, rose, tulip, and sunflower. This paper also represents the minimum computation time of MDCNN to detect flowers, along with the CPU and GPU. It is also compared with pre-trained convolutional neural networks such as VggNet-16, GoogleNet, AlexNet, and ResNet-50 in terms of f1-score, accuracy, precision, and sensitivity. Finally, the proposed method accurately recognised flower images with accuracy up to 98%, maximising up to + 1.89% from the state of the art while minimising the image segmentation error rate.
Similar content being viewed by others
Data availability
All the data and the supplementary material can be made available from the corresponding author, upon reasonable request.
Code availability
Codes used in this study can be made available from the corresponding author, upon reasonable request.
References
Abbas T, Razzaq A, Zia MA, Mumtaz I, Saleem MA, Akbar W, Shivachi CS (2022) Deep neural networks for automatic flower species localization and recognition. Comput Intell Neurosci: 2022. https://doi.org/10.1155/2022/9359353
Alipour N, Tarkhaneh O, Awrangjeb M, Tian H (2021) Flower image classification using deep convolutional neural network. In 2021 7th International Conference on Web Research (ICWR): 1–4. https://doi.org/10.1109/ICWR51868.2021.9443129
Almogdady H, Manaseer S, Hiary H (2018) A flower recognition system based on image processing and neural networks. Int J Sci Technol Res 7(11):166–173
Atrish A, Singh N, Kumar K, Kumar V (2017) An automated hierarchical framework for player recognition in sports image. In Proceedings of the international conference on video and image processing:103–108. https://dl.acm.org/doi/10.1145/3177404.3177432
Baziyad M, Rabie T, Kamel I (2018) Extending steganography payload capacity using the L ab color space. In 2018 International conference on innovations in information technology (IIT): 1–6. IEEE. https://doi.org/10.1109/INNOVATIONS.2018.8606008
Bisen D (2021) Deep convolutional neural network based plant species recognition through features of leaf. Multimed Tools Appl 80(4):6443–6456. https://doi.org/10.1007/s11042-020-10038-w
Bisen D, Shukla R, Rajpoot N, Maurya P, Uttam AK, Arjaria SK (2022) Responsive human-computer interaction model based on recognition of facial landmarks using machine learning algorithms. Multimed Tools Appl 81(13):18011–18031. https://doi.org/10.1007/s11042-022-12775-6
Chen Y, Lee WS, Gan H, Peres N, Fraisse C, Zhang Y, He Y (2019) Strawberry yield prediction based on a deep neural network using high-resolution aerial orthoimages. Remote Sens 11(13):1584. https://www.mdpi.com/2072-4292/11/13/1584
Christenhusz MJM, Byng JW (2016) The number of known plants species in the world and its annual increase. Phytotaxa 261(201):10–11646. https://doi.org/10.11646/phytotaxa.261.3.1
Donahue J, Jia Y, Vinyals O, Hoffman J, Zhang N, Tzeng E, Darrell T (2014) Decaf A deep convolutional activation feature for generic visual recognition. In International conference on machine learning: 647–655. PMLR. https://doi.org/10.48550/arXiv.1310.1531
Flower Dataset: https://www.kaggle.com/alxmamaev/flowers-recognition. Accessed July 2022
Gavai NR, Jakhade YA, Tribhuvan SA, Bhattad R (2017) MobileNets for flower classification using TensorFlow. In 2017 international conference on big data IoT and data science (BID):154–158. https://doi.org/10.1109/BID.2017.8336590
Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition: 580–587. https://doi.org/10.1109/CVPR.2014.81
Gogul I, Kumar VS (2017) Flower species recognition system using convolution neural networks and transfer learning. In 2017 fourth international conference on signal processing, communication and networking (ICSCN):1–6. https://doi.org/10.1109/ICSCN.2017.8085675
Grauman K, Darrell T (2005) The pyramid match kernel: Discriminative classification with sets of image features. In Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1:1458–1465. https://doi.org/10.1109/ICCV.2005.239
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition: 770–778. https://doi.org/10.1109/CVPR.2016.90
Hiary H, Saadeh H, Saadeh M, Yaqub M (2018) Flower classification using deep convolutional neural networks. IET Comput Vision 12(6):855–862. https://doi.org/10.1049/iet-cvi.2017.0155
Ioffe S, Szegedy C (2015) Batch normalization Accelerating deep network training by reducing internal covariate shift. In International conference on machine learning: 448–456. https://doi.org/10.48550/arXiv.1502.03167
Ito S, Kubota S (2010) Object classification using heterogeneous co-occurrence features. In Computer Vision–ECCV 2010 11th European Conference on Computer Vision Heraklion Crete Greece September 5–11 2010 Proceedings Part V 11: 701–714. Springer Berlin Heidelberg. https://link.springer.com/chapter/10.1007/978-3-642-15555-0_51
Kaur S, Sikka G, Awasthi LK (2018) Sentiment analysis approach based on N-gram and KNN classifier. In 2018 First International Conference on Secure Cyber Computing and Communication (ICSCCC): 1–4. https://doi.org/10.1109/ICSCCC.2018.8703350
Krizhevsky A, Sutskever I, Hinton GE (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60(6):84–90. https://dl.acm.org/doi/10.1145/3065386
Kumar A, Singh N, Kumar P, Vijayvergia A, Kumar K (2017) A novel superpixel based color spatial feature for salient object detection. In 2017 conference on information and communication technology (CICT): 1–5. https://doi.org/10.1109/INFOCOMTECH.2017.8340630
Li B, Wang Y, Wang Y, Chen Y, Yang H (2014) Training itself: Mixed-signal training acceleration for memristor-based neural network. In 2014 19th Asia and South Pacific Design Automation Conference (ASP-DAC):361-366. IEEE.https://doi.org/10.1109/ASPDAC.2014.6742916
Lodh A, Parekh R (2017) Flower recognition system based on color and GIST features. In 2017 Devices for Integrated Circuit (DevIC): 790–794. https://doi.org/10.1109/DEVIC.2017.8074061
Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition: 3431–3440. https://doi.org/10.1109/CVPR.2015.7298965
Lu Z, Sreekumar G, Goodman E, Banzhaf W, Deb K, Boddeti VN (2021) Neural architecture transfer. IEEE Tran Pattern Anal Mach Intell 43(9):2971–2989. https://doi.org/10.1109/TPAMI.2021.3052758
Lukman A, Yang CK (2021) An object recognition system based on convolutional neural networks and angular resolutions. Multimedia Tools Appl 80: 16059–16085. https://link.springer.com/article/10.1007/s11042-020-10312-x
MATLAB: https://in.mathworks.com/products/deep-learning.html. Accessed June 2023
Mete BR, Ensari T (2019) Flower classification with deep cnn and machine learning algorithms. In 2019 3rd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT): 1–5. https://doi.org/10.1109/ISMSIT.2019.8932908
Negi A, Kumar K, Chauhan P (2021) Deep neural network‐based multi‐class image classification for plant diseases. Agricultural informatics automation using the IoT and machine learning: 117–129. https://doi.org/10.1002/9781119769231.ch6
Nguyen TN, Le VT, Le TL, Hai V, Pantuwong N, Yagi Y (2016) Flower species identification using deep convolutional neural networks. In AUN/SEED-Net Regional Conference for Computer and Information Engineering.https://doi.org/10.1049/iet-cvi.2017.0155
Ong ZY, Chye KK, Kang HW, Tan CW (2021) A flower recognition system using deep neural network with visual geometry group 19 architecture. In International Conference on Digital Transformation and Applications (ICDXA): 121–128. https://doi.org/10.56453/icdxa.2021.1012
Sabeena M, Abraham L (2021) Digital image forensic using deep flower pollination with adaptive Harris hawk optimization. Multimed Tools Appl 80(17):26333–26355. https://link.springer.com/article/10.1007/s11042-021-10925-w
Sahota K K, Awasthi L K, Verma H K (2017) An empirical enhancement using scale invariant feature transform in text extraction from images. In 2017 International Conference on Intelligent Communication and Computational Techniques (ICCT): 228–232. https://doi.org/10.1109/INTELCCT.2017.8324050
Sharma S, Shivhare SN, Singh N, Kumar K (2019) Computationally Efficient ANN Model for Small-Scale Problems. In: Tanveer M, Pachori R (eds) Machine Intelligence and Signal Analysis. Advances in Intelligent Systems and Computing, vol 748. Springer, Singapore. https://doi.org/10.1007/978-981-13-0923-6_37
Simonyan K, Zisserman (2014) A Very deep convolutional networks for large-scale image recognition. arXiv Pre print arXiv14(09):1556. https://doi.org/10.48550/arXiv.1409.1556
Xia X, Xu C, Nan B (2017) Inception-v3 for flower classification. In 2017 2nd international conference on image, vision and computing (ICIVC): 783–787. https://doi.org/10.1109/ICIVC.2017.7984661
Funding
The Author(s) declares that this research has not been funded by any agency.
Author information
Authors and Affiliations
Contributions
• Varshali Jaiswal: Methodology; Writing original draft.
• Varsha Sharma: Literature Review; Editing; Reviewing the Manuscript.
• Dhananjay Bisen: Reviewing the Manuscript & final drafting.
Corresponding author
Ethics declarations
Declarations
The Author(s) permits the publisher to publish this research article in this esteemed Journal. The Corresponding Author gives consent from individuals to publish the data associated with this research article.
Ethical approval
All the author(s) agrees to the guidelines provided by the Journal. This research has considered all ethical issues associated with the methodology being employed.
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Jaiswal, V., Sharma, V. & Bisen, D. Modified Deep-Convolution Neural Network Model for Flower Images Segmentation and Predictions. Multimed Tools Appl 83, 25713–25739 (2024). https://doi.org/10.1007/s11042-023-16530-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-16530-3