Abstract
Support vector machines (SVM) are one of the important techniques used to solve classifications problems efficiently. Setting support vector machine kernel factors affects the classification performance. Feature selection is a powerful technique to solve dimensionality problems. In this paper, we optimized SVM factors and chose features using a Grasshopper Optimization Algorithm (GOA). GOA is a new heuristic optimization algorithm inspired by grasshoppers searching for food. It approved its ability to solve real-world problems with anonymous search space. We applied the proposed GOA + SVM approach on biomedical data sets for Iraqi cancer patients in 2010–2012 and for University of California Irvine data sets.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Staelin C (2003) Parameter selection for support vector machines. Hewlett-Packard Company, HPL-2002-354 (R.1), vol 354, pp 1–4
Vapnik V (1999) The nature of statistical learning theory. Springer, New York. ISBN:0-387-98780-0; SPIN 10713304
Sweilam NH, Tharwat AA, Moniem NA (2010) Support vector machine for diagnosis cancer disease: a comparative study. Egyp Inform J 11(2):81–92
Salcedo-Sanz S, Rojo-Álvarez JL, Martínez-Ramón M, Camps-Valls G (2014) Support vector machines in engineering: an overview. Wiley Interdiscip Rev Data Min Knowl Discov 4(3):234–267
Zhang L, Lin F, Zhang B (2001) Support vector machine learning for image retrieval. In: Proceedings of 2001 international conference on image processing, vol 2, no. x, pp 721–724
Lehtokangas M (2000) Pattern recognition with novel support vector machine learning method. In: 2000 10th European signal processing conference
Tobergte DR, Curtis S (2013) Review on support vector machine (SVM) classifier for human emotion pattern recognition from EEG signals. J Chem Inf Model 53(9):1689–1699
Drucker H, Wu D, Vapnik VN (1999) Support vector machines for spam categorization. IEEE Trans Neural Netw 10(5):1048–1054
Moghaddam B (2000) Gender classification using support vector machines. In: Proceedings of 2000 international conference on image processing (Cat. No. 00CH37101), vol 2, pp 471–474
Hermes L, Buhmann JM (2000) Feature selection for support vector machines. Proc IEEE Int Conf Pattern Recognit 2:716–719
Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3(3):1157–1182
Leardi R, Gonzalez AL (1998) Genetic algorithms applied to feature selection in PLS regression: how and when to use them. Chemom Intell Lab Syst 41(2):195–207
Khushaba RN, Al-ani A, Al-jumaily A, Box PO (2008) Differential evolution based feature subset selection. Evolution (N. Y)
Khushaba RN, Al-Ani A, Al-Jumaily A (2011) Feature subset selection using differential evolution and a statistical repair mechanism. Expert Syst Appl 38(9):11515–11526
Al-Ani A, Alsukker A, Khushaba RN (2013) Feature subset selection using differential evolution and a wheel based search strategy. Swarm Evol Comput 9:15–26
Ceylan O, Gulsen T (2016) A comparison of differential evolution and harmony search methods for svm model selection in hyperspectral image classification Classification. In: Ceylan O (ed) Igarss. emerburgaz University Department of Electrical and Electronics Engineering Istanbul, Turkey, pp 485–488
Yang CS, Chuang LY, Li JC, Yang CH (2008) Chaotic maps in binary particle swarm optimization for feature selection, pp. 107–112
Kanan HR, Faez K, Taheri SM (2007) Feature selection using ant colony optimization (ACO): A New Method and Comparative Study in the application of face recognition system, pp 63–64
Emary E, Zawbaa HM, Grosan C, Hassenian AE (2015) Feature subset selection approach by gray-wolf optimization, vol 334
Zawbaa HM, Emary E, Parv B, Sharawi M (2016) Proceedings of IEEE congress evolution on computation, pp 4612–4617
Mohamed A, Faris H, Hassonah MA, Al-Zoubi M (2017) A multi-verse optimizer approach for feature selection and optimizing SVM parameters based on a robust system architecture. Neural Comput Appl. https://doi.org/10.1007/s00521-016-2818-2
Saremi S, Mirjalili S, Lewis A (2017) Grasshopper optimisation algorithm: theory and application. Adv Eng Softw 105:30–47
Faris H, Hassonah MA, Al-Zoubi AM et al (2017) A multi-verse optimizer approach for feature selection and optimizing SVM parameters based on a robust system architecture. Neural Comput Appl. https://doi.org/10.1007/s00521-016-2818-2
Braga PL, Oliveira ALI, Meira SRL (2008) A GA-based feature selection and parameters optimization for support vector regression applied to software effort estimation. In: Proceedings of 2008 ACM symposium on applied computing—SAC’08, no. January, pp 1788
Ministry of Health-Iraq-Iraqi Cancer Board (2017) Acceptance of Official Cancer datasets from Iraq
Lichman M (1013) UCI machine learning repository. University of California, Irvine, School of Information and Computer Sciences (online). http://archive.ics.uci.edu/ml. Accessed: 01 July 2017
Izmailov AF (2010) Solution sensitivity for Karush–Kuhn–Tucker systems with non-unique Lagrange multipliers. Optimization 59(5):747–775
Rogers SM, Matheson T, Despland E, Dodgson T, Burrows M, Simpson SJ (2003) Mechanosensory-induced behavioural gregarization in the desert locust Schistocerca gregaria. J Exp Biol 206(Pt 22):3991–4002
Huang CL, Wang CJ (2006) A GA-based feature selection and parameters optimizationfor support vector machines. Expert Syst Appl 31(2):231–240
Roffo G (2016) Feature selection library (MATLAB toolbox) feature selection library (MATLAB toolbox), no. April, pp 3–7
Mathew TV (2014) Genetic algorithm, pp 1–18
Li M, Du W, Nian F (2014) An adaptive particle swarm optimization algorithm based on directed weighted complex network. Mathematical problems in engineering, vol 2014
Zhang L, Liu L, Yang X-S, Dai Y (2016) A novel hybrid firefly algorithm for global optimization. PLoS ONE 11(9):e0163230
Mirjalili S, Mirjalili SM, Hatamlou A (2016) Multi-verse optimizer: a nature-inspired algorithm for global optimization. Neural Comput Appl 27(2):495–513
Emary E, Yamany W, Hassanien AE (2014) New approach for feature selection based on rough set and bat algorithm. In: 2014 9th International Conference on Computer Engineering & Systems (ICCES), pp 346–353
Mirjalili SZ, Mirjalili S, Saremi S, Faris H, Aljarah I (2017) Grasshopper optimization algorithm for multi-objective optimization problems. Appl Intell 48(4):805–850
Emary E, Zawbaa HM, Ghany KKA, Hassanien AE, Parv B (2015) Firefly optimization algorithm for feature selection. In: Proceedings of the 7th Balkan conference on informatics conference—BCI’15, pp1–7
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All authors declare that they have no conflict of interest.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Ibrahim, H.T., Mazher, W.J., Ucan, O.N. et al. A grasshopper optimizer approach for feature selection and optimizing SVM parameters utilizing real biomedical data sets. Neural Comput & Applic 31, 5965–5974 (2019). https://doi.org/10.1007/s00521-018-3414-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-018-3414-4