A new adaptive framework for classifier ensemble in multiclass large data
Pages 526 - 536
Abstract
This paper proposes an innovative combinational algorithm to improve the performance of multiclass problems. Because the more accurate classifier the better performance of classification, so researchers have been tended to improve the accuracies of classifiers. Although obtaining the more accurate classifier is often targeted, there is an alternative way to reach for it. Indeed one can use many inaccurate classifiers each of which is specialized for a few dataitems in the problem space and then s/he can consider their consensus vote as the classification. This paper proposes a new ensembles methodology that uses ensemble of classifiers as elements of ensemble. These ensembles of classifiers jointly work using majority weighted voting. The results of these ensembles are in weighted manner combined to decide the final vote of the classification. In empirical result, these weights in final classifier are determined with using a series of genetic algorithms. We evaluate the proposed framework on a very large scale Persian digit handwritten dataset and the results show effectiveness of the algorithm.
References
[1]
Bala, J., De Jong, K., Huang, J., Vafaie, H., Wechsler, H.: Using learning to facilitate the evolution of features for recognizing visual concepts. Evolutionary Computation, Special Issue on Evolution, Learning, and Instinct: 100 years of the Baldwin Effect 4(3) (1997).
[2]
Bandyopadhyay, S., Muthy, C.A.: Pattern Classification Using Genetic Algorithms. Pattern Recognition Letters 16, 801-808 (1995).
[3]
Breiman, L.: Bagging Predictors. Journal of Machine Learning 24(2), 123-140 (1996).
[4]
Guerra-Salcedo, C., Whitley, D.: Feature Selection mechanisms for ensemble creation: a genetic search perspective. In: Freitas, A.A. (ed.) Data Mining with Evolutionary Algorithms: Research Directions - Papers from the AAAI Workshop, Technical Report WS-99-06, pp. 13-17. AAAI Press, Menlo Park (1999).
[5]
Gunter, S., Bunke, H.: Creation of classifier ensembles for handwritten word recognition using feature selection algorithms. In: IWFHR 2002, January 15 (2002).
[6]
Holland, J.: Adaptive in Natural and Artificial Systems. MIT Press, Cambridge (1992) (1st edn. The University of Michigan Press, Ann Arbor (1975)).
[7]
Khosravi, H., Kabir, E.: Introducing a very large dataset of handwritten Farsi digits and a study on the variety of handwriting styles. Pattern Recognition Letters 28(10), 1133-1141 (2007).
[8]
Kuncheva, L.I., Jain, L.C.: Designing Classifier Fusion Systems by Genetic Algorithms. IEEE Transaction on Evolutionary Computation 33, 351-373 (2000).
[9]
Kuncheva, L.I.: Combining Pattern Classifiers, Methods and Algorithms. Wiley, New York (2005).
[10]
Martin-Bautista, M.J., Vila, M.A.: A survey of genetic feature selection in mining issues. In: Proceeding Congress on Evolutionary Computation (CEC 1999), Washington DC, pp. 1314-1321 (1999).
[11]
Minaei-Bidgoli, B., Punch, W.F.: Using Genetic Algorithms for Data Mining Optimization in an Educational Web-based System. In: Cantú-Paz, E., Foster, J.A., Deb, K., Davis, L., Roy, R., O'Reilly, U.-M., Beyer, H.-G., Kendall, G., Wilson, S.W., Harman, M., Wegener, J., Dasgupta, D., Potter, M.A., Schultz, A., Dowsland, K.A., Jonoska, N., Miller, J., Standish, R.K. (eds.) GECCO 2003. LNCS, vol. 2723, Springer, Heidelberg (2003).
[12]
Minaei-Bidgoli, B., Kortemeyer, G., Punch, W.F.: Mining Feature Importance: Applying Evolutionary Algorithms within a Web-Based Educational System. In: Proc. of the Int. Conf. on Cybernetics and Information Technologies, Systems and Applications (2004).
[13]
Parvin, H., Alizadeh, H., Fathi, M., Minaei-Bidgoli, B.: Improved Face Detection Using Spatial Histogram Features. In: Improved Face Detection Using Spatial Histogram Features. The 2008 Int. Conf. on Image Processing, Computer Vision, and Pattern Recognition (IPCV 2008), Las Vegas, Nevada, USA, July 14-17 (2008).
[14]
Punch, W.F., Pei, M., Chia-Shun, L., Goodman, E.D., Hovland, P., Enbody, R.: Further research on Feature Selection and Classification Using Genetic Algorithms. In: 5th International Conference on Genetic Algorithm, Champaign IL, pp. 557-564 (1993).
[15]
Saberi, A., Vahidi, M., Minaei-Bidgoli, B.: Learn to Detect Phishing Scams Using Learning and Ensemble Methods. In: IEEE/WIC/ACM International Conference on Intelligent Agent Technology, Workshops (IAT 2007), Silicon Valley, USA, November 2- 5, vol. 5, pp. 311-314 (2007).
[16]
Vafaie, H., De Jong, K.: Robust feature Selection algorithms. In: Proceeding 1993 IEEE Int. Conf on Tools with AI, Boston, Mass., USA, pp. 356-363 (1993).
[17]
Yang, T.: Computational Verb Decision Trees. International Journal of Computational Cognition, 34-46 (2006).
Index Terms
- A new adaptive framework for classifier ensemble in multiclass large data
Index terms have been assigned to the content through auto-classification.
Recommendations
A heuristic classifier ensemble for huge datasets
AMT'11: Proceedings of the 7th international conference on Active media technologyThis paper proposes a heuristic classifier ensemble to improve the performance of learning in multiclass problems. Although the more accurate classifier leads to a better performance, there is another approach to use many inaccurate classifiers while ...
A scalable heuristic classifier for huge datasets: a theoretical approach
CIARP'11: Proceedings of the 16th Iberoamerican Congress conference on Progress in Pattern Recognition, Image Analysis, Computer Vision, and ApplicationsThis paper proposes a heuristic classifier ensemble to improve the performance of learning in multiclass problems. Although the more accurate classifier leads to a better performance, there is another approach to use many inaccurate classifiers while ...
A hybrid ensemble for classification in multiclass datasets
New hybrid ensemble algorithm for multiclass classification problems is proposed.It uses machine learning algorithms, feature ranking method and an instance filter.Its aim is to improve the performance results of ensemble-Vote.It is tested on four ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
June 2011
728 pages
ISBN:9783642219276
Sponsors
- KSU: Kyushu Sangyo University
- The University of Perugia: The University of Perugia
- Monash University: Monash University
- The University of Basilicata: The University of Basilicata
- University of Cantabria
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 20 June 2011
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 31 Dec 2024