Summary
This paper presents a new method for calculating competence of a classifier in the feature space. The idea is based on relating the response of the classifier with the response obtained by a random guessing. The measure of competence reflects this relation and rates the classifier with respect to the random guessing in a continuous manner. Two multiclassifier systems representing fusion and selection strategies were developed using proposed measure of competence. The performance of multiclassifiers was evaluated using five benchmark databases from the UCI Machine Learning Repository and Ludmila Kuncheva Collection. Classification results obtained for three simple fusion methods and one multiclassifier system with selection strategy were used for a comparison. The experimental results showed that, regardless of the strategy used by the multiclassifier system, the classification accuracy has increased when the measure of competence was employed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Asuncion, A., Newman, D.: UCI Machine Learning Repository. University of California, Department of Information and Computer Science, Irvine (2007), http://www.ics.uci.edu/~mlearn/MLRepository.html
Duda, R., Hart, P., Stork, D.: Pattern Classification. Wiley-Interscience, Hoboken (2001)
Freund, Y., Schapire, R.: Experiments with a new boosting algorithm. In: Proceedings of the Thirteenth International Conference on Machine Learning, pp. 148–156 (1996)
Giacinto, G., Roli, F.: Design of effective neural network ensembles for image classification processes. Image Vision and Computing Journal 19, 699–707 (2001)
Kuncheva, L.: Combining Pattern Classifiers. Wiley Interscience, Hoboken (2004)
Kuncheva, L.: Collection, http://www.informatics.bangor.ac.uk/~kuncheva/activities/real_data_full_set.htm
Rastrigin, L.A., Erenstein, R.H.: Method of Collective Recognition. Energoizdat, Moscow (1981)
Woods, K., Kegelmeyer, W.P., Bowyer, K.: Combination of multiple classifiers using local accuracy estimates. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 405–410 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Woloszynski, T., Kurzynski, M. (2009). On a New Measure of Classifier Competence in the Feature Space. In: Kurzynski, M., Wozniak, M. (eds) Computer Recognition Systems 3. Advances in Intelligent and Soft Computing, vol 57. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-93905-4_34
Download citation
DOI: https://doi.org/10.1007/978-3-540-93905-4_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-93904-7
Online ISBN: 978-3-540-93905-4
eBook Packages: EngineeringEngineering (R0)