More Web Proxy on the site http://driver.im/

article

Immune network based ensembles

Authors:

Nicolás García-Pedrajas,

Colin FyfeAuthors Info & Claims

Neurocomputing, Volume 70, Issue 7-9

Pages 1155 - 1166

https://doi.org/10.1016/j.neucom.2006.11.005

Published: 01 March 2007 Publication History

Abstract

This paper presents a new method for constructing ensembles of classifiers based on immune network theory, one of the most interesting paradigms within the field of artificial immune systems. Ensembles of classifiers are a very interesting alternative to single classifiers when facing difficult problems. In general, ensembles are able to achieve better performance in terms of learning and generalisation error. Artificial immune system is a new paradigm within the field of bioinspired algorithms that mimics the behaviour of the natural immune system of animals to develop solutions for a given problem. Within artificial immune systems, one of the most innovative and appealing fields is immune network theory. We construct an immune network that constitutes an ensemble of classifiers. Using a neural network as base classifier we have compared the performance of this ensemble with five standard methods of ensemble construction. This comparison is made using 35 real-world classification problems from the UCI Machine Learning Repository. The results show that the proposed model exhibits a general advantage over the standard methods.

References

[1]

T.W. Anderson, An Introduction to Multivariate Statistical Analysis, second ed., Wiley Series in Probability and Mathematical Statistics, Wiley, New York, 1984.]]

[2]

Bauer, E. and Kohavi, R., An empirical comparison of voting classification algorithms: bagging, boosting and variants. Mach. Learning. v36 i1/2. 105-142.]]

[3]

Breiman, L., Stacked regressions. Mach. Learning. v24 i1. 49-64.]]

[4]

Breiman, L., Bagging predictors. Mach. Learning. v24 i2. 123-140.]]

[5]

Breiman, L., Arcing classifiers. Ann. Stat. v26. 801-824.]]

[6]

Carneiro, J. and Stewart, J., Self and nonself revisited: lessons form modelling the immune network. In: Proceedings of the Third European Conference on Artificial Life, Granada, Spain. pp. 405-420.]]

[7]

Carter, J.H., The immune system as a model for pattern recognition and classification. J. Am. Med. Inf. Assoc. v7 i1. 28-41.]]

[8]

Castro, P., Coelho, G., Caetano, M. and von Zuben, F., Designing ensembles of fuzzy classification systems: an immune approach. In: Jacob, C. (Ed.), Proceedings of the Fourth International Conference on Artificial Immune Systems (ICARIS'2005), Springer, Calgary, Canada. pp. 469-482.]]

[9]

de Castro, L.N. and Timmis, J., Artificial Immune Systems: A New Computational Intelligence Approach. Springer, London.]]

[10]

de Castro, L.N. and Timmis, J., Artificial immune systems as a novel soft computing paradigm. Soft Comput. J. v7 i7.]]

[11]

Dasgupta, D., Artificial Immune Systems and their Applications. Springer, Berlin.]]

[12]

Demšar, J., Statistical comparisons of classifiers over multiple data sets. J. Mach. Learning Res. v7. 1-30.]]

Digital Library

[13]

Dietterich, T.G., Approximate statistical tests for comparing supervised classification learning algorithms. Neural Comput. v10 i7. 1895-1923.]]

[14]

Dietterich, T.G., . In: Ensemble Methods in Machine Learning, Lecture Notes in Computer Science, vol. 1857. Springer, Berlin. pp. 1-15.]]

[15]

Dzeroski, S. and Zenko, B., Is combining classifiers with stacking better than selecting the best one?. Mach. Learning. v54. 255-273.]]

[16]

Farmer, J., Packard, N. and Perelson, A., The immune system. adaptation and machine learning, Physica D. v22. 187-204.]]

[17]

Fern, A. and Givan, R., Online ensemble learning: an empirical study. Mach. Learning. v53. 71-109.]]

[18]

Y. Freund, R. Schapire, Experiments with a new boosting algorithm, in: Proceedings of the 13 International Conference on Machine Learning, Bari, Italy, 1996, pp. 148-156.]]

[19]

García-Pedrajas, N. and Fyfe, C., Immune network based ensembles. In: Proceedings of the 14th European Symposium on Artificial Neural Networks, Bruges, Belgium. pp. 437-442.]]

[20]

N. García-Pedrajas, C. Fyfe, Construction of classifier ensembles by means of artificial immune systems, J. Heuristics, in press.]]

[21]

N. García-Pedrajas, C. Fyfe, Nonlinear "boosting" projections for ensemble construction, J. Mach. Learning Res., accepted.]]

[22]

García-Pedrajas, N., Hervás-Martínez, C. and Muñoz-Pérez, J., Covnet: a cooperative coevolutionary model for evolving artificial neural networks. IEEE Trans. Neural Networks. v14 i3. 575-596.]]

[23]

García-Pedrajas, N., Hervás-Martínez, C. and Ortiz-Boyer, D., Cooperative coevolution of artificial neural network ensembles for pattern classification. IEEE Trans. Evol. Comput. v9 i3. 271-302.]]

[24]

Garret, S.M., How do we evaluate artificial immune systems?. Evol. Comput. v13 i2. 145-178.]]

[25]

L. Hall, K. Bowyer, R. Banfield, D. Bhadoria, W. Kegelmeyer, S. Eschrich, Comparing pure parallel ensemble creation techniques against bagging, in: Third IEEE International Conference on Data Mining, Melbourne, FL, USA, 2003, pp. 533-536.]]

[26]

E. Hart, P. Ross, Exploiting the analogy between immunology and spares distributed memories: a system for clustering non-stationary data, in: First International Conference on Artificial Immune Systems, Canterbury, UK, 2002, pp. 49-58.]]

[27]

Haykin, S., Neural Networks-A Comprehensive Foundation. second ed. Prentice-Hall, Upper Saddle River, NJ.]]

[28]

S. Hettich, C. Blake, C. Merz, UCI repository of machine learning databases, {http://www.ics.uci.edu/~mlearn/MLRepository.html}, 1998.]]

[29]

Ho, T.K., The random subspace method for constructing decision forests. IEEE Trans. Pattern Anal. Mach. Intell. v20 i8. 832-844.]]

[30]

Jerne, K.N., Towards a network theory of the immune system. Ann. Immunol. v125C. 373-389.]]

[31]

Kleinberg, E., On the algorithmic implementation of stochastic discrimination. IEEE Trans. Pattern Anal. Mach. Intell. v22 i5. 473-490.]]

[32]

Kuncheva, L.I., Combining classifiers: soft computing solutions. In: Pal, S.K., Pal, A. (Eds.), Pattern Recognition: From Classical to Modern Approaches, World Scientific, Singapore. pp. 427-451.]]

[33]

Liu, Y., Yao, X. and Higuchi, T., Evolutionary ensembles with negative correlation learning. IEEE Trans. Evolutionary Comput. v4 i4. 380-387.]]

[34]

Merz, C.J., Using correspondence analysis to combine classifiers. Mach. Learning. v36 i1. 33-58.]]

[35]

Moriarty, D.E. and Miikkulainen, R., Forming neural networks through efficient and adaptive coevolution. Evol. Comput. v4 i5. 373-399.]]

[36]

Munro, R., Ler, D. and Patrick, J., Meta-learning orthographic and contextual models for language independent named entity recognition. In: Proceedings of the Seventh Conference on Natural Language Learning, pp. 192-195.]]

[37]

Ortiz-Boyer, D., Hervás-Martínez, C. and García-Pedrajas, N., Cixl2: a crossover operator for evolutionary algorithms based on population features. J. Artif. Intell. Res. v24. 33-80.]]

[38]

Perelson, A., Immune network theory. Immunol. Rev. v110. 5-36.]]

[39]

Perrone, M.P. and Cooper, L.N., When networks disagree: ensemble methods for hybrid neural networks. In: Mammone, R.J. (Ed.), Neural Networks for Speech and Image Processing, Chapman & Hall, London. pp. 126-142.]]

[40]

M. Skurichina, R.P.W. Duin, Bagging and the random subspace method for redundant feature spaces, in: J. Kittler, R. Poli (Eds.), Proceedings of the Second International Workshop on Multiple Classifier Systems MCS 2001, Cambridge, UK, 2001, pp. 1-10.]]

[41]

Vapnik, V., The Nature of Statistical Learning Theory. Springer, New York.]]

[42]

Webb, G.I., Multiboosting: a technique for combining boosting and wagging. Mach. Learning. v40 i2. 159-196.]]

[43]

Wilcoxon, F., Individual comparisons by ranking methods. Biometrics. v1. 80-83.]]

[44]

Yao, X. and Liu, Y., A new evolutionary system for evolving artificial neural networks. IEEE Trans. Neural Networks. v8 i3. 694-713.]]

[45]

Zhang, X., Wang, S., Shan, T. and Jiao, L., Selective svms ensemble driven by immune clonal algorithm. In: Rothlauf, F. (Ed.), Proceedings of EvoWorkshops, Springer, Berlin. pp. 325-333.]]

[46]

Zhou, Z.-H., Wu, J. and Tang, W., Ensembling neural networks: many could be better than all. Artif. Intell. v137 i1-2. 239-253.]]

Cited By

García-Pedrajas NGarcía-Osorio C(2011)Constructing ensembles of classifiers using supervised projection methods based on misclassified instancesExpert Systems with Applications: An International Journal10.1016/j.eswa.2010.06.07238:1(343-359)Online publication date: 1-Jan-2011
https://dl.acm.org/doi/10.1016/j.eswa.2010.06.072
Tian JLi MChen F(2010)Dual-population based coevolutionary algorithm for designing RBFNN with feature selectionExpert Systems with Applications: An International Journal10.1016/j.eswa.2010.03.03137:10(6904-6918)Online publication date: 1-Oct-2010
https://dl.acm.org/doi/10.1016/j.eswa.2010.03.031
Jinying ABo BHaojing C(2009)Design of vehicle speed controller based on immune feed-backProceedings of the 18th international conference on Fuzzy Systems10.5555/1717561.1717740(1033-1037)Online publication date: 20-Aug-2009
https://dl.acm.org/doi/10.5555/1717561.1717740
Show More Cited By

Index Terms

Immune network based ensembles

Recommendations

Construction of classifier ensembles by means of artificial immune systems

This paper presents the application of Artificial Immune Systems to the design of classifier ensembles. Ensembles of classifiers are a very interesting alternative to single classifiers when facing difficult problems. In general, ensembles are able to ...
Incremental construction of classifier and discriminant ensembles

We discuss approaches to incrementally construct an ensemble. The first constructs an ensemble of classifiers choosing a subset from a larger set, and the second constructs an ensemble of discriminants, where a classifier is used for some classes only. ...
Optimal resampling and classifier prototype selection in classifier ensembles using genetic algorithms

Ensembles of classifiers that are trained on different parts of the input space provide good results in general. As a popular boosting technique, AdaBoost is an iterative and gradient based deterministic method used for this purpose where an exponential ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Neurocomputing

Neurocomputing Volume 70, Issue 7-9

March, 2007

478 pages

ISSN:0925-2312

Issue’s Table of Contents

Copyright © Elsevier B.V. © 2007.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 March 2007

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

García-Pedrajas NGarcía-Osorio C(2011)Constructing ensembles of classifiers using supervised projection methods based on misclassified instancesExpert Systems with Applications: An International Journal10.1016/j.eswa.2010.06.07238:1(343-359)Online publication date: 1-Jan-2011
https://dl.acm.org/doi/10.1016/j.eswa.2010.06.072
Tian JLi MChen F(2010)Dual-population based coevolutionary algorithm for designing RBFNN with feature selectionExpert Systems with Applications: An International Journal10.1016/j.eswa.2010.03.03137:10(6904-6918)Online publication date: 1-Oct-2010
https://dl.acm.org/doi/10.1016/j.eswa.2010.03.031
Jinying ABo BHaojing C(2009)Design of vehicle speed controller based on immune feed-backProceedings of the 18th international conference on Fuzzy Systems10.5555/1717561.1717740(1033-1037)Online publication date: 20-Aug-2009
https://dl.acm.org/doi/10.5555/1717561.1717740
Zhang CYi Z(2009)Tree structured artificial immune network with self-organizing reaction operatorNeurocomputing10.1016/j.neucom.2009.08.00773:1-3(336-349)Online publication date: 1-Dec-2009
https://dl.acm.org/doi/10.1016/j.neucom.2009.08.007
Luengo JGarcía SHerrera F(2009)A study on the use of statistical tests for experimentation with neural networksExpert Systems with Applications: An International Journal10.1016/j.eswa.2008.11.04136:4(7798-7808)Online publication date: 1-May-2009
https://dl.acm.org/doi/10.1016/j.eswa.2008.11.041
Gong MJiao LZhang X(2008)A population-based artificial immune system for numerical optimizationNeurocomputing10.1016/j.neucom.2007.12.04172:1-3(149-161)Online publication date: 1-Dec-2008
https://dl.acm.org/doi/10.1016/j.neucom.2007.12.041
Ding YHu ZSun H(2008)An antibody network inspired evolutionary framework for distributed object computingInformation Sciences: an International Journal10.1016/j.ins.2008.08.010178:24(4619-4631)Online publication date: 1-Dec-2008
https://dl.acm.org/doi/10.1016/j.ins.2008.08.010
Georgiou VAlevizos PVrahatis M(2008)Novel Approaches to Probabilistic Neural Networks Through Bagging and Evolutionary Estimating of Prior ProbabilitiesNeural Processing Letters10.1007/s11063-007-9066-527:2(153-162)Online publication date: 1-Apr-2008
https://dl.acm.org/doi/10.1007/s11063-007-9066-5

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents