Abstract
This work suggests two ways of looking at classifier systems; as Genetic Algorithm-based systems, and as Reinforcement Learning-based systems, and argues that the former is more suitable for traditional strength-based systems while the latter is more suitable for accuracy-based XCS. The dissociation of the Genetic Algorithm from policy determination in XCS is noted.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Manu Ahluwalia and Larry Bull. A Genetic Programming-based Classifier System. In J. Daida, A.E. Eiben, M.H. Garzon, V. Honavar, M. Jakiela, and R.E. Smith, editors. GECCO-99: Proceedings of the Genetic and Evolutionary Computation Conference. Morgan Kaufmann, 1999 Banzhaf et al. [2]}, pages 11–18.
W. Banzhaf, J. Daida, A.E. Eiben, M.H. Garzon, V. Honavar, M. Jakiela, and R.E. Smith, editors. GECCO-99: Proceedings of the Genetic and Evolutionary Computation Conference. Morgan Kaufmann, 1999.
Alwyn Barry. XCS Performance and Population Structure within Multiple-Step Environments. PhD thesis, Queens University Belfast, 2000.
Lashon B. Booker. Improving the performance of genetic algorithms in classifier systems. In John J. Grefenstette, editor, Proceedings of the 1st International Conference on Genetic Algorithms and their Applications (ICGA-85), pages 80–92, Pittsburgh, PA, July 1985. Lawrence Erlbaum Associates.
Martin Butz, David E. Goldberg, and Wolfgang Stolzmann. New challenges for an ACS: Hard problems and possible solutions. Technical Report 99019, University of Illinois at Urbana-Champaign, Urbana, IL, October 1999.
Martin Butz and Wolfgang Stolzmann. Action-Planning in Anticipatory Classifier Systems. In Wu [43], pages 242–249.
Martin V. Butz, David E. Goldberg, and Wolfgang Stolzmann. Probability-enhanced predictions in the anticipatory classifier system. In Proceedings of the International Workshop on Learning Classifier Systems (IWLCS-2000), in the Joint Workshops of SAB 2000 and PPSN 2000, 2000.
Martin V. Butz and Stewart W. Wilson. An Algorithmic Description of XCS. In Pier Luca Lanzi, Wolfgang Stolzmann, and Stewart W. Wilson, editors, Advances in Learning Classifier Systems, number 1996 in LNAI, pages 253–272. Springer-Verlag, 2001.
Henry Brown Cribbs III and Robert E. Smith. What Can I do with a Learning Classifier System? In C. Karr and L.M. Freeman, editors, Industrial Applications of Genetic Algorithms, pages 299–320. CRC Press, 1998.
David E. Goldberg. Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, Reading, MA, 1989.
John H. Holland. Adaptation. In R. Rosen and F.M. Snell, editors, Progress in theoretical biology. New York: Plenum, 1976.
John H. Holland. Properties of the bucket brigade. In John J. Grefenstette, editor, Proceedings of the 1st International Conference on Genetic Algorithms and their Applications, pages 1–7, Pittsburgh, PA, July 1985. Lawrence Erlbaum Associates.
John H. Holland, Lashon B. Booker, Marco Colombetti, Marco Dorigo, David E. Goldberg, Stephanie Forrest, Rick L. Riolo, Robert E. Smith, Pier Luca Lanzi, Wolfgang Stolzmann, and Stewart W. Wilson. What is a Learning Classifier System? In Wolfgang Stolzmann, and Stewart W. Wilson, editors. Learning Classifier Systems. From Foundations to Applications, volume 1813 of LNAI. Springer-Verlag, Berlin, 2000 Lanzi et al. [17]}, pages 3–32.
John H. Holland and J.S. Reitman. Cognitive systems based on adaptive algorithms. In D.A. Waterman and F. Hayes-Roth, editors, Pattern-directed inference systems. New York: Academic Press, 1978. Reprinted in: Evolutionary Computation. The Fossil Record. David B. Fogel (Ed.) IEEE Press, 1998. ISBN: 0-7803-3481-7.
Tim Kovacs. A Comparison of Strength and Accuracy-Based Fitness in Learning Classifier Systems. PhD thesis, School of Computer Science, University of Birmingham, 2001.
Pier Luca Lanzi. Extending the Representation of Classifier Conditions Part II: From Messy Coding to S-Expressions. In J. Daida, A.E. Eiben, M.H. Garzon, V. Honavar, M. Jakiela, and R.E. Smith, editors. GECCO-99: Proceedings of the Genetic and Evolutionary Computation Conference. Morgan Kaufmann, 1999 Banzhaf et al. [2]}, pages 345–352.
Pier Luca Lanzi, Wolfgang Stolzmann, and Stewart W. Wilson, editors. Learning Classifier Systems. From Foundations to Applications, volume 1813 of LNAI. Springer-Verlag, Berlin, 2000.
Rick L. Riolo. Bucket Brigade Performance: I. Long Sequences of Classifiers. In Proceedings Second International Conference on Genetic Algorithms (ICGA-87), pages 184–195. Lawrence Erlbaum Associates, 1987.
Rick L. Riolo. The emergence of coupled sequences of classifiers. In Schaffer [20], pages 256–264.
J. David Schaffer, editor. Proceedings of the 3rd International Conference on Genetic Algorithms (ICGA-89), George Mason University, June 1989. Morgan Kaufmann.
Robert E. Smith. A Report on The First International Workshop on Learning Classifier Systems (IWLCS-92). NASA Johnson Space Center, Houston, Texas, Oct. 6–9, 1992.
Robert E. Smith. Derivative Methods: Learning Classifier Systems. In Thomas Bäck, David B. Fogel, and Zbigniew Michalewicz, editors, Handbook of Evolutionary Computation, pages B1.2:6–B1.5:11. Institute of Physics Publishing and Oxford University Press, 1997. http://www.iop.org/Books/Catalogue/
Robert E. Smith, B.A. Dike, B. Ravichandran, A. El-Fallah, and R.K. Mehra. The Fighter Aircraft LCS: A Case of Different LCS Goals and Techniques. In Wolfgang Stolzmann, and Stewart W. Wilson, editors. Learning Classifier Systems. From Foundations to Applications, volume 1813 of LNAI. Springer-Verlag, Berlin, 2000 Lanzi et al. [17]}, pages 283–300.
S.F. Smith. A Learning System Based on Genetic Adaptive Algorithms. PhD thesis, University of Pittsburgh, 1980.
S.F. Smith. Flexible Learning of Problem Solving Heuristics through Adaptive Search. In Proceedings Eight International Joint Conference on Artificial Intelligence, pages 422–425, 1983.
S.F. Smith. Adaptive learning systems. In R. Forsyth, editor, Expert systems: Principles and case studies, pages 169–189. Chapman and Hall, 1984.
Wolfgang Stolzmann. Learning classifier systems using the cognitive mechanism of anticipatory behavioral control, detailed version. In Proceedings of the First European Workshop on Cognitive Modelling, pages 82–89. Berlin: TU, 1996.
Wolfgang Stolzmann. Antizipative Classifier Systeme. PhD thesis, Fachbereich Mathematik/Informatik, University of Osnabrück, 1997.
Wolfgang Stolzmann. Two Applications of Anticipatory Classifier Systems (ACSs). In Proceedings of the 2nd European Conference on Cognitive Science, pages 68–73. Manchester, U.K., 1997.
Wolfgang Stolzmann. Anticipatory classifier systems. In Proceedings of the Third Annual Genetic Programming Conference, pages 658–664. Morgan Kaufmann, 1998.
Wolfgang Stolzmann. Latent Learning in Khepera Robots with Anticipatory Classifier Systems. In Wu [43], pages 290–297.
Wolfgang Stolzmann. An Introduction to Anticipatory Classifier Systems. In Wolfgang Stolzmann, and Stewart W. Wilson, editors. Learning Classifier Systems. From Foundations to Applications, volume 1813 of LNAI. Springer-Verlag, Berlin, 2000 Lanzi et al. [17]}, pages 175–194.
Wolfgang Stolzmann and Martin Butz. Latent Learning and Action-Planning in Robots with Anticipatory Classifier Systems. In Wolfgang Stolzmann, and Stewart W. Wilson, editors. Learning Classifier Systems. From Foundations to Applications, volume 1813 of LNAI. Springer-Verlag, Berlin, 2000 Lanzi et al. [17]}, pages 301–317.
Wolfgang Stolzmann, Martin Butz, J. Hoffmann, and D. E. Goldberg. First cognitive capabilities in the anticipatory classifier system. In J. A. Meyer et al., editor, From Animals to Animats 6: Proceedings of the Sixth International Conference on Simulation of Adaptive Behavior, pages 287–296, 2000. Also Technical Report 2000008 of the Illinois Genetic Algorithms Laboratory.
Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
Andy Tomlinson and Larry Bull. A Corporate Classifier System. In A. E. Eiben, T. Bäck, M. Shoenauer, and H.-P. Schwefel, editors, Proceedings of the Fifth International Conference on Parallel Problem Solving From Nature-PPSN V, volume 1498 of Lecture Notes in Computer Science, pages 550–559. Springer Verlag, 1998.
Patrick Tufts. Evolution of a Clustering Scheme for Classifier Systems: Beyond the Bucket Brigade. PhD Thesis proposal, 1994.
Patrick Tufts. Dynamic Classifiers: Genetic Programming and Classifier Systems. In E. V. Siegel and J. R. Koza, editors, Working Notes for the AAAI Symposium on Genetic Programming, pages 114–119, MIT, Cambridge, MA, USA, 1995. AAAI.
Stewart W. Wilson. ZCS: A Zeroth Level Classifier System. Evolutionary Computation, 2(1):1–18, 1994.
Stewart W. Wilson. Classifier Fitness Based on Accuracy. Evolutionary Computation, 3(2):149–175, 1995.
Stewart W. Wilson. Personal communication to Alwyn Barry and Tim Kovacs. June 12, 1998.
Stewart W. Wilson and David E. Goldberg. A Critical Review of Classifier Systems. In Schaffer [20], pages 244–255.
Annie S. Wu, editor. Proceedings of the 1999 Genetic and Evolutionary Computation Conference Workshop Program, 1999.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kovacs, T. (2002). Two Views of Classifier Systems. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds) Advances in Learning Classifier Systems. IWLCS 2001. Lecture Notes in Computer Science(), vol 2321. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48104-4_6
Download citation
DOI: https://doi.org/10.1007/3-540-48104-4_6
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43793-2
Online ISBN: 978-3-540-48104-1
eBook Packages: Springer Book Archive