Abstract
Recently, there has been an outburst of interest in extending topographic maps of vectorial data to more general data structures, such as sequences or trees. The representational capabilities and internal representations of the models are not well understood. We concentrate on a generalization of the Self-Organizing Map (SOM) for processing sequential data – the Recursive SOM (RecSOM [1]). We argue that contractive fixed-input dynamics of RecSOM is likely to lead to Markovian organizations of receptive fields on the map. We show that Markovian topographic maps of sequential data can be produced using a simple fixed (non-adaptable) dynamic module externally feeding a standard topographic model designed to process static vectorial data of fixed dimensionality (e.g. SOM). We elaborate upon the importance of non-Markovian organizations in topographic maps of sequential data.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Voegtlin, T.: Recursive self-organizing maps. Neural Networks 15, 979–992 (2002)
Kohonen, T.: Self–organizing formation of topologically correct feature maps. Biological Cybernetics 43, 59–69 (1982)
Yin, H.: ViSOM - a novel method for multivariate data projection and structure visualisation. IEEE Transactions on Neural Networks 13, 237–243 (2002)
de, A., Barreto, G., Araújo, A., Kremer, S.: A taxanomy of spatiotemporal connectionist networks revisited: The unsupervised case. Neural Computation 15, 1255–1320 (2003)
Hammer, B., Micheli, A., Strickert, M., Sperduti, A.: A general framework for unsupervised processing of structured data. Neurocomputing 57, 3–35 (2004)
Chappell, G., Taylor, J.: The temporal kohonen map. Neural Networks 6, 441–445 (1993)
Koskela, T., Heikkonen, J., Varsta, M., Kaski, K.: Recurrent SOM with local linear models in time series prediction. In: 6th European Symposium on Artificial Neural Networks, pp. 167–172 (1998)
Horio, K., Yamakawa, T.: Feedback self-organizing map and its application to spatio-temporal pattern classification. International Journal of Computational Intelligence and Applications 1, 1–18 (2001)
Strickert, M., Hammer, B.: Neural gas for sequences. In: Proceedings of the Workshop on Self-Organizing Maps (WSOM 2003), pp. 53–57 (2003)
Hagenbuchner, M., Sperduti, A., Tsoi, A.: Self-organizing map for adaptive processing of structured data. IEEE Transactions on Neural Networks 14, 491–505 (2003)
Schulz, R., Reggia, J.: Temporally asymmetric learning supports sequence processing in multi-winner self-organizing maps. Neural Computation 16, 535–561 (2004)
Hammer, B., Micheli, A., Sperduti, A., Strickert, M.: Recursive self-organizing network models. Neural Networks 17, 1061–1085 (2004)
Tiňo, P., Čerňanský, M., Beňušková, L.: Markovian architectural bias of recurrent neural networks. IEEE Transactions on Neural Networks 15, 6–15 (2004)
Tiňo, P., Dorffner, G.: Predicting the future of discrete sequences from fractal representations of the past. Machine Learning 45, 187–218 (2001)
Barnsley, M.: Fractals everywhere. Academic Press, New York (1988)
Kohonen, T.: The self-organizing map. Proceedings of the IEEE 78, 1464–1479 (1990)
Wiemer, J.: The time-organized map algorithm: Extending the self-organizing map to spatiotemporal signals. Neural Computation 16, 1143–1171 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tiňo, P., Farkaš, I. (2005). On Non-markovian Topographic Organization of Receptive Fields in Recursive Self-organizing Map. In: Wang, L., Chen, K., Ong, Y.S. (eds) Advances in Natural Computation. ICNC 2005. Lecture Notes in Computer Science, vol 3611. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11539117_96
Download citation
DOI: https://doi.org/10.1007/11539117_96
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28325-6
Online ISBN: 978-3-540-31858-3
eBook Packages: Computer ScienceComputer Science (R0)