A Recurrent Multimodal Network for Binding Written Words and Sensory-Based Semantics into Concepts

1. Bright, P., Moss, H.E., Tyler, L.K.: Unitary vs multiple semantics: PET studies of word and picture processing. Cerebral Cortex 89, 417–432 (2004)

   Google Scholar 

2. Chou, S., Papliński, A.P., Gustafsson, L.: Speaker-dependent bimodal integration of Chinese phonemes and letters using multimodal self-organizing networks. In: Proc. Int. Joint Conf. Neural Networks, Orlando, Florida (August 2007)

   Google Scholar 

3. Davis, C.J., Bowers, J.S.: Contrasting five different theories of letter position coding: Evidence from orthographic similarity effects. J. Exp. Psych.: Human Perception and Performance 32(3), 535–557 (2006)

   Google Scholar 

4. Dehaene, S.: Reading in the Brain. Viking (2009), http://pagesperso-orange.fr/readinginthebrain/figures.htm

5. Glezer, L.S., Jiang, X., Riesenhuber, M.: Evidence for highly selective neuronal tuning to whole words in the “Visual Word Form Area”. Neuron 62(2), 199–204 (2009)

   Article  Google Scholar 

6. Gliozzi, V., Mayor, J., Hu, J.F., Plunkett, K.: Labels as features (not names) for infant categorisation: A neuro-computational approach. Cog. Sci. 33(3), 709–738 (2009)

   Article  Google Scholar 

7. Graboi, D., Lisman, J.: Recognition by top-down and bottom-up processing in cortex: The control of selective attention. J. Neurophysiol. 90, 798–810 (2003)

   Article  Google Scholar 

8. Grainger, J.: Cracking the orthographic code: An introduction. Language and Cogn. Processes 23(1), 1–35 (2007)

   Article  MathSciNet  Google Scholar 

9. Jantvik, T., Gustafsson, L., Papliński, A.P.: A self-organized artificial neural network architecture for sensory integration with applications to letter–phoneme integration. Neural Computation, 1–39 (2011), doi:10.1162/NECO_a_00149

   Google Scholar 

10. Kohonen, T.: Self-Organising Maps, 3rd edn. Springer, Berlin (2001)

    Book  MATH  Google Scholar 

11. Li, P., Zhao, X., MacWhinney, B.: Dynamic self-organization and early lexical development in children. Neuron 31, 581–612 (2007)

    Google Scholar 

12. Mayor, J., Plunkett, K.: A neurocomputational account of taxonomic responding and fast mapping in early word learning. Psychol. Rev. 117(1), 1–31 (2010)

    Article  Google Scholar 

13. McCandliss, B.D., Cohen, L., Dehaene, S.: The visual word form area: expertise for reading in the fusiform gyrus. TRENDS Cog. Sci. 7(7), 293–299 (2003)

    Article  Google Scholar 

14. Miikkulainen, R.: Dyslexic and category-specific aphasic impairments in a self-organizing feature map model of the lexicon. Brain and Language, 334–366 (1997), http://nn.cs.utexas.edu/miikkulainen:bl97

15. Miikkulainen, R., Kiran, S.: Modeling the Bilingual Lexicon of an Individual Subject. In: Príncipe, J.C., Miikkulainen, R. (eds.) WSOM 2009. LNCS, vol. 5629, pp. 191–199. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

16. Monner, D., Reggia, J.A.: An unsupervised learning method for representing simple sentences. In: Proc. Int. Joint Conf. Neural Net., Atlanta, USA, pp. 2133–2140 (June 2009)

    Google Scholar 

17. Noppeney, U., Josephs, O., Hocking, J., Price, C., Friston, K.: The effect of prior visual information on recognition of speech and sounds. Cerebral Cortex 18, 598–609 (2008)

    Article  Google Scholar 

18. Papliński, A.P., Gustafsson, L.: Feedback in Multimodal Self-organizing Networks Enhances Perception of Corrupted Stimuli. In: Sattar, A., Kang, B.-h. (eds.) AI 2006. LNCS (LNAI), vol. 4304, pp. 19–28. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

19. Papliński, A.P., Gustafsson, L., Mount, W.M.: A model of binding concepts to spoken names. Aust. Journal of Intelligent Information Processing Systems 11(2), 1–5 (2010)

    Google Scholar 

20. Whitney, C.: Comparison of the SERIOL and SOLAR theories of letter-position encoding. Brain and Language 107, 170–178 (2008)

    Article  Google Scholar 

Download references