[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article
Open access

Analysing neurobiological models using communicating automata

Published: 01 November 2014 Publication History

Abstract

Two important issues in computational modelling in cognitive neuroscience are: first, how to formally describe neuronal networks (i.e. biologically plausible models of the central nervous system), and second, how to analyse complex models, in particular, their dynamics and capacity to learn. We make progress towards these goals by presenting a communicating automata perspective on neuronal networks. Specifically, we describe neuronal networks and their biological mechanisms using Data-rich Communicating Automata, which extend classic automata theory with rich data types and communication. We use two case studies to illustrate our approach. In the first case study, we model a number of learning frameworks, which vary in respect of their biological detail, for instance the Backpropagation (BP) and the Generalized Recirculation (GeneRec) learning algorithms. We then used the SPIN model checker to investigate a number of behavioral properties of the neural learning algorithms. SPIN is a well-known model checker for reactive distributed systems, which has been successfully applied to many non-trivial problems. The verification results show that the biologically plausible GeneRec learning is less stable than BP learning. In the second case study, we presented a large scale (cognitive-level) neuronal network, which models an attentional spotlight mechanism in the visual system. A set of properties of this model was verified using Uppaal, a popular real-time model checker. The results show that the asynchronous processing supported by concurrency theory is not only a more biologically plausible way to model neural systems, but also provides a better performance in cognitive modelling of the brain than conventional artificial neural networks that use synchronous updates. Finally, we compared our approach with several other related theories that apply formal methods to cognitive modelling. In addition, the practical implications of the approach are discussed in the context of neuronal network based controllers.

References

References

[1]
Aisa B, Mingus B, and O’Reilly R The emergent neural modeling system Neural Netw 2008 21 1146-1152
[2]
Arik S Global robust stability of delayed neural networks IEEE Trans Circuits Syst I Fundam Theory Appl 2003 50 156-160
[3]
Artho C, Drusinsky D, Goldberg A, Havelund K, Lowry M, Pasareanu C, Rosu G, Visser W (2003) Experiments with test case generation and runtime analysis. In: Proceedings of the abstract state machines (ASM’03). Lecture notes in computer science, vol 2589, pp 87–107
[4]
Bakker R, Schouten JC, Giles CL, Takens F, and van den Bleek CM Learning chaotic attractors by neural networks Neural Comput 2000 12 2355-2383
[5]
Barringer H, Goldberg A, Havelund K, Sen K (2004) Rule-based runtime verification. In: Proceedings of the 5th international conference on verification, model checking and abstract interpretation. Lecture Notes in Computer Science, vol 2937, pp 44–57
[6]
Barnard P (1985) Interacting cognitive subsystems: a psycholinguistic approach to short-term memory. In: Ellis A (ed) Progress in the psychology of language, vol 2, pp 197–258. Lawrence Erlbaum Associates Ltd., Hove
[7]
Barringer H, Goldberg A, Havelund K, Sen K (2004) Rule-based runtime verification. In: Proceedings of the 5th international conference on verification, model checking and abstract interpretation. Lecture Notes in Computer Science, vol 2937, pp 44–57
[8]
Behrmann G, David A, Larsen KG (2004) A tutorial on Uppaal. In: Proceedings of the 4th international school on formal methods for the design of computer, communication, and software systems (SFM-RT’04). Lecture notes in computer science, vol 3185, pp 200–236
[9]
Bengtsson J, Larsen KG, Larsson F, Pettersson P, Yi W (1995) UPPAAL—a tool suite for automatic verification of real-time systems. Hybrid Syst 232–243
[10]
Boly M, Garrido MI, Gosseries O, Bruno MA, Boveroux P, Schnakers C, Massimini M, Litvak V, Laureys S, and Friston K Preserved feedforward but impaired top–down processes in the vegetative state Science 2011 13 858-862
[11]
Bolognesi T and Brinksma E Introduction to the ISO specification language LOTOS Comput Netw ISDN Syst 1988 14910 25-29
[12]
Bowman H and Faconti G Analysing cognitive behaviour using LOTOS and Mexitl Form Asp Comput 1999 11 2 132-159
[13]
Bowman H, Derrick J (eds) (2001) Formal methods for distributed processing, a survey of object oriented approaches. Cambridge University Press, Cambridge
[14]
Bowman H, Steen MWA, Boiten EA, and Derrick J A formal framework for viewpoint consistency Form Methods Syst Des 2002 21 2 111-166
[15]
Bowman H, Gomez RS (2006) Concurrency theory, calculi and automata for modelling untimed and timed concurrent systems. Springer, New York
[16]
Bowman H and Wyble B The simultaneous type, serial token model of temporal attention and working memory Psychol Rev 2007 114 1 38-70
[17]
Bowman H, Wyble B, Chennu S, and Craston P A reciprocal relationship between bottom-up trace strength and the attentional blink bottleneck: relating the LC-NE and ST2 models Brain Res 2008 1202 25-42
[18]
Clarke EM, Grumberg O, Peled DA (2000) Model Checking. The MIT Press, Cambridge
[19]
Attwell D and Laughlin SB An energy budget for signaling in the grey matter of the brain J Cereb Blood Flow Metab 2001 21 1133-1145
[20]
Derrick J, Boiten E (2001) Refinement in Z and object-Z: foundations and advanced applications. Springer, Berlin
[21]
Desimone R and Duncan J Neural mechanism of selective visual attention Annu Rev Neurosc 1995 18 193-222
[22]
Dibner C, Schibler U, and Albrecht U The mammalian circadian timing system: organization and coordination of central and peripheral clocks Annu Rev Physiol 2010 72 517-549
[23]
Fodor JA and Pylyshyn ZW Connectionism and cognitive architecture: a critical analysis Cognition 1988 28 3-71
[24]
Friston KJ The labile brain. I. Neuronal transients and nonlinear coupling Philos Trans R Soc B Biol Sci 2000 355 1394 215-236
[25]
Friston KJ The labile brain. II. Transients, complexity and selection Philos Trans R Soc B Biol Sci 2000 355 1394 237-252
[26]
Friston KJ The labile brain. III. Transients and spatio-temporal receptive fields Philos Trans R Soc B Biol Sci 2000 355 1394 253-265
[27]
Garcez AS, Broda KB, Gabbay DM (2002) Neural-symbolic learning systems, foundations and applications. Springer, New York
[28]
Giannakopoulou D, Pasareanu C, Barringer H (2002) Assumption generation for software component verification. In: Proceedings of the 17th IEEE international conference on automated software engineering, pp 3–12
[29]
Grossberg S Adaptive pattern classification and universal recoding, I: parallel development and coding of neural feature detectors Biol Cybern 1976 23 121-134
[30]
Grossberg S Adaptive resonance theory: how a brain learns to consciously attend, learn, and recognize a changing world Neural Netw 2012 37 1-47
[31]
Hamey LGC XOR has no local minima: a case study in neural network error surface analysis Neural Netw 1998 11 669-681
[32]
Havelund K, Lowry M, Park S, Pecheur C, Penix J, Visser W, White JL (2000) Formal analysis of the remote agent before and after flight. In: Proceedings of 5th NASA Langley formal methods workshop, pp 13–15
[33]
Henzinger TA, Nicollin X, Sifakis J, and Yovine S Symbolic model checking for real-time systems Inf Comput 1994 111 2 193-244
[34]
Hodgkin A and Huxley A A quantitative description of membrane current and its application to conduction and excitation in nerve J Physiol 1952 117 500-544
[35]
Holzmann G (2003) The SPIN model checker: primer and reference manual. Addison-Wesley, Boston
[36]
Kiczales G, Lamping J, Mendhekar A, Maeda C, Lopes CV, Loingtier JM, Irwin J (1997) Aspect-oriented programming. In: Lecture notes in computer science, vol 1241. Springer-Verlag, New York
[37]
Kolen JF, Pollack JB (1991) Back propagation is sensitive to initial conditions. In Lippmann RP, Moody JE, Touretzky DS (eds) Advances in neural information processing systems, vol 3, pp 860–867
[38]
Liljenström H (1994) Cognition, neurodynamics, and computer models. Connectionism in a broad perspective. Ellis Horwood, Chichester
[39]
McMillan KL (1993) Symbolic model checking. Springer, New York
[40]
Menzies T and Pecheur C Verification and validation and artificial intelligence Adv Comput 2005 65 154-203
[41]
Moller F, Tofts CMN (1990) A temporal calculus of communicating systems. In: CONCUR’90, pp 401–415
[42]
Napolitano MR, Molinaro G, Innocenti M, Seanor B, Martinelli D (1999) A complete hardware package for a fault-tolerant flight control system using on-line learning neural networks. In: Proceedings of the American Control Conference, pp 2615–2619
[43]
Nieuwenhuis S, Gilzenrat MS, Holmes BD, and Cohen JD The role of the locus coeruleus in mediating the attentional blink: a neurocomputational theory J Exp Psychol Gen 2005 134 291-307
[44]
Olshausen BA and Field DJ Sparse coding with an overcomplete basis set: a strategy employed by V1? Vis Res 1997 37 23 3311-3325
[45]
O’Reilly RC Biologically plausible error-driven learning using local activation differences: the generalized recirculation algorithm Neural Comput 1996 8 895-938
[46]
O’Reilly RC, Munakata Y (2000) Computational explorations in cognitive neuroscience: understanding the mind by simulating the brain. MIT Press, Cambridge
[47]
Pnueli A (1977) The temporal logic of programs. In: Proceedings of the 18th IEEE symposium foundations of computer science, FOCS 1977, pp 46–57
[48]
Rodrigues P, Costa JF, Siegelmann HT (2001) Verifying properties of neural networks. Artificial and natural neural networks. In: Lecture notes in computer science, vol 2084, pp 158–165, Springer, New York
[49]
Rolls ET, Deco G (2002) Computational neuroscience of vision. Oxford University Press, Oxford
[50]
Roscoe AW (1998) The theory and practice of concurrency. Prentice-Hall, London
[51]
Rukše̱nas R, Back RJ, Curzon P, and Blandford A Verification-guided modelling of salience and cognitive load Form Asp Comput 2009 21 541-569
[52]
Smith LS A framework for neural net specification IEEE Trans Softw Eng 1992 18 7 601-612
[53]
Sprinkhuizen-Kuyper IG and Boers EJW The error surface of the simplest XOR network has only global minima Neural Comput 1996 8 1301-1320
[54]
Su L, Bowman H, Barnard PJ (2007) Attentional capture by meaning, a multi-level modelling study. In: Proceedings of 29th annual meeting of the Congitive Science Society, Nashville, pp 1521–1526
[55]
Su L, Bowman H, Barnard PJ, and Wyble B Process algebraic modelling of attentional capture and human electrophysiology in interactive systems Form Asp Comput 2009 21 6 513-539
[56]
Su L, Bowman H, Barnard P (2011) Glancing and then looking: on the role of body, affect, and meaning in cognitive control. Front Psychol 2:348
[57]
Sutherland RJ and Rudy JW Configural association theory: the role of the hippocampal formation in learning, memory, and amnesia Psychobiology 1989 17 2 129-144
[58]
Tipper SP, Driver J, and Weaver B Object-centred inhibition of return of visual attention Q J Exp Psychol A 1991 43 289-298

Cited By

View all
  • (2023)Is predictive coding falsifiable?Neuroscience & Biobehavioral Reviews10.1016/j.neubiorev.2023.105404154(105404)Online publication date: Nov-2023
  • (2022)Gradient-Free Neural Network Training via Synaptic-Level Reinforcement LearningAppliedMath10.3390/appliedmath20200112:2(185-195)Online publication date: 12-Apr-2022
  • (2019)Symbolic Modeling of Asynchronous Neural Dynamics Reveals Potential Synchronous Roots for the Emergence of AwarenessFrontiers in Computational Neuroscience10.3389/fncom.2019.0000113Online publication date: 12-Feb-2019
  • Show More Cited By

Index Terms

  1. Analysing neurobiological models using communicating automata
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image Formal Aspects of Computing
        Formal Aspects of Computing  Volume 26, Issue 6
        Nov 2014
        190 pages
        ISSN:0934-5043
        EISSN:1433-299X
        Issue’s Table of Contents

        Publisher

        Springer-Verlag

        Berlin, Heidelberg

        Publication History

        Published: 01 November 2014
        Accepted: 18 December 2013
        Revision received: 23 September 2013
        Received: 03 June 2011
        Published in FAC Volume 26, Issue 6

        Author Tags

        1. Neuronal networks
        2. Communicating automata
        3. Model checking
        4. Backpropagation
        5. Generalized recirculation algorithm
        6. Plasticity–stability dilemma
        7. Visual attention
        8. Cognitive neuroscience
        9. AI
        10. SPIN
        11. PROMELA
        12. Uppaal

        Qualifiers

        • Research-article

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)39
        • Downloads (Last 6 weeks)3
        Reflects downloads up to 19 Dec 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2023)Is predictive coding falsifiable?Neuroscience & Biobehavioral Reviews10.1016/j.neubiorev.2023.105404154(105404)Online publication date: Nov-2023
        • (2022)Gradient-Free Neural Network Training via Synaptic-Level Reinforcement LearningAppliedMath10.3390/appliedmath20200112:2(185-195)Online publication date: 12-Apr-2022
        • (2019)Symbolic Modeling of Asynchronous Neural Dynamics Reveals Potential Synchronous Roots for the Emergence of AwarenessFrontiers in Computational Neuroscience10.3389/fncom.2019.0000113Online publication date: 12-Feb-2019
        • (2016)Modelling and verification of weighted spiking neural systemsTheoretical Computer Science10.1016/j.tcs.2015.11.005623:C(92-102)Online publication date: 11-Apr-2016

        View Options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Login options

        Full Access

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media