[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article
Open access

Process algebraic modelling of attentional capture and human electrophysiology in interactive systems

Published: 01 December 2009 Publication History

Abstract

Previous research has developed a formal methods-based (cognitive-level) model of the Interacting Cognitive Subsystems central engine, with which we have simulated attentional capture in the context of Barnard’s key-distractor Attentional Blink task. This model captures core aspects of the allocation of human attention over time and as such should be applicable across a range of practical settings when human attentional limitations come into play. In addition, this model simulates human electrophysiological data, such as electroencephalogram recordings, which can be compared to real electrophysiological data recorded from human participants. We have used this model to evaluate the performance trade-offs that would arise from varying key parameters and applying either a constructive or a reactive approach to improving interactive systems in a stimulus rich environment. A strength of formal methods is that they are abstract and the resulting specifications of the operator are general purpose, ensuring that our findings are broadly applicable. Thus, we argue that new modelling techniques from computer science can also be employed in computational modelling of the mind. These would complement existing techniques, being specifically targeted at psychological level modelling, in which it is advantageous to directly represent the distribution of control.

References

References

[1]
Abeles M, Bergman H, Margalis E, and Vaadia E Spatiotemporal firing patterns in the frontal cortex of behaving monkeys J Neurophysiol 1993 70 1629-1638
[2]
Anderson JR Rules of the mind 1993 Hillsdale Erlbaum
[3]
Anderson AK Affective influences on the attentional dynamics supporting awareness J Exp Psychol General 2005 134 2 258-281
[4]
Baeten JC, Middelburg CA, and Middelburg K Process algebra with timing 2002 New York Springer
[5]
Barnard PJ (1999) Interacting cognitive subsystems: modelling working memory phenomena within a multi-processor architecture, Models of Working Memory: Mechanisms of active maintenance and executive control, pp 298–339
[6]
Barnard PJ, Scott S, Taylor J, May J, and Knightley W Paying attention to meaning Psychol Sci 2004 15 3 179-186
[7]
Barnard PJ and Bowman H Rendering information processing models of cognition and affect computationally explicit: distributed executive control and the deployment of attention Cogn Sci Q 2003 3 3 297-328
[8]
Barnard PJ, Ramponi C, Battye G, and Mackintosh B Anxiety and the deployment of visual attention over time Vis Cogn 2005 12 1 181-211
[9]
Beverina F, Palmas G, Silvoni S, Piccione F, and Giove S User adaptive BCIs: SSVEP and P300 based interfaces Psychnology 2003 1 4 331-354
[10]
Bolognesi T and Brinksma E Introduction to the ISO specification language LOTOS Comput Netw ISDN Syst 1988 14910 25-29
[11]
Bond AH Describing behavioural states using a system model of the primate brain Am J Primatol 1999 49 315-338
[12]
Bowman H, Bryans JW, and Derrick J Analysis of a multimedia stream using stochastic process algebra Comput J 2001 44 4 230-245
[13]
Bowman H and Faconti G Analysing cognitive behaviour using LOTOS and Mexitl Formal Aspects Comput 1999 11 132-159
[14]
Bowman H and Gomez RS Concurrency theory, calculi and automata for modelling untimed and timed concurrent systems 2006 Berlin Springer
[15]
Bowman H and Wyble B The simultaneous type, serial token model of temporal attention and working memory Psychol Rev 2007 114 1 38-70
[16]
Carver CS and Scheier MF On the self-regulation of behaviour 1998 Cambridge Cambridge University Press
[17]
Chun MM and Potter MC A two-stage model for multiple target detection in rapid serial visual presentation J Exp Psychol Hum Percept Perform 1995 21 1 109-127
[18]
Cilliers PJ, Van Der Kouwe AJW (1993) A VEP-based computer interfcae for C2-Quadriplegics. Engineering in Medicine and Biology Society, 1993. In: Proceedings of the 15th Annual International Conference of the IEEE, vol 15(3), pp 1263–1624
[19]
Cooper R, Fox J, Farringdon J, and Shallice T A systematic methodology for cognitive modelling Artif Intell 1996 85 3-44
[20]
Craston P, Wyble B, Chennu S, Bowman H (2008) The attentional blink reveals serial working memory encoding: evidence from virtual and human event-related potentials. J Cogn Neurosci (in press)
[21]
Donchin E Presidential address, 1980 Surprise!...Surprise?. Psychophysiology 1981 18 5 493-513
[22]
Duke DJ, Barnard PJ, Duce DA, and May J Syndetic modelling Hum Comput Interact 1998 13 4 337-393
[23]
Ehrig H, Fey W, Hansen H (1983) ACT ONE—an algebraic specification language with two levels of semantics, ADT
[24]
Elman JL, Bates EA, Johnson MH, Karmiloff-Smith A, Parisi D, and Plunkett K Rethinking innateness: a connectionist perspective on development, a Bradford book 1996 Cambridge MIT Press
[25]
Erickson TD and Mattson ME From words to meaning: a semantic illusion J Verbal Learn Verbal Behav 1981 20 540-551
[26]
Fodor JA and Pylyshyn ZW Connectionism and cognitive architecture: a critical analysis Cognition 1988 28 3-71
[27]
Garavel H, Lang F, and Mateescu F An overview of CADP 2001 EASST Newsl 2002 4 13-24
[28]
Garavel H, Viho C, and Zendri M System design of a CC-NUMA multiprocessor architecture using formal specification, model-checking, co-simulation, and test generation Springer Int J Softw Tools Technol Transf (STTT) 2001 3 3 314-331
[29]
Gomez ME, Santonja V (1998) Self-similiary in I/O workload: analysis and modeling. In: Workshop on Workload Characterization
[30]
Grill-Spector K and Kanwisher N Visual recognition: as soon as you know it is there, you know what it is Psychol Sci 2005 16 2 152-160
[31]
Hoare CAR Communicating sequential processes 1985 London Prentice-Hall
[32]
Kieras DE, Meyer DE, Mueller S, and Seymour T Insights into working memory from the perspective of the EPIC architecture for modelling skilled perceptual-motor and cognitive human performance, Models of Working Memory, Mechanisms of Active Maintenance and Executive Control 1999 New York Cambridge University Press 183-223
[33]
Leventhal H Pilner P, Blankstein K, and Spigel IM A perceptual-motor processing model of emotion Perception of emotion in self and others, vol 5 1979 New York Plenum 1-46
[34]
Levine SP, Huggins JE, BeMent SL, Kushwaha RK, Schuh LA, and Rohde MM A direct brain interface based on event-related potentials IEEE Trans Rehabil Eng 2000 8 2 180-185
[35]
Mackworth J The duration of the visual image Can J Paychol 1963 17 1 62-68
[36]
Maki WS, Frigen K, and Paulsen K Associative priming by targets and distractors during rapid serial presentation J Exp Psychol Hum Percept Perform 1997 23 1014-1034
[37]
Meinicke P, Kaper M, Hoppe F, Heumann M, and Ritter H Improving transfer rates in brain computer interfacing: a case study Adv Neural Inform Process Syst 2003 15 1107-1114
[38]
Metz CE Basic principles of ROC analysis Semin Nuclear Med 1978 8 283-298
[39]
Meyer DE and Kieras DE A computational theory of executive cognitive processes and multiple task performance: Part 1 Basic mechanisms. Psychol Rev 1997 104 3-65
[40]
Milner R Communication and concurrency 1989 Hemel Hempstead Prentice-Hall
[41]
Newell A Unified theories of cognition 1990 Cambridge Harvard University Press
[42]
O’Reilly RC and Munakata Y Computational explorations in cognitive neuroscience: understanding the mind by simulating the brain, a Bradford book 2000 Cambidge MIT Press
[43]
Raymond J, Shapiro K, and Arnell KM Temporary suppression of visual processing in an RSVP Task: an attentional blink J Exp Psychol Hum Percept Perform 1992 18 3 849-860
[44]
Rolls ET and Stringer SM A model of the interaction between mood and memory Netw: Comput Neural Syst 2001 12 89-109
[45]
Rolls ET and Treves A Neural networks and brain function 1998 Oxford Oxford University Press
[46]
Rumelhart DE, McClelland JL, and thePDP Research Group Parallel distributed processing, explorations in the microstructure of cognition. Volume 1: Foundations and Volume 2: Psychological and Biological Models, a Bradford book 1986 Cambridge MIT Press
[47]
Schmolesky M, Wang Y, Hanes D, Thompson K, Leutgeb S, Schall J, and Leventhal AG Signal timing across the Macaque visual system J Neurophysiopl 1998 79 6 3272-3278
[48]
Shapiro KL, Caldwell JI, and Sorensen RE Personal names and the attentional blink: the cocktail party revisited J Exp Psychol Hum Percept Perform 1997 23 504-514
[49]
Shapiro KL, Luck SJ (1999) The attentional blink: a front-end mechanism for fleeting memories. In: Fleeting memories, cognition of brief visual stimuli, A Bradford book. MIT Press, Boston, pp 95–118
[50]
Snodgrass JG and Corwin J Pragmatics of measuring recognition memory: applications to dementia and amnesia J Exp Psychol Gen 1988 117 1 34-50
[51]
Squires NK, Squires KC, and Hillyard SA Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in man Electroencephalogr Clin Neurophysiol 1975 38 4 387-401
[52]
Su L, Bowman H, Barnard PJ (2007) Attentional capture by meaning: a multi-level modelling study. In: Proceedings of the 29th Annual Cognitive Science Society. Cognitive Science Society, Austin, pp 1521–1526
[53]
Su L, Bowman H, Barnard PJ (2008) Performance of reactive interfaces in stimulus rich environments, applying formal methods and cognitive frameworks. In: The 2nd International Workshop on Formal Methods for Interactive Systems FMIS2007 (held in conjunction with HCI2007), Electronic Notes in Theoretical Computer Science, vol 208. Elsevier, Amsterdam, pp 95–111
[54]
Teasdale JD and Barnard PJ Affect, cognition and change: re-modelling depressive thought 1993 Hove Lawrence Erlbaum Associates
[55]
Vidal JJ Toward direct brain-computer communication Ann Rev Biophys Bioeng 1973 2 157-180
[56]
Vogel EK, Luck SJ, and Shapiro KL Electrophysiological evidence for a postperceptual locus of suppression during the attentional blink J Exp Psychol Hum Percept Perform 1998 24 6 1656-1674
[57]
Wang M, Madhyastha T, Chan NH, Papadimitriou S, Faloutsos C (2002) Data mining meets performance evaluation: fast algorithms for modeling bursty traffic. In: 18th International Conference on Data Engineering
[58]
Wyble B, Bowman H (2005) Computational and experimental evaluation of the attentional blink: testing the simultaneous type serial token model. In: Bara BG, Barsalou LW, Bucciarelli M (eds) CogSci 2005, XXVII Annual Conference of the Cognitive Science Society. Cognitive Science Society, Cognitive Science Society through Lawrence Erlbaum, Austin, pp 2371–2376
[59]
Wyble B, Craston P, Bowman H (2006) Electrophysiological feedback in adaptive human–computer interfaces, Technical Report 8-06, Computing Laboratory, University of Kent, Canterbury, UK

Cited By

View all
  • (2022)Formal Methods for Human-Computer InteractionFormal Methods for Software Engineering10.1007/978-3-030-38800-3_7(345-394)Online publication date: 23-Jun-2022
  • (2021)Is CADP an Applicable Formal Method?Electronic Proceedings in Theoretical Computer Science10.4204/EPTCS.349.1349(1-11)Online publication date: 16-Nov-2021
  • (2019)Interdisciplinary Aspects of CognitionSoftware Engineering and Formal Methods10.1007/978-3-030-57506-9_9(103-118)Online publication date: 16-Sep-2019
  • Show More Cited By

Index Terms

  1. Process algebraic modelling of attentional capture and human electrophysiology in interactive systems
            Index terms have been assigned to the content through auto-classification.

            Recommendations

            Comments

            Please enable JavaScript to view thecomments powered by Disqus.

            Information & Contributors

            Information

            Published In

            cover image Formal Aspects of Computing
            Formal Aspects of Computing  Volume 21, Issue 6
            Dec 2009
            129 pages
            ISSN:0934-5043
            EISSN:1433-299X
            Issue’s Table of Contents

            Publisher

            Springer-Verlag

            Berlin, Heidelberg

            Publication History

            Published: 01 December 2009
            Accepted: 06 October 2008
            Received: 01 March 2008
            Published in FAC Volume 21, Issue 6

            Author Tags

            1. Formal methods
            2. HCI
            3. Stimulus rich reactive interfaces
            4. Attentional blink
            5. EEG
            6. Interacting cognitive subsystems

            Qualifiers

            • Research-article

            Contributors

            Other Metrics

            Bibliometrics & Citations

            Bibliometrics

            Article Metrics

            • Downloads (Last 12 months)34
            • Downloads (Last 6 weeks)6
            Reflects downloads up to 18 Jan 2025

            Other Metrics

            Citations

            Cited By

            View all
            • (2022)Formal Methods for Human-Computer InteractionFormal Methods for Software Engineering10.1007/978-3-030-38800-3_7(345-394)Online publication date: 23-Jun-2022
            • (2021)Is CADP an Applicable Formal Method?Electronic Proceedings in Theoretical Computer Science10.4204/EPTCS.349.1349(1-11)Online publication date: 16-Nov-2021
            • (2019)Interdisciplinary Aspects of CognitionSoftware Engineering and Formal Methods10.1007/978-3-030-57506-9_9(103-118)Online publication date: 16-Sep-2019
            • (2017)Modelling the UserThe Handbook of Formal Methods in Human-Computer Interaction10.1007/978-3-319-51838-1_8(211-245)Online publication date: 25-Apr-2017
            • (2016)Modelling and analysing neural networks using a hybrid process algebraTheoretical Computer Science10.1016/j.tcs.2015.08.019623:C(15-64)Online publication date: 11-Apr-2016
            • (2016)A Cognitive Framework Based on Rewriting Logic for the Analysis of Interactive SystemsSoftware Engineering and Formal Methods10.1007/978-3-319-41591-8_20(287-303)Online publication date: 23-Jun-2016
            • (2014)Analysing neurobiological models using communicating automataFormal Aspects of Computing10.1007/s00165-014-0294-y26:6(1169-1204)Online publication date: 1-Nov-2014
            • (2011)Salience sensitive control, temporal attention and stimulus-rich reactive interfacesHuman Attention in Digital Environments10.1017/CBO9780511974519.005(114-144)Online publication date: 4-Feb-2011
            • (2010)On the fringe of awarenessProceedings of the 20th international conference on Artificial neural networks: Part III10.5555/1886436.1886510(504-509)Online publication date: 15-Sep-2010
            • (2010)On the Fringe of Awareness: The Glance-Look Model of Attention-Emotion InteractionsArtificial Neural Networks – ICANN 201010.1007/978-3-642-15825-4_69(504-509)Online publication date: 2010
            • Show More Cited By

            View Options

            View options

            PDF

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader

            Login options

            Full Access

            Media

            Figures

            Other

            Tables

            Share

            Share

            Share this Publication link

            Share on social media