More Web Proxy on the site http://driver.im/

research-article

Audio description as an aural guide of children's visual attention: evidence from an eye-tracking study

Authors:

Izabela Krejtz,

Agnieszka Szarkowska,

Krzysztof Krejtz,

Agnieszka Walczak,

Andrew DuchowskiAuthors Info & Claims

ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

Pages 99 - 106

https://doi.org/10.1145/2168556.2168572

Published: 28 March 2012 Publication History

Abstract

Audio description (AD) has become a cultural revolution for the visually impaired; however, the range of AD beneficiaries can be much broader. We claim that AD is useful for guiding children's attention. The paper presents an eye-tracking study testing the usefulness of AD in selective attention to described elements of a video scene. Forty-four children watched 2 clips from an educational animation series while their eye movements were recorded. Average fixation duration, fixation count, and saccade amplitude served as primary dependent variables. The results confirmed that AD guides children's attention towards described objects resulting e. g., in more fixations on specific regions of interest. We also evaluated eye movement patterns in terms of switching between focal and ambient processing. We postulate that audio description could complement regular teaching tools for guiding and focusing children's attention, especially when new concepts are introduced.

References

[1]

Audio Description International, 2005. Guidelines for Audio Description. http://www.adinternational.org/ADIguidelines.html.

[2]

Barkley, R. A. 1997. Behavioral Inhibition, Sustained Attention, and Executive Functioning: Constructing a Unifying Theory of ADHD. Psychological Bulletin 121, 1, 65--94.

[3]

Benecke, B. 1997. Audio-Description. Bulletin 121, 1, 65--94.

[4]

Bourne, J., and Hurtado, C. J. 2007. From the Visual to the Verbal in Two Languages: a Contrastive Analysis of the Audio Description of The Hours in English and Spanish. In Media for All: Subtitling for the Deaf, Audio Description, and Sign Language, J. Díaz Cintas, P. Orero, and A. Remael, Eds. Rodopi, Amsterdam, Holland, 175--187.

[5]

Braun, S. 2008. Audiodescription Research: State of the Art and Beyond. Translation Studies in the New Millennium 6, 14--30.

[6]

Cabeza-Cáceres, C. 2010. Opera Audio Description at Barcelona's Liceu Theatre. In Media for All 2: New Insights into Audiovisual Translation and Media Accessibility, J. Díaz Cintas, A. Matamala, and J. Neves, Eds. Rodopi, Amsterdam, Holland, 227--237.

[7]

Chmiel, A., Mazur, I., Vilaro, A., diGiovanni, E., Chmiel, P., and Orero, P., 2010. How Audio Description Influences Perception. A Work-In-Progress Report on an International Eye-Tracking Study. ARSAD 2010.

[8]

Ciborowski, M. 2008. Znaczenie audiodeskrypcji dla niewidomych w Polsce. Przekladaniec 20, 136--137.

[9]

Commission, I. T., 2000. Guidance On Standards for Audio Description.

[10]

Deubel, H., and Schneider, W. X. 1996. Saccade Target Selection and Object Recognition: Evidence for a Common At-tentional Mechanism. Vision Res. 36, 12, 1827--1837.

[11]

Díaz Cintas, J. 2004. Accessibility for All. Translating Today, 3--4.

[12]

D'Ydewalle, G., and Van de Poel, M. 1999. Incidental Foreign-Language Acquisition by Children Watching Subtitled Television Programs. Journal of Psycholinguistic Research 28, 3, 227--244.

[13]

Finbow, S. 2010. The State of Audio Description in the United Kingdom---from Description to Narration. Perspectives 18, 3, 215--229.

[14]

Frazier, G., and Coutinho-Johnson, I. 1995. The Effectiveness of Audio Description in Processing Access to Educational AV Media for Blind and Visually Impaired Students in High School. San Francisco: Audio Vision.

[15]

Fryer, L. 2010. Audio Description as Audio Drama---a Practitioner's Point of View. Perspectives 18, 3, 205--213.

[16]

Greening, J., and Rolph, D. 2007. Accessibility: Raising Awareness of Audio Description in the UK. In Media for All: Subtitling for the Deaf, Audio Description and Sign Language, J. Díaz Cintas, P. Orero, and A. Remael, Eds. Rodopi, Amsterdam, Holland, 127--138.

[17]

Hainline, L., Turkel, J., Abramov, I., Lemerise, E., and Harris, C. 1984. Characteristics of Saccades in Human Infants. Vision Research, 24, 1771--1780.

[18]

He, P., and Kowler, E. 1992. The Role of Saccades in the Perception of Texture Patterns. Vision Research 32, 2151--2163.

[19]

Henderson, J. M. 1992. Visual Attention and Eye Movement Control During Reading and Picture Viewing. In Eye Movements and Visual Cognition: Scene Perception and Reading, K. Rayner, Ed. Springer-Verlag, New York, NY, 260--283. Springer Series in Neuropsychology.

[20]

Hoffman, J. E., and Subramaniam, B. 1995. The Role of Visual Attention in Saccadic Eye Movements. Perception and Psychophysics 57, 787--795.

[21]

Holland, A. 2008. Audio Description in the Theatre and the Visual Arts: Images into Words. In Audiovisual Translation: Language Transfer on Screen, J. Díaz Cintas and G. Anderman, Eds. Palgrave Macmillan, Basingstoke, UK.

[22]

Ingle, D. 1967. Two visual mechanisms underlying the behavior of fish. Psychologische Forschung, 31, 44--51.

[23]

Irwin, D. E., and Zelinsky, G. J. 2002. Eye movements and scene perception: memory for things observed. Perception and Psychophysics, 64, 882--895.

[24]

Jensema, C. J., El Sharkawy, S., Danturthi, R. S., Burch, R., and Hsu, D. 2000. Eye Movement Patterns of Captioned Television Viewers. American Annals of the Deaf 145, 3 (July), 275--285.

[25]

Jensema, C. 2003. The Relation Between Eye Movement and Reading Captions and Print by School-Age Deaf Children. Final Report Grant Award Number HH327H000002, Institute for Disability Research and Training, Inc., Wheaton, MD, September.

[26]

Kruger, J.-L. 2010. Audio Narration: Re-Narrativising Film. Perspectives 18, 3, 231--249.

[27]

Marchant, P., Raybould, D., Renshaw, T., and Stevens, R. 2009. Are You Seeing What I'm Seeing? An Eye-Tracking Evaluation of Dynamic Scenes. Digital Creativity 20, 3, 153--163.

[28]

Orero, P. 2007. Sampling Audio Description in Europe. In Media for All: Subtitling for the Deaf, Audio Description and Sign Language, J. Díaz Cintas, P. Orero, and A. Remael, Eds. Rodopi, Amsterdam, Holland, 111--125.

[29]

Palomo, A. 2008. Audio Description as Language Development and Language Learning for Blind and Visual Impaired Children. In Thinking Translation: Perspectives from Within and Without, R. H. Parker and K. G. García, Eds. Brown Walker Press, Boca Raton, FL, 113--134.

[30]

Peli, E., Fine, E. M., and Labianca, A. T. 1996. Evaluating Information Provided by Audio Description. Journal of Visual Impairment and Blindness 90, 378--385.

[31]

Posner, M. I. 2004. Cognitive Neuroscience of Attention. New York: Guilford Press.

[32]

Rayner, K. 1984. Visual selection in reading, picture perception, and visual search: A tutorial review. In Attention and Performance, H. Bouma and D. Bouwhuis, Eds. Erlbaum, Hillsdale, NJ.

[33]

Rayner, K. 1998. Eye Movements in Reading and Informa-tionprocessing: 20 years of research. Psychological Bulletin 85, 618--660.

[34]

Remael, A., and Vercauteren, G. 2007. Audio Describing the Exposition Phase of Films: Teaching Students What to Choose. Trans. Revista De Traductología 11, 73--93.

[35]

Royal National Institute for the Blind, 2006. Audio Description for Children. www. rnib.org.uk.

[36]

Salway, A. 2007. A Corpus-Based Analysis of Audio Description. In Media for All: Subtitling for the Deaf, Audio Description and Sign Language, J. Díaz Cintas, P. Orero, and A. Remael, Eds. Rodopi, Amsterdam, Holland, 154--174.

[37]

Schmeidler, E., and Kirchner, C. 2001. Adding Audio Description: Does It Make a Difference? Journal of Visual Impairment and Blindness, 198--212.

[38]

Schneidler, G. E. 1967. Contrasting visuomotor functions of tectum and cortex in the golden hamster. Psychologische Forschung, 31(1), 52--62.

[39]

Smith, T. J., and Henderson, J. M. 2008. Edit Blindness: The Relationship Between Attention and Global Change Blindness in Dynamic Scenes. Journal of Eye Movement Research 2, 2, 1--17.

[40]

Szarkowska, A. 2011. Text-to-Speech Audio Description: Towards Wider Availability of AD. Journal of Specialised Translation, 15, 142--162.

[41]

Treuting, J. 2006. Eye Tracking and the Cinema. SMPTE Motion Imaging Journal (January), 31--40.

[42]

Trevarthen, C. B. 1968. Two mechanisms of vision in primates. Psychologische Forschung, 31, 229--337.

[43]

Udo, J. P., and Fels, D. I. 2009. "Suit the Action to the Word, the Word to the Action": An Unconventional Approach to Describing Shakespeare's Hamlet. Journal of Visual Impairment and Blindness 103, 3.

[44]

Udo, J. P., and Fels, D. I. 2010. Universal Design on Stage: Live Audio Description for Theatrical Performances. Perspectives 18, 3, 189--203.

[45]

Unema, P. J. A., Pannasch, S., Joos, M., and Velichkovsky, B. 1968. Time course of information processing during scene perception. Visual Cognition, 12(3), 473--494.

[46]

Velichkovsky, B. M., Joos, M., Helmert, J. R., and Pannasch, S. 2005. Two Visual Systems and Their Eye Movements: Evidence from Static and Dynamic Scene Perception. In CogSci 2005: Proceedings of the XXVII Conference of the Cognitive Science Society, 2283--2288.

[47]

Vercauteren, G. 2007. Towards a European Guideline for Audio Description. In Media for All: Subtitling for the Deaf, Audio Description and Sign Language, J. Díaz Cintas, P. Orero, and A. Remael, Eds. Rodopi, Amsterdam, Holland, 139--149.

[48]

Vilaró, A., Duchowski, Andrew T. Orero, P., Grindinger, T. J., Tetreault, S., and Di Giovanni, E. 2011. How Sound is The Pear Tree Story? Testing the Effect of Varying Audio Stimuli on Visual Attention Distribution. Perspectives: Studies in Translatology. Special Issue on The Pear Stories (to appear).

[49]

Weiskrantz, L. 1972. Behavioral analysis of the monkey's visual system. Proceedings of the Royal Society of London (Biology), 182, 427--455.

[50]

Yarbus, A. 1967. Eye Movements and Vision. New York: Plenum Press.

Cited By

Krejtz KRutkowska-Siuda DKrejtz I(2024)Gaze-Led Audio Description (GLAD). Concept and Application to Accessibility of Architectural HeritageTransforming Media Accessibility in Europe10.1007/978-3-031-60049-4_4(53-72)Online publication date: 20-Aug-2024
https://doi.org/10.1007/978-3-031-60049-4_4
Krejtz KSzczecinski PPawlowska ARutkowska-Siuda DWisiecka KMilczarski PHlobaz ADuchowski AKrejtz I(2023)A Unified Look at Cultural Heritage: Comparison of Aggregated Scanpaths over Architectural ArtifactsProceedings of the ACM on Human-Computer Interaction10.1145/35911387:ETRA(1-17)Online publication date: 18-May-2023
https://dl.acm.org/doi/10.1145/3591138
Zabrocka M(2022)The value of audio description for the therapy of speech-communicative disordersRevista de Investigación en Logopedia10.5209/rlog.7558412:1(e75584)Online publication date: 3-Jan-2022
https://doi.org/10.5209/rlog.75584
Show More Cited By

Index Terms

Audio description as an aural guide of children's visual attention: evidence from an eye-tracking study
1. Applied computing
  1. Law, social and behavioral sciences
    1. Psychology

Recommendations

Video game design using an eye-movement-dependent model of visual attention

Eye movements can be used to infer the allocation of covert attention. In this article, we propose to model the allocation of attention in a task-dependent manner based on different eye movement conditions, specifically fixation and pursuit. We show ...
Eye-hand coordination strategies during active video game playing

All participants used multiple eye-hand strategies while playing digital games.Different active video games induced different latencies and gaze points.Children had different latencies and fixation than adults during game playing.Eye-tracking technology ...
Cyberbullying perpetration and victimization among children and adolescents: A systematic review of longitudinal studies
Highlights
- A growing number of longitudinal studies have investigated factors related to cyberbullying in youth.
Abstract
In this systematic review of exclusively longitudinal studies on cyberbullying perpetration and victimization among adolescents, we identified 76 original longitudinal studies published between 2007 and 2017. The majority of them ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

March 2012

420 pages

ISBN:9781450312219

DOI:10.1145/2168556

Conference Chairs:
Carlos H. Morimoto
University of São Paulo, Brazil
,
Howell Istance
Montfort University, UK
,
Editor:
Stephen N. Spencer
University of Washington
,
Program Chairs:
Jeffrey B. Mulligan
NASA
,
Pernilla Qvarfordt
FX Palo Alto

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Polish Ministry of Science and Higher Education

Conference

ETRA '12

Sponsor:

ETRA '12: Eye Tracking Research and Applications

March 28 - 30, 2012

California, Santa Barbara

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
755
Total Downloads

Downloads (Last 12 months)69
Downloads (Last 6 weeks)7

Reflects downloads up to 18 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Krejtz KRutkowska-Siuda DKrejtz I(2024)Gaze-Led Audio Description (GLAD). Concept and Application to Accessibility of Architectural HeritageTransforming Media Accessibility in Europe10.1007/978-3-031-60049-4_4(53-72)Online publication date: 20-Aug-2024
https://doi.org/10.1007/978-3-031-60049-4_4
Krejtz KSzczecinski PPawlowska ARutkowska-Siuda DWisiecka KMilczarski PHlobaz ADuchowski AKrejtz I(2023)A Unified Look at Cultural Heritage: Comparison of Aggregated Scanpaths over Architectural ArtifactsProceedings of the ACM on Human-Computer Interaction10.1145/35911387:ETRA(1-17)Online publication date: 18-May-2023
https://dl.acm.org/doi/10.1145/3591138
Zabrocka M(2022)The value of audio description for the therapy of speech-communicative disordersRevista de Investigación en Logopedia10.5209/rlog.7558412:1(e75584)Online publication date: 3-Jan-2022
https://doi.org/10.5209/rlog.75584
Wisiecka KKrejtz KKrejtz ISromek DCellary ALewandowska BDuchowski A(2022)Comparison of Webcam and Remote Eye Tracking2022 Symposium on Eye Tracking Research and Applications10.1145/3517031.3529615(1-7)Online publication date: 8-Jun-2022
https://dl.acm.org/doi/10.1145/3517031.3529615
Zabrocka M(2021)Audio description accompanying video content as a compensatory tool in socialization and cognitive-linguistic development of children with visual impairment: the search for theory for alternative AD applicationEducational and Developmental Psychologist10.1080/20590776.2021.189975038:2(215-226)Online publication date: 22-Mar-2021
https://doi.org/10.1080/20590776.2021.1899750
Downs BShukla AKrentz MPera MWright KKennington CFails JRubegni EVasalou AParés NSawhney N(2020)Guiding the selection of child spellchecker suggestions using audio and visual cuesProceedings of the Interaction Design and Children Conference10.1145/3392063.3394390(398-408)Online publication date: 21-Jun-2020
https://dl.acm.org/doi/10.1145/3392063.3394390
Holsanova J(2020)Uncovering scientific and multimodal literacy through audio descriptionJournal of Visual Literacy10.1080/1051144X.2020.182621939:3-4(132-148)Online publication date: 7-Oct-2020
https://doi.org/10.1080/1051144X.2020.1826219
Mazur I(2020)Audio Description: Concepts, Theories and Research ApproachesThe Palgrave Handbook of Audiovisual Translation and Media Accessibility10.1007/978-3-030-42105-2_12(227-247)Online publication date: 1-Aug-2020
https://doi.org/10.1007/978-3-030-42105-2_12
Kwok TKiefer PSchinazi VAdams BRaubal MBrewster SFitzpatrick GCox AKostakos V(2019)Gaze-Guided NarrativesProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300721(1-12)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300721
Krejtz IKrejtz KWisiecka KAbramczyk MOlszanowski MDuchowski A(2019)Attention Dynamics During Emotion Recognition by Deaf and Hearing IndividualsThe Journal of Deaf Studies and Deaf Education10.1093/deafed/enz036Online publication date: 29-Oct-2019
https://doi.org/10.1093/deafed/enz036
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents