More Web Proxy on the site http://driver.im/

research-article

Gaze behaviour and linguistic processing of dynamic text in print interpreting

Authors:

Selina Sharmin,

Mari WiklundAuthors Info & Claims

ETRA '14: Proceedings of the Symposium on Eye Tracking Research and Applications

Pages 263 - 266

https://doi.org/10.1145/2578153.2578212

Published: 26 March 2014 Publication History

Abstract

Print interpreting is a form of communication that allows deaf and hard of hearing people to get access to speech. We carried out an eye tracking experiment where twenty participants read print interpreted text presented dynamically on a computer screen. We compared regression landing points on reread words between two dynamic text presentation formats: letter-by-letter and word-by-word. Then we investigated the gaze behaviour from a linguistic point of view in order to discover whether the dynamic presentation has an effect on linguistic factors. In particular, we have examined the parts of speech of the first and the second landing points of regressions. The findings suggest significant difference between the presentation formats. There is also a relationship between the gaze behaviour and the linguistic processing of dynamic text. Being conscious of this lexical hierarchy may help to develop supporting print interpreting tools and consequently may also help print interpreters to improve the presentation of dynamic text to the user.

References

[1]

Altmann, G. T. M., Garnham, A., and Dennis, Y. 1992. Avoiding the garden path: Eye movements in context. Journal of Memory and Language 31, 685--712.

[2]

Bernard, M. L., Chaparro, B. S., and Russell, M. 2001. Examining automatic text presentation for small screens. In Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting, Minneapolis, 637--639.

[3]

Carpenter, P. A., and Just, M. A. 1983. What your eyes do while your mind is reading. In Rayner, K. (ed.), Eye movements in reading: Perceptual and language processes. Academic Press, 275--307.

[4]

Caselli, M., Bates, E., Cadadio, P., Fenson, J., Sanderl, L., and Weir, J. 1995. A crosslinguistic study of early lexical development. Cognitive Development 10, 159--199.

[5]

Chien, Y.-H, and Chen, C.-H. 2007. The use of dynamic display to improve reading comprehension for the small screen of a wrist watch. In Proceedings of the 2007 Conference on Human Interface, Part I. Springer, 814--823.

Digital Library

[6]

Daneman, M., and Carpenter, P. A. 1980. Individual differences in working memory and reading. Journal of Verbal Learning and Verbal Behaviour 19, 450--466.

[7]

Ferreira, F., and Henderson, J. M. 1990. The use of verb information in syntactic parsing: A comparison of evidence from eye movements and self-paced word-by-word reading. Journal of Experimental Psychology: Learning, Memory, and Cognition 16, 555--568.

[8]

Friedman, N. P., and Miyake, A. 2004. The reading span test and its predictive power for reading comprehension ability. Journal of Memory and Language 51, 136--158.

[9]

Furtner, M. R., Rauthmann, J. F., and Sachse, P. 2009. Nomen est omen: Investigating the dominance of nouns in word comprehension with eye movement analyses. Advances in Cognitive Psychology 5, 91--104.

[10]

Gentner, D. 1982. Why nouns are learnt before verbs: linguistic relativity versus natural partitioning. In Kuczaj, S. (ed.), Language development, vol. 2. Erlbaum, 67--88.

[11]

Hyönä, J., and Nurminen, A. M. 2006. Do adult readers know how they read? Evidence from eye movement patterns and verbal reports. British Journal of Psychology 97, 31--50.

[12]

Hyönä, J., Lorch, R. F., and Kaakinen, J. 2002. Individual differences in reading to summarize expository text: Evidence from eye fixation patterns. Journal of Educational Psychology 94, 44--55.

[13]

Just, M. A., and Carpenter, P. A. 1980. A theory of reading: From eye fixations to comprehension. Psychological Review 87, 4, 329--354.

[14]

Kaakinen, J., and Hyönä, J. 2007. Strategy use in the reading span test: An analysis of eye movements and reported encoding strategies. Memory 15, 6, 634--646.

[15]

Levy, B. A., Dipersio, R., and Hollingshead, A. 1992. Fluent rereading: Repetition, automaticity, and discrepancy. Journal of Experimental Psychology: Learning, Memory and Cognition 18, 957--971.

[16]

Lin, Y.-C., and Shieh, K.-K. 2006. Reading a dynamic presentation of Chinese text on a single-line display. Displays 27, 145--152.

[17]

Maratsos, M. 1991. How the acquisition of nouns may be different of that of verbs. In Krasnegor, N., Rumbaugh, D., Schiefelbusch, R. and Studdert-Kennedy, M. (eds.), Biological and behavioral determinants of language development. Erlbaum.

[18]

McNamara, D. S., and Scott, J. L. 2001. Working memory capacity and strategy use. Memory and Cognition 29, 10--17.

[19]

O'Grady, W. 1987. Principles of grammar learning. University of Chicago Press.

[20]

Rayner, K. 1998. Eye movements in reading and information processing: 20 years of research. Psychological Bulletin 124, 372--422.

[21]

Rayner, K., and Duffy, S. A. 1988. On-line comprehension processes and eye movements in reading. In Daneman, M., MacKinnon, G. E. and Waller, T. G. (eds.), Reading research: Advances in theory and practice. Academic Press, 13--66.

[22]

Reichle, E. D., Rayner, K., and, A. 2003. The E-Z Reader model of eye movement control in reading: Comparison to other models. Brain and Behavioral Sciences 26, 445--476.

[23]

Špakov, O. 2011. Sprintanium: A tool for print interpreting. Software URL: http://www.cs.uta.fi/speechtext/links.php.

[24]

Tanenhaus, M. K., and Trueswell, J. C. 2006. Eye movements and spoken language comprehension. In Traxler, M., and Gernsbacher, M. (eds.), Handbook of Psycholinguistics (2nd ed.). Elsevier, 863--900.

[25]

Tiittula, L. 2009. SpeechText: research on print interpreting. In Proceedings of 2nd International Seminar on Real-Time Intralingual Subtitling, Universitat Autonoma de Barcelona. URL: www.cs.uta.fi/speechtext/docs/Tiittula_ISRIS_2009.pdf

[26]

Turner, M. L., and Engle, R. W. 1989. Is working memory task dependent? Journal of Memory and Language 28, 127--154.

[27]

Weger, U., and Inhoff, A. 2006. Attention and eye movements in reading inhibition of return predicts the size of regressive saccades. Psychological Science 17, 3, 187--191.

Cited By

Sharmin SŠpakov ORäihä K(2015)Dynamic text presentation in print interpreting - An eye movement study of reading behaviourInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2015.01.01078:C(17-30)Online publication date: 1-Jun-2015
https://dl.acm.org/doi/10.1016/j.ijhcs.2015.01.010

Index Terms

Gaze behaviour and linguistic processing of dynamic text in print interpreting
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
    2. Interaction devices
      1. Touch screens

Recommendations

Towards Predicting Reading Comprehension From Gaze Behavior
ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and Applications

As readers of a language, we all agree to move our eyes in roughly the same way. Yet might there be hidden within this self-similar behavior subtle clues as to how a reader is understanding the material being read? Here we attempt to decode a reader’s ...
Dynamic text presentation in print interpreting - An eye movement study of reading behaviour

Print interpreting supports people with a hearing disability by giving them access to spoken language. In print interpreting, the interpreter types the spoken text in real time for the hard-of-hearing client to read. This results in dynamic text ...
Classification of reading and not reading behavior based on eye movement analysis
UbiComp/ISWC '19 Adjunct: Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers

Nowadays, many researchers analyze reading behavior with eye trackers. Various traits of reading like engagement, or text difficulty have been observed in laboratory settings. But, their automatic application for daily life is usually prevented by one ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '14: Proceedings of the Symposium on Eye Tracking Research and Applications

March 2014

394 pages

ISBN:9781450327510

DOI:10.1145/2578153

Conference Chairs:
Pernilla Qvarfordt
FX Palo Alto Laboratory
,
Dan Witzner Hansen
IT University, Denmark

Copyright © 2014 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 March 2014

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ETRA '14

Sponsor:

ETRA '14: Eye Tracking Research and Applications

March 26 - 28, 2014

Florida, Safety Harbor

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
119
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sharmin SŠpakov ORäihä K(2015)Dynamic text presentation in print interpreting - An eye movement study of reading behaviourInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2015.01.01078:C(17-30)Online publication date: 1-Jun-2015
https://dl.acm.org/doi/10.1016/j.ijhcs.2015.01.010

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents