More Web Proxy on the site http://driver.im/

research-article

The impact of head movements on user involvement in mediated interaction

Authors:

Banan S. Bamoallem,

Andrew J. Wodehouse,

Gordon M. Mair,

Gokula A. VasanthaAuthors Info & Claims

Computers in Human Behavior, Volume 55, Issue PA

Pages 424 - 431

https://doi.org/10.1016/j.chb.2015.09.016

Published: 01 February 2016 Publication History

Abstract

Communication takes place not only through speech, but also through gestures such as facial expressions, gaze, head movements, hand movements and body posture. Although developing rapidly, current communication platforms do not facilitate the types of behaviour we believe are needed to fully support non-verbal communication and make interactions more engaging and efficient. In this paper, we decided to focus our research specifically on the head rather than any other body part as it is a rich source of information for speech-related movement. Thus we aim in this study to investigate the value of incorporating head movements into the use of telepresence robots as communication platforms; by means of investigating a system that manually reproduces head movement as closely as possible. The essential quantitative results revealed no significant differences on any of the measures we used. However, the qualitative information from the experiment indicates of further research will be useful in this area. These findings suggest that an enclose body language are required for a real-time communication beside the head nodding. We examine engagement within conversational behaviours of the subject when interacting with a socially expressive system.We found real-time communication requires more than verbal communication, and head nodding.Head nodding effects depend on precise on-screen movement by synchronize the on-screen movement with the head movement.

References

[1]

S.O. Adalgeirsson, C. Breazeal, MeBot: a robotic platform for socially embodied presence, in: Paper presented at the Proceedings of the 5th ACM/IEEE international conference on human-robot interaction, 2010.

[2]

K.O. Arras, D. Cerqui, Do we want to share our lives and bodies with robots? A 2000 people survey, 2005.

[3]

B. Bamoallem, A. Wodehouse, G. Mair, Design for an optimal social presence experience when using telepresence robots, in: Paper presented at the DS 77: Proceedings of the DESIGN 2014 13th International Design Conference, 2014.

[4]

J. Bates, The role of emotion in believable agents, Communications of the ACM, 37 (1994) 122-125.

Digital Library

[5]

G.W. Beattie, P. Barnard, The temporal structure of natural telephone conversations (directory enquiry calls), Linguistics, 17 (1979) 213-230.

[6]

F. Biocca, C. Harms, Defining and measuring social presence: contribution to the networked minds theory and measure, in: Proceedings of PRESENCE, 2002, 2002, pp. 1-36.

[7]

R.L. Birdwhistell, Background to kinesics, ETC, 40 (1983) 352-361.

[8]

J.K. Burgoon, T.P. Saine, The unspoken dialogue: An introduction to nonverbal communication, Houghton Mifflin School, 1978.

[9]

J. Cassell, Nudge nudge wink wink: elements of face-to-face conversation for embodied conversational agents, Embodied Conversational Agents (2000) 1-27.

[10]

D.J. Cegala, G.T. Savage, C.C. Brunner, A.B. Conrad, An elaboration of the meaning of interaction involvement: toward the development of a theoretical concept, Communications Monographs, 49 (1982) 229-248.

[11]

A. Chapanis, R.B. Ochsman, R.N. Parrish, G.D. Weeks, Studies in interactive communication: I. The effects of four communication modes on the behavior of teams during cooperative problem-solving, Human Factors: The Journal of the Human Factors and Ergonomics Society, 14 (1972) 487-509.

[12]

D.A. Coker, J. BURGOON, The nature of conversational involvement and nonverbal encoding patterns, Human Communication Research, 13 (1987) 463-494.

[13]

M. Cook, M.G. Lalljee, Verbal substitutes for visual signals in interaction, Semiotica, 6 (1972) 212-221.

[14]

John W. Creswell, Vicki L. Plano Clark, Designing and conducting mixed methods research, 2007.

[15]

P. De Greef, W.A. Ijsselsteijn, Social presence in a home tele-application, CyberPsychology & Behavior, 4 (2001) 307-315.

[16]

G. Doherty-Sneddon, A. Anderson, C. O'Malley, S. Langton, S. Garrod, V. Bruce, Face-to-face and video-mediated communication: a comparison of dialogue structure and task performance, Journal of Experimental Psychology: Applied, 3 (1997) 105.

[17]

R.L. Duran, L. Kelly, An investigation into the cognitive domain of competence II: the relationship between communicative competence and interaction involvement, Communication Research Reports, 5 (1988) 91-96.

[18]

A.W. Ellis, G. Beattie, The psychology of language and communication, Weidenfeld and Nicolson, 1986.

[19]

L.K. Guerrero, An application of attachment theory to relational messages and nonverbal involvement behaviors in romantic relationships, 1994.

[20]

L.K. Guerrero, Observer ratings of nonverbal involvement and immediacy, 2005.

[21]

U. Hadar, T. Steiner, E. Grant, F.C. Rose, Kinematics of head movements accompanying speech during conversation, Human Movement Science, 2 (1983) 35-46.

[22]

U. Hadar, T. Steiner, F.C. Rose, Head movement during listening turns in conversation, Journal of Nonverbal Behavior, 9 (1985) 214-228.

[23]

C. Heeter, Being there: The Subjective Experience of Presence, MIT Press, 1992.

[24]

M.K. Lee, L. Takayama, Now, I have a body: uses and social norms for mobile remote presence in the workplace, in: Paper presented at the Proceedings of the SIGCHI Conference on human factors in computing systems, 2011.

[25]

D. Li, P.L.P. Rau, Y. Li, A¿cross-cultural study: effect of robot appearance and task, International Journal of Social Robotics, 2 (2010) 175-186.

[26]

A. Mehrabian, Some referents and measures of nonverbal behavior, Behavior Research Methods & Instrumentation, 1 (1968) 203-207.

[27]

A. Mollahosseini, G. Graitzer, E. Borts, S. Conyers, R.M. Voyles, R. Cole, ExpressionBot: an emotive lifelike robotic face for face-to-face communication, in: Paper presented at the Humanoid robots (Humanoids), 2014 14th IEEE-RAS International Conference on, 2014.

[28]

B. Mutlu, F. Yamaoka, T. Kanda, H. Ishiguro, N. Hagita, Nonverbal leakage in robots: communication of intentions through seemingly unintentional behavior, in: Paper presented at the Proceedings of the 4th ACM/IEEE international conference on human robot interaction, 2009.

[29]

A.E. Norris, H. Weger, C. Bullinger, A. Bowers, Quantifying engagement: measuring player involvement in human-avatar interactions, Computers in Human Behavior, 34 (2014) 1-11.

[30]

Alicia O'Cathain, Elizabeth Murphy, Jon Nicholl, Three techniques for integrating data in mixed methods studies, BMJ, 341 (2010).

[31]

B. O'Conaill, S. Whittaker, S. Wilbur, Conversations over video conferences: an evaluation of the spoken aspects of video-mediated communication, Human-Computer Interaction, 8 (1993) 389-428.

Digital Library

[32]

C. O'Malley, S. Langton, A. Anderson, G. Doherty-Sneddon, V. Bruce, Comparison of face-to-face and video-mediated interaction, Interacting with Computers, 8 (1996) 177-192.

[33]

J.S. Olson, G.M. Olson, D.K. Meader, What mix of video and audio is useful for small groups doing remote real-time design work?, in: Paper presented at the Proceedings of the SIGCHI conference on human factors in computing systems, 1995.

[34]

M.T. Palmer, Interpersonal communication and virtual reality: mediating interpersonal relationships, Communication in the Age of Virtual Reality (1995) 277-299.

[35]

R.E. Pittenger, C.F. Hockett, J.J. Danehy, The first five minutes: A sample of microscopic interview analysis, 1960.

[36]

H.M. Rosenfeld, Conversational control functions of nonverbal behavior, Nonverbal Behavior and Communication (1978) 291-328.

[37]

D.R. Rutter, G.M. Stephenson, The role of visual communication in synchronising conversation, European Journal of Social Psychology, 7 (1977) 29-37.

[38]

G. Schillaci, S. Bodiro¿a, V.V. Hafner, Evaluating the effect of saliency detection and attention manipulation in human-robot interaction, International Journal of Social Robotics, 5 (2013) 139-152.

[39]

M. Schröder, E. Bevacqua, R. Cowie, F. Eyben, H. Gunes, D. Heylen, Building autonomous sensitive artificial listeners, Affective Computing, IEEE Transactions on, 3 (2012) 165-183.

Digital Library

[40]

A.J. Sellen, Remote conversations: the effects of mediating talk with technology, Human-Computer Interaction, 10 (1995) 401-444.

Digital Library

[41]

J. Short, E. Williams, B. Christie, The social psychology of telecommunications, 1976.

[42]

R.J. Sidelinger, G. Ayash, A. Godorhazy, D. Tibbles, Couples go online: relational maintenance behaviors and relational characteristics use in dating relationships, Human Communication A Journal of the Pacific and Asian Communication Association, 11 (2008) 333.

[43]

C.L. Sidner, C. Lee, C. Kidd, Engagement during dialogues with robots, in: Paper presented at the AAAI spring symposia, 2005.

[44]

C.L. Sidner, C. Lee, C.D. Kidd, N. Lesh, C. Rich, Explorations in engagement for humans and robots, Artificial Intelligence, 166 (2005) 140-164.

Digital Library

[45]

D. Sirkin, W. Ju, Consistency in physical and on-screen action improves perceptions of telepresence robots, in: Paper presented at the Proceedings of the seventh annual ACM/IEEE international conference on Human-robot interaction, 2012.

[46]

D. Sirkin, W. Ju, M. Cutkosky, Communicating meaning and role in distributed design Collaboration: How crowdsourced users help inform the design of telepresence robotics Design Thinking Research, Springer, 2012.

[47]

K.M. Tsui, M. Desai, H. Yanco, C. Uhlik, Exploring use cases for telepresence robots, in: Paper presented at the Human-Robot Interaction (HRI), 2011 6th ACM/IEEE International Conference on, 2011.

[48]

W.A. Villaume, D.J. Cegala, Interaction involvement and discourse strategies: the patterned use of cohesive devices in conversation, Communications Monographs, 55 (1988) 22-40.

[49]

E. Williams, Experimental comparisons of face-to-face and mediated communication: a review, Psychological Bulletin, 84 (1977) 963.

Cited By

Reyes-Cruz GMartinez Avila JSchneiders EBoudouraki A(2024)Reimagining the Design of Mobile Robotic Telepresence: Reflections from a Hybrid Design WorkshopProceedings of the Second International Symposium on Trustworthy Autonomous Systems10.1145/3686038.3686055(1-7)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1145/3686038.3686055
Schneiders EBoudouraki AReyes-Cruz GMartinez Avila JElmimouni HGrønbæk JRintel SJoshi S(2023)Mobility and Utility in Robot Mediated InteractionProceedings of the 25th International Conference on Mobile Human-Computer Interaction10.1145/3565066.3609791(1-5)Online publication date: 26-Sep-2023
https://dl.acm.org/doi/10.1145/3565066.3609791
Illi MKaryda MLucero AMandryk RHancock MPerry MCox A(2018)On Visual GranularityProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173721(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173721
Show More Cited By

The impact of head movements on user involvement in mediated interaction
1. Human-centered computing

Recommendations

The Role of the Vocal Stream in Telepresence Communication
PETRA '16: Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Most of the work in affective computing within telepresence robot platforms focusses on research and knowledge generation as opposed to application. The main reason behind this is that the actual capabilities we have in the real world do not match the ...
Eye movements and viewer's impressions in response to HMD-evoked head movements
COGAIN '18: Proceedings of the Workshop on Communication by Gaze Interaction

The relationships between eye and head movements during the viewing of various visual stimuli using a head mounted display (HMD) and a large flat display were compared. The visual sizes of the images displayed were adjusted virtually, using an image ...
Consider the Head Movements! Saccade Computation in Mobile Eye-Tracking
ETRA '22: 2022 Symposium on Eye Tracking Research and Applications

Saccadic eye movements are known to serve as a suitable proxy for tasks prediction. In mobile eye-tracking, saccadic events are strongly influenced by head movements. Common attempts to compensate for head-movement effects either neglect saccadic events ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Computers in Human Behavior

Computers in Human Behavior Volume 55, Issue PA

February 2016

604 pages

ISSN:0747-5632

Issue’s Table of Contents

Copyright © Elsevier Ltd.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 February 2016

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Reyes-Cruz GMartinez Avila JSchneiders EBoudouraki A(2024)Reimagining the Design of Mobile Robotic Telepresence: Reflections from a Hybrid Design WorkshopProceedings of the Second International Symposium on Trustworthy Autonomous Systems10.1145/3686038.3686055(1-7)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1145/3686038.3686055
Schneiders EBoudouraki AReyes-Cruz GMartinez Avila JElmimouni HGrønbæk JRintel SJoshi S(2023)Mobility and Utility in Robot Mediated InteractionProceedings of the 25th International Conference on Mobile Human-Computer Interaction10.1145/3565066.3609791(1-5)Online publication date: 26-Sep-2023
https://dl.acm.org/doi/10.1145/3565066.3609791
Illi MKaryda MLucero AMandryk RHancock MPerry MCox A(2018)On Visual GranularityProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173721(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173721
Cafaro AGlas NPelachaud CJonker CMarsella SThangarajah JTuyls K(2016)The Effects of Interrupting Behavior on Interpersonal Attitude and Engagement in Dyadic InteractionsProceedings of the 2016 International Conference on Autonomous Agents & Multiagent Systems10.5555/2936924.2937059(911-920)Online publication date: 9-May-2016
https://dl.acm.org/doi/10.5555/2936924.2937059
Bamoallem BWodehouse A(2016)The Role of the Vocal Stream in Telepresence CommunicationProceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments10.1145/2910674.2910706(1-4)Online publication date: 29-Jun-2016
https://dl.acm.org/doi/10.1145/2910674.2910706

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents