More Web Proxy on the site http://driver.im/

research-article

Yelling in the hall: using sidetone to address a problem with mobile remote presence systems

Authors:

Andreas Paepcke,

Leila Takayama,

Blaise GassendAuthors Info & Claims

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

Pages 107 - 116

https://doi.org/10.1145/2047196.2047209

Published: 16 October 2011 Publication History

Abstract

In our field deployments of mobile remote presence (MRP) systems in offices, we observed that remote operators of MRPs often unintentionally spoke too loudly. This disrupted their local co-workers, who happened to be within earshot of the MRP system. To address this issue, we prototyped and empirically evaluated the effect of sidetone to help operators self regulate their speaking loudness. Sidetone is the intentional, attenuated feedback of speakers' voices to their ears while they are using a telecommunication device. In a 3-level (no sidetone vs. low sidetone vs. high sidetone) within- participants pair of experiments, people interacted with a confederate through an MRP system. The first experiment involved MRP operators using headsets with boom microphones (N=20). The second experiment involved MRP operators using loudspeakers and desktop microphones (N=14). While we detected the effects of the sidetone manipulation in our audio-visual context, the effect was attenuated in comparison to earlier audio-only studies. We hypothesize that the strong visual component of our MRP system interferes with the sidetone effect. We also found that engaging in more social tasks (e.g., a getting-to-know-you activity) and more intellectually demanding tasks (e.g., a creativity exercise) influenced how loudly people spoke. This suggests that testing such sidetone effects in the typical read-aloud setting is insufficient for generalizing to more interactive, communication tasks. We conclude that MRP application support must reach beyond the time honored audio-only technologies to solve the problem of excessive speaker loudness.

References

[1]

American National Standards of the Acoustical Society of America. American National Standard method for measuring the intelligibility of speech over communication systems, May 2009.

[2]

M. Argyle. Bodily Communication. Methuen, New York, NY, 1975.

[3]

J. M. Beer and L. Takayama. Mobile remote presence systems for older adults: Acceptance, benefits, and concern. In Proceedings of Human Robot Interaction: HRI, pages 19--26, 2011.

Digital Library

[4]

H. Clark. Using Language. Cambridge University Press, Cambridge, UK, 1996.

[5]

D.J. Goodman and J.D. Johnston. Sidetone expansion for the regulation of talker loudness. Electronics Letters, 15(16):492 -- 493, 1979.

[6]

J.P. Guilford, P.R. Christensen, P.R. Merrifield, and R.C. Wilson. Alternate uses task manual, 1978.

[7]

E.T. Hall. The Hidden Dimension. Doubleday, New York, NY, 1966.

[8]

E. S. Jones. Providing Foldback with Out-Of-Phase Loudspeakers. Journal of the Audio Engineering Society, 19(4):306--&, 1971.

[9]

N. P. Jouppi. First steps toward mutually-immersive mobile telepresence. In Proceedings of Computer Supported Cooperative Work: CSCW, pages 354--363, 2002.

Digital Library

[10]

H. Lane, B. Tranel, and C. Sisson. Regulation of voice communication by sensory dynamics. Journal of the Acoustical Society of America, 47:618 -- 624, 1970.

[11]

M.-K. Lee and L. Takayama. "Now, I Have a Body": Uses and social norms for mobile remote presence in the workplace. In Proceedings of Human Factors in Computing Systems: CHI, 2011.

Digital Library

[12]

E. Lombard. Le signe de l'elevation de la voix. Ann. maladies oreille larynx nez pharynx, 37:109--119, 1911.

[13]

D. Nestel, P. Sains, C.M. Wetzel, C. Nolan, A. Tay, R.L. Kneebone, and A.W. Darzi. Communication skills for mobile remote presence technology in clinical interactions. Journal of Telemed Telecare, 13(2):100--104, 2007.

[14]

D. A. Norman. Minimizing the annoyance of the mobile phone, 2005.

[15]

E. Paulos and J.F. Canny. PRoP: Personal roving presence. In Proceedings of Human Factors in Computing Systems: CHI, pages 296--303, 1998.

Digital Library

[16]

B. Reeves and C. Nass. The media equation: How people treat computers, television, and new media like real people and places. Cambridge University Press, 1996.

Digital Library

[17]

D. Sakamoto, T. Kanda, T. Ono, H. Ishiguro, and N. Hagita. Android as a telecommunication medium with a human-like presence. In Proceedings of Human Robot Interaction: HRI, pages 193--200, 2007.

Digital Library

[18]

G. M. Siegel, H. L. Pick, M. G. Olsen, and L. Sawin. Auditory feedback in the regulation of vocal intensity of preschool children. Developmental Psychology, 12(3):255--261, 1976.

[19]

G.M. Siegel and H.L. Pick Jr. Auditory feedback in the regulation of voice. Journal of the Acoustical Society of America, 56(5):1618 -- 1624, 1974.

[20]

L. Takayama and C. Pantofaru. Influences on proxemic behaviors in human-robot interaction. In Proceedings of Intelligent Robotic Systems: IROS, pages 5495--5502, St. Louis, MO, USA, 2009.

Digital Library

[21]

L. Takayama, J. G. Sison, B. Lathrop, N. Wolfe, A. Chiang, A. Nielsen, and C. Nass. Bringing design considerations to the mobile phone and driving debate. In Proceedings of Human Factors in Computing Systems: CHI, pages 1643--1646, 2009.

Digital Library

[22]

D. Tannen. You Just Don't Understand: Women and Men in Conversation. Harper Paperbacks, 2001.

[23]

K. Tsui, M. Desai, H. A. Yanco, and C. Uhlik. Exploring use cases for telepresence robots. In Proceedings of Human Robot Interaction: HRI, pages 11--18, 2011.

Digital Library

[24]

G. Venolia, J. Tang, R. Cervantes, S. Bly, G. Robertson, B.s Lee, and K. Inkpen. Embodied social proxy: Mediating interpersonal connection in hub-and-satellite teams. In Proceedings of Human Factors in Computing Systems: CHI, pages 1049--1058, 2010.

Digital Library

[25]

Wikipedia. Dynamic range compression.

[26]

M. Wolff. Peoples In Places: The Sociology Of The Familiar, chapter Notes On The Behaviour Of Pedestrians, pages 35--48. Praeger, 1975.

[27]

N.H. Wolfinger. Notes on the behaviour of pedestrians. Journal of Contemporary Ethnography, 24:323--340, 1995.

Cited By

Elmimouni HRode JŠabanović S(2024)Articulation work for supporting the values of students attending class via telepresence robotsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103318190(103318)Online publication date: Oct-2024
https://doi.org/10.1016/j.ijhcs.2024.103318
Rueben MSyed MLondon ECamarena MShin EZhang YWang TGroechel TLee RMatarić M(2021)Long-Term, in-the-Wild Study of Feedback about Speech Intelligibility for K-12 Students Attending Class via a Telepresence RobotProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479893(567-576)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479893
Tholander JRossitto CRostami AIshiguro YMiyaki TRekimoto JKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Design in Action: Unpacking the Artists’ Role in Performance-Led ResearchProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445056(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445056
Show More Cited By

Index Terms

Yelling in the hall: using sidetone to address a problem with mobile remote presence systems
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Auditory feedback

Recommendations

The effect of the acoustics of sound control rooms on the perceived acoustics of a live concert hall recording
AMTA'10: Proceedings of the 11th WSEAS international conference on Acoustics & music: theory & applications

Live recordings of music and speech in concert halls have acoustical properties, such as reverberation, definition, clarity and spaciousness. Sound engineers play back these recordings through loudspeakers in sound control rooms for audio CD or film. ...
Investigating interruptions in the context of computerised cognitive testing for older adults
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Interruptions in the home pose a threat to the validity of self-administered computerised cognitive testing. We report the findings of a laboratory experiment investigating the effects of increased interruption workload demand on older adults' ...
Development of a Multi-modal Multi-user Telepresence and Teleaction System

The presented multi-user telepresence and teleaction system enables two teleoperators, which are independently controlled by two human operators, to perform collaborative actions in a remote ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

October 2011

654 pages

ISBN:9781450307161

DOI:10.1145/2047196

General Chair:
Jeff Pierce
IBM Research, USA
,
Program Chairs:
Maneesh Agrawala
University of California, Berkeley, USA
,
Scott Klemmer
Stanford University, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '11

Sponsor:

UIST '11: The 24th Annual ACM Symposium on User Interface Software and Technology

October 16 - 19, 2011

California, Santa Barbara, USA

Acceptance Rates

UIST '11 Paper Acceptance Rate 67 of 262 submissions, 26%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
305
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Elmimouni HRode JŠabanović S(2024)Articulation work for supporting the values of students attending class via telepresence robotsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103318190(103318)Online publication date: Oct-2024
https://doi.org/10.1016/j.ijhcs.2024.103318
Rueben MSyed MLondon ECamarena MShin EZhang YWang TGroechel TLee RMatarić M(2021)Long-Term, in-the-Wild Study of Feedback about Speech Intelligibility for K-12 Students Attending Class via a Telepresence RobotProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479893(567-576)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479893
Tholander JRossitto CRostami AIshiguro YMiyaki TRekimoto JKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Design in Action: Unpacking the Artists’ Role in Performance-Led ResearchProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445056(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445056
Ambeth Kumar VMalathi SKumar AM PVeluvolu K(2020)Active Volume Control in Smart Phones Based on User Activity and Ambient NoiseSensors10.3390/s2015411720:15(4117)Online publication date: 24-Jul-2020
https://doi.org/10.3390/s20154117
Rueben MGroechel TZhang YMatarić MRagusa GBelpaeme TYoung JGunes HRiek L(2020)Increasing Telepresence Robot Operator Awareness of Speaking Volume AppropriatenessCompanion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3371382.3378388(421-423)Online publication date: 23-Mar-2020
https://dl.acm.org/doi/10.1145/3371382.3378388
Fitter NRaghunath NCha ESanchez CTakayama LMataric M(2020) Are We There Yet? Comparing Remote Learning Technologies in the University Classroom IEEE Robotics and Automation Letters10.1109/LRA.2020.29709395:2(2706-2713)Online publication date: Apr-2020
https://doi.org/10.1109/LRA.2020.2970939
Hornbæk KMottelson AKnibbe JVogel D(2019)What Do We Mean by “Interaction”? An Analysis of 35 Years of CHIACM Transactions on Computer-Human Interaction10.1145/332528526:4(1-30)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1145/3325285
Ahumada-Newhart VOlson J(2019)Going to School on a RobotACM Transactions on Computer-Human Interaction10.1145/332521026:4(1-28)Online publication date: 17-Jun-2019
https://dl.acm.org/doi/10.1145/3325210
Wang CFeng DTong WLiu JLi ZChang JZhang YWu BXu JZhao WLi YRen R(2019)Cross-point Resistive MemoryACM Transactions on Design Automation of Electronic Systems10.1145/332506724:4(1-37)Online publication date: 20-Jun-2019
https://dl.acm.org/doi/10.1145/3325067
Rapp ATirassa MTirabeni L(2019)Rethinking Technologies for Behavior ChangeACM Transactions on Computer-Human Interaction10.1145/331814226:4(1-30)Online publication date: 17-Jun-2019
https://dl.acm.org/doi/10.1145/3318142
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents