short-paper

Audio or tactile feedback: which modality when?

Authors:

Eve Hoggan,

Andrew Crossan,

Stephen A. Brewster,

Topi KaaresojaAuthors Info & Claims

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2253 - 2256

https://doi.org/10.1145/1518701.1519045

Published: 04 April 2009 Publication History

Get Access

Abstract

When designing interfaces for mobile devices it is import-ant to take into account the variety of contexts of use. We present a study that examines how changing noise and dis-turbance in the environment affects user performance in a touchscreen typing task with the interface being presented through visual only, visual and tactile, or visual and audio feedback. The aim of the study is to show at what exact environmental levels audio or tactile feedback become inef-fective. The results show significant decreases in perform-ance for audio feedback at levels of 94dB and above as well as decreases in performance for tactile feedback at vibration levels of 9.18g/s. These results suggest that at these levels, feedback should be presented by a different modality. These findings will allow designers to take advantage of sensor enabled mobile devices to adapt the provided feed-back to the user's current context.

References

[1]

Chang, A. and O'Sullivan, C. Audio-Haptic Feedback in Mobile Phones. In Proc CHI '05, ACM (2005), pp. 1264 -- 1267.

Digital Library

Google Scholar

[2]

Hoggan, E. and Brewster, S. A. Designing Audio and Tactile Crossmodal Icons for Mobile Devices. In Proc ICMI '07, ACM (2007), pp. 162 -- 169.

Digital Library

Google Scholar

[3]

Hoggan, E., Brewster, S., and Johnston, J. Investigating the Effectiveness of Tactile Feedback for Mobile Touchscreens. In Proc CHI' 08, ACM (2008), pp. 1573--1582.

Digital Library

Google Scholar

[4]

Lenay, C., Canu, S., and Villon, P. Technology and Perception: The Contribution of Sensory Substitution Systems. In Proc ICCT, IEEE (1997), pp.44.

Digital Library

Google Scholar

[5]

MacKenzie, I. S. and Soukoreff, R. W. Phrase Sets for Evaluating Text Entry Techniques. In Proc CHI '03, ACM (2003), pp. 754 -- 755.

Digital Library

Google Scholar

[6]

Poupyrev, I. and Maruyama, S. Tactile Interfaces for Small Touch Screens. In Proc User Interface Software and Technology, ACM (2003), pp. 217 -- 220.

Digital Library

Google Scholar

[7]

Raento, M., Oulasvirta, A., Petit, R., and Toivonen, H., "ContextPhone: A Prototyping Platform for Context-Aware Mobile Applications," IEEE Pervasive Computing, vol. 4(2), pp. 51--59, 2005.

Digital Library

Google Scholar

[8]

Soukoreff, R. W. and MacKenzie, I. S. Metrics for Text Entry Research: an Evaluation of MSD and KSPC, and a new Unified Error Metric. In Proc CHI '03, ACM (2003), pp. 113 -- 120.

Digital Library

Google Scholar

[9]

Williamson, J., Murray-Smith, R., and Hughes, S. Shoogle: Excitatory Multimodal Interaction on Mobile Devices. In Proc CHI' 07, ACM (2007), pp. 121 -- 124.

Digital Library

Google Scholar

Cited By

View all

Xia CMin TSugiura Y(2024)AudioMove: Applying the Spatial Audio to Multi-Directional Limb Exercise GuidanceProceedings of the ACM on Human-Computer Interaction10.1145/36764898:MHCI(1-26)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676489
Kim TKim HRoberts AJacobs MKay M(2024)Opportunities in Mental Health Support for Informal Dementia Caregivers Suffering from Verbal AgitationProceedings of the ACM on Human-Computer Interaction10.1145/36373818:CSCW1(1-26)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637381
Dodani AVan Koningsbruggen RHornecker E(2022)Birdbox: Exploring the User Experience of Crossmodal, Multisensory Data RepresentationsProceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia10.1145/3568444.3568455(12-21)Online publication date: 27-Nov-2022
https://dl.acm.org/doi/10.1145/3568444.3568455
Show More Cited By

Index Terms

Audio or tactile feedback: which modality when?
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
    2. Interaction techniques
      1. Auditory feedback

Recommendations

Investigating the effectiveness of tactile feedback for mobile touchscreens
CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

This paper presents a study of finger-based text entry for mobile devices with touchscreens. Many devices are now coming to market that have no physical keyboards (the Apple iPhone being a very popular example). Touchscreen keyboards lack any tactile ...
Crossmodal congruence: the look, feel and sound of touchscreen widgets
ICMI '08: Proceedings of the 10th international conference on Multimodal interfaces

Our research considers the following question: how can visual, audio and tactile feedback be combined in a congruent manner for use with touchscreen graphical widgets? For example, if a touchscreen display presents different styles of visual buttons, ...
Crosstrainer: testing the use of multimodal interfaces in situ
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We report the results of an exploratory 8-day field study of CrossTrainer: a mobile game with crossmodal audio and tactile feedback. Our research focuses on the longitudinal effects on performance with audio and tactile feedback, the impact of context ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2009

2426 pages

ISBN:9781605582467

DOI:10.1145/1518701

General Chairs:
Dan R. Olsen
Brigham Young University
,
Richard B. Arthur
Brigham Young University
,
Program Chairs:
Ken Hinckley
Microsoft Research
,
Meredith Ringel Morris
Microsoft Research
,
Scott Hudson
Carnegie Mellon University
,
Saul Greenberg
University of Calgary

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

CHI '09

Sponsor:

CHI '09: CHI Conference on Human Factors in Computing Systems

April 4 - 9, 2009

MA, Boston, USA

Acceptance Rates

CHI '09 Paper Acceptance Rate 277 of 1,130 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

67
Total Citations
View Citations
2,015
Total Downloads

Downloads (Last 12 months)92
Downloads (Last 6 weeks)11

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Xia CMin TSugiura Y(2024)AudioMove: Applying the Spatial Audio to Multi-Directional Limb Exercise GuidanceProceedings of the ACM on Human-Computer Interaction10.1145/36764898:MHCI(1-26)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676489
Kim TKim HRoberts AJacobs MKay M(2024)Opportunities in Mental Health Support for Informal Dementia Caregivers Suffering from Verbal AgitationProceedings of the ACM on Human-Computer Interaction10.1145/36373818:CSCW1(1-26)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637381
Dodani AVan Koningsbruggen RHornecker E(2022)Birdbox: Exploring the User Experience of Crossmodal, Multisensory Data RepresentationsProceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia10.1145/3568444.3568455(12-21)Online publication date: 27-Nov-2022
https://dl.acm.org/doi/10.1145/3568444.3568455
Xia CFang XArakawa RSugiura Y(2022)VoLearnProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35345766:2(1-26)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3534576
Villanueva AZhu ZLiu ZWang FChidambaram SRamani K(2022)ColabAR: A Toolkit for Remote Collaboration in Tangible Augmented Reality LaboratoriesProceedings of the ACM on Human-Computer Interaction10.1145/35129286:CSCW1(1-22)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512928
Feng FBennett DFan ZMetatla O(2022)It’s Touching: Understanding Touch-Affect Association in Shape-Change with Kinematic FeaturesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502003(1-18)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502003
Yildirim C(2022)Point and Select: Effects of Multimodal Feedback on Text Entry Performance in Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2022.210733039:19(3815-3829)Online publication date: 24-Aug-2022
https://doi.org/10.1080/10447318.2022.2107330
Hoeber OHarvey MDewan Sagar SPointon M(2022)The effects of simulated interruptions on mobile search tasksJournal of the Association for Information Science and Technology10.1002/asi.2457973:6(777-796)Online publication date: 26-Apr-2022
https://dl.acm.org/doi/10.1002/asi.24579
Bermejo CHui P(2021)A Survey on Haptic Technologies for Mobile Augmented RealityACM Computing Surveys10.1145/346539654:9(1-35)Online publication date: 8-Oct-2021
https://dl.acm.org/doi/10.1145/3465396
Nasser AZheng KZhu K(2021)ThermEarhook: Investigating Spatial Thermal Haptic Feedback on the Auricular Skin AreaProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479922(662-672)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479922
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Investigating the effectiveness of tactile feedback for mobile touchscreens

Crossmodal congruence: the look, feel and sound of touchscreen widgets

Crosstrainer: testing the use of multimodal interfaces in situ