Affective Quality of Audio Feedback on Mobile Devices in Different Contexts
Pages 1 - 21
Abstract
Sound is a common means to give feedback on mobile devices. Much research has been conducted to examine the learnability and user performance with systems that provide audio feedback. In many cases a training period is necessary to understand the meaning of a specific feedback, because their functional connotation may be ambiguous. Additionally, no standardized evaluation method to measure the subjective quality of these messages has been established; especially regarding the affective quality of feedback sounds. The authors describe a series of experiments to investigate the affective impression of audio feedback on mobile devices as well as their functional meaning under varying contexts prototypical for mobile phone usage. Results indicate that context influences the emotional impression and that there is a relation between affective quality and functional appropriateness. These findings confirm that emotional stimuli are suitable as feedback messages in the context of mobile HCI and that context matters for the affective quality of sounds emitted by mobile phones.
References
[1]
Absar, R., & Guastavino, C. (2008). Usability of Non-Speech Sounds in User Interfaces. Paper presented at the 14th International Conference on Auditory Display, Paris, France.
[2]
Ballas, J. A. (1993). Common factors in the identification of an assortment of brief everyday sounds. Journal of Experimental Psychology. Human Perception and Performance, 19(2), 250—267. 8473838.
[3]
Blattner, M. M., Sumikawa, D. A., & Greenberg, R. M. (1989). Earcons and icons: Their structure and common design principles. Human-Computer Interaction, 4(1), 11—44.
[4]
Bradley, M. M., & Lang, P. J. (1994). Measuring emotion: The self-assessment manikin and the semantic differential . Journal of Behavior Therapy and Experimental Psychiatry, 25(1), 49—59. 7962581.
[5]
Bradley, M. M., & Lang, P. J. (2000). Affective reactions to acoustic stimuli. Psychophysiology, 37(2), 204——215. 10731770.
[6]
Bradley, M. M., & Lang, P. J. (2007). The international affective digitized sounds (2nd Edition; IADS-2). Affective Ratings of Sounds and Instruction Manual University of Florida, Gainesville, Fl.
[7]
Brewster, S. (2002). Non-speech auditory output. In Jacko, J. A., & Sears, A. (Eds.), Human-computer interaction handbook (pp. 220——239). Lawrence Erlbaum Assoc Inc.
[8]
BrewsterS.ChohanF.BrownL. (2007). Tactile feedback for mobile interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, San Jose, CA. 10.1145/1240624.1240649
[9]
BrewsterS.RatyV.-P.KortekangasA. (1996). Earcons as a method of providing navigational cues in a menu hierarchy. In Proceedings of HCI on People and Computers XI. 10.1007/978-1-4471-3588-3_12
[10]
Gaver, W. W. (1986). Auditory icons: Using sound in computer interfaces. Human-Computer Interaction, 2(2), 167—177.
[11]
Hoggan, E., & Brewster, S. (2007). Designing audio and tactile crossmodal icons for mobile devices. Paper presented at the ICMI, Nagoya, Aichi, Japan. 10.1145/1322192.1322222
[12]
HogganE.CrossanA.BrewsterS. A.KaaresojaT. (2009). Audio or tactile feedback: which modality when? In Proceedings of the 27th International Conference on Human Factors in Computing Systems, Boston, MA. 10.1145/1518701.1519045
[13]
Jekosch, U. (1999). Meaning in the context of sound quality assessment. Acta Acustica united with Acustica, 85(5), 681—684.
[14]
Lang, P. J. (2010). Emotion and motivation: Toward consensus definitions and a common research purpose. Emotion Review, 2(3), 229—233.
[15]
Lang, P. J., & Bradley, M. M. (2010). Emotion and the motivational brain. Biological Psychology, 84(3), 437——450. 19879918.
[16]
Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (2005). International affective picture system (IAPS): Affective ratings of pictures and instruction manual: NIMH. Center for the Study of Emotion & Attention.
[17]
Larsson, P., Opperud, A., Fredriksson, K., & Väästfjäll, D. (2009). Emotional and behavioral response to auditory icons and earcons in driver-vehicle interfaces. Paper presented at the 21st International Technical Conference On the Enhanced Safety of Vehicles, Stuttgart, Germany.
[18]
Lee, C., & Christopher, B. (2004). Focus groups. Handbook of human factors and ergonomics methods (pp. 32-31——32-37). CRC Press.
[19]
Lemmens, P. M. C., Haan, A., Galen, G. P., & Meulenbroek, R. G. J. (2007). Emotionally charged earcons reveal affective congruency effects. Ergonomics, 12(12), 2017——2025. 18033613.
[20]
Leplatre, G., & Brewster, S. A. (2000). Designing non-speech sounds to support navigation in mobile phone menus. Paper presented at the 6th International Conference on Auditory Display (ICAD), Atlanta, Georgia, USA.
[21]
Peirce, C. S. (1960). Collected papers of Charles Sanders Peirce. Cambridge: Harvard University Press.
[22]
Perry, N. C., Stevens, C. J., Wiggins, M. W., & Howell, C. E. (2007). Cough once for danger: Icons versus abstract warnings as informative alerts in civil aviation. Human Factors: The Journal of the Human Factors and Ergonomics Society, 49(6), 1061—1071. 18074705.
[23]
Probst, W. (2003). Bildschirmarbeit - Lärmminderung in Mehrpersonenbüros. Arbeitswissenschaftliche Erkenntnisse der BAuA Nr.124. Dortmund, Germany.
[24]
Schleicher, R., Westermann, T., Weiss, B., Wechsung, I., & Mööller, S. (2013). Research on mobile HCI — taken out of context? In Rizvanoglu, K., & Cetin, G. (Eds.), Research and design innovations for mobile user experience (pp. 60——75). IGI Global.
[25]
Schubert, E. (2001). Continuous measurements of self-report emotional response to music. In Juslin, P. N., & Sloboda, J. A. (Eds.), Music and emotion (pp. 393——414). Oxford University Press.
[26]
Seebode, J., Schleicher, R., & Mööller, S. (2012). Affective quality of audio feedback in different contexts. Paper presented at the 11th International Conference on Mobile and Ubiquitous Multimedia (MUM), Ulm, Germany. 10.1145/2406367.2406407
[27]
Sikora, C. A., Roberts, L., & Murray, L. T. (1995). Musical vs. real world feedback signals. Paper presented at the Conference companion on Human factors in computing systems, Denver, CO. 10.1145/223355.223534
[28]
Sound Ideas. (2012). The BBC sound effects library - Original series. Retrieved March 1, 2012, from http://www.sound-ideas.com/bbc.html
[29]
Stamps, A. E. (2005). In search of dominance: The case of the missing dimension. Perceptual and Motor Skills, 100(2), 559—566. 15974366.
[30]
Stephan, K. L., Smith, S. E., Martin, R. L., Parker, S. P., & McAnally, K. I. (2006). Learning and retention of associations between auditory icons and denotative referents: Implications for the design of auditory warnings. Human Factors, 48(2), 288—299. 16884050.
[31]
Stevens, C. J., Brennan, D., Petocz, A., & Howell, C. (2009). Designing informative warning signals: Effects of indicator type, modality, and task demand on recognition speed and accuracy. Advances in Cognitive Psychology, 5(5), 84—90. 20523852.
[32]
Susini, P., Misdariis, N., Lemaitre, G., & Houix, O. (2012). Naturalness influences the perceived usability and pleasantness of an interface's sonic feedback. Journal on Multimodal User Interfaces, 5(3), 175—186.
Recommendations
Affective quality of audio feedback in different contexts
MUM '12: Proceedings of the 11th International Conference on Mobile and Ubiquitous MultimediaTo give feedback on mobile devices, sound is commonly used in different ways. Much research has focused on the learnability and user performance with systems that have audio feedback. But so far, there is no standardized method to evaluate the ...
Investigating the affective impression of tactile feedback on mobile devices
BCS-HCI '13: Proceedings of the 27th International BCS Human Computer Interaction ConferenceOn mobile devices, vibrotactile messages are a common way to give feedback to the user. They might be a less obtrusive means to communicate information about the system status compared to auditory feedback. Much research has focused on the possibilities ...
The Effect of Different Affective Arousal Levels on Taste Perception
ICMI '20 Companion: Companion Publication of the 2020 International Conference on Multimodal InteractionThe emotions we experience shape our perception, and our emotion is shaped by our perceptions. Taste perception is also influenced by emotions. Positive and negative emotions alter sweetness, sourness, and bitterness perception. However, most previous ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Publisher
IGI Global
United States
Publication History
Published: 01 October 2014
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Jan 2025