More Web Proxy on the site http://driver.im/

research-article

Towards Emotion Acquisition in IT Usability Evaluation Context

Author:

Agnieszka LandowskaAuthors Info & Claims

MIDI '15: Proceedings of the Mulitimedia, Interaction, Design and Innnovation

Article No.: 5, Pages 1 - 9

https://doi.org/10.1145/2814464.2814470

Published: 29 June 2015 Publication History

Abstract

The paper concerns extension of IT usability studies with automatic analysis of the emotional state of a user. Affect recognition methods and emotion representation models are reviewed and evaluated for applicability in usability testing procedures. Accuracy of emotion recognition, susceptibility to disturbances, independence on human will and interference with usability testing procedures are the criteria, that were identified and addressed in this paper. A study of a usability evaluation case was also performed to spot realistic challenges. As a result, a number of concerns were identified, providing a list of pros and cons for affect acquisition applied in usability testing context.

References

[1]

Hyung Il Ahn, Rosalind Picard. 2014. Measuring Affective-Cognitive Experience and Predicting Market Success. Affective Computing, IEEE Transactions on, vol.5, no.2, pp.173, 186, April-June 1 2014.

[2]

Bill Albert, Tom Tullis. 2013. Measuring the user experience: collecting, analyzing, and presenting usability metrics. Newnes.

Digital Library

[3]

Jeremy N. Bailenson, Emmanuel D. Pontikakis, Iris B. Mauss, James J. Gross, Maria E. Jabon, Cendri A.C. Hutcherson, Clifford Nass, Oliver John. 2008. Real-time classification of evoked emotions using facial feature tracking and physiological responses. International journal of human-computer studies, 66(5): 303--317.

Digital Library

[4]

Nigel Bevan. 2009. What is the difference between the purpose of usability and user experience evaluation methods. In Proceedings of the Workshop UXEM (Vol. 9).

[5]

Haji Binali, Chen Wu, Vidyasagar Potdar. 2010. Computational approaches for emotion detection in text. 4th IEEE International Conference on Digital Ecosystems and Technologies (DEST): 172--177.

[6]

Paul Ekman, Richard J. Davidson. 1999. The Nature of Emotion: Fundamental Questions, Oxford University Press, 1994

[7]

Hatice Gunes, Björn Schuller. 2013. Categorical and dimensional affect analysis in continuous input: Current trends and future directions. Image and Vision Computing, 31(2): 120--136.

Digital Library

[8]

Hatice Gunes, Massimo Piccardi. 2005 Affect Recognition from Face and Body: Early Fusion vs. Late Fusion, IEEE International Conference on Systems, Man and Cybernetics, vol. 4: 3437--3443.

[9]

Dan Hill, 2010. Emotionomics: Leveraging Emotions for Business Success, Cogan Page, USA.

[10]

ISO. 1998. Norm 9241: Ergonomics of human-system interaction.

[11]

Rana El Kaliouby and Peter Robinson. 2004. Real-time inference of complex mental states from facial expressions and headgestures. In CVPRW. Proceedings of the Conference on Computer Vision and Pattern Recognition Workshop, vol. 10, IEEE Computer Society

Digital Library

[12]

Agata Kołakowska, Agnieszka Landowska, Mariusz Szwoch, Wioleta Szwoch, Michal R Wrobel. 2013. Emotion recognition and its application in software engineering, Proc. of 6th International Conference on Human-System Interaction, Gdansk: 532--539.

[13]

Agata Kołakowska, Agnieszka Landowska, Mariusz Szwoch, Wioleta Szwoch, Michal R Wrobel. 2014. Emotion recognition and its applications, Human-Computer Systems Interaction: Backgrounds and Applications 3, Springer: 51--62.

[14]

Agata Kołakowska. 2013. A review of emotion recognition methods based on keystroke dynamics and mouse movements. In: Proc 6th International Conference on Human Systems Interaction: 548--555.

[15]

Agnieszka Landowska. 2014. Emotion monitoring - verification of physiological characteristics measurement procedures, Metrology and Measurement Systems Journal, Vol XXI, No. 4: 719--732.

[16]

Agnieszka Landowska, Michal R Wrobel. 2015. Affective reactions to playing digital games, 8th Int. Conf. on Human-Systems Interaction (unpublished).

[17]

Agnieszka Landowska. 2013. Affective computing and affective learning -- methods, tools and prospects, EduAction. Electronic education magazine, 1(5): 16--31.

[18]

Philip Lew, Luis Olsina, Pablo Becker, Li Zhang. 2012. An integrated strategy to systematically understand and manage quality in use for web applications. Requirements Engineering, 17(4): 299--330.

Digital Library

[19]

Albert Mehrabian. 1997. Comparison of the PAD and PANAS as models for describing emotions and for differentiating anxiety from depression. Journal of psychopathology and behavioral assessment, 19(4): 331--357.

[20]

Alena Neviarouskaya, Helmut Prendinger, Mitsuru Ishizuka. 2009. Compositionality principle in recognition of finegrained emotions from text. Proceedings of the Third International Conference on Weblogs and Social Media: 278--281.

[21]

Jakob Nielsen, 1993. Usability Engineering, Academic Press/AP Professional, Cambridge, MA ISBN 0-12-518406-9

Digital Library

[22]

Maja Pantic, Leon J. M. Rothkrantz, 2000. Automatic Analysis of Facial Expressions: The State of the Art, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.12: 1424-1445.

Digital Library

[23]

Maja Pantic, Leon J. M. Rothkrantz. 2003. Toward an affect-sensitive multimodal human-computer interaction," Proceedings of the IEEE, vol.91, no.9: 1370--1390.

[24]

Rosalind Picard, Shaundra Bryant Daily. 2005. Evaluating affective interactions: Alternatives to asking what users feel. CHI Workshop on Evaluating Affective Interfaces: Innovative Approaches

[25]

Jianhua Tao, Tieniu Tan. 2005. Affective computing: A review. In Affective computing and intelligent interaction. Springer Berlin Heidelberg: 981--995.

Digital Library

[26]

Robert E. Thayer. 1989. The biopsychology of mood and arousal: Oxford University Press.

[27]

Arnold P. O. S. Vermeeren, Effie Lai-Chong, Virpi Roto, Marianna Obrist, Jettie Hoonhout, Kaisa Väänänen-Vainio-Mattila. 2010. User experience evaluation methods: current state and development needs. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, ACM: 521--530.

Digital Library

[28]

Lisa M. Vizer, Lina Zhou, Andrew Sears. 2009. Automated stress detection using keystroke and linguistic features, Int. Journal of Human-Computer Studies 67: 870--886.

Digital Library

[29]

Jun Wang, Lijun Yin, Xiaozhou Wei, Yi Sun. 2006. 3D facial expression recognition based on primitive surface feature distribution, Computer Vision and Pattern Recognition, vol. 2: 1399--1406.

Digital Library

[30]

Cynthia Whissell. 2009. Using the revised Dictionary of Affect in Language to quantify the emotional undertones of samples of natural language. Psychological Reports, 105: 1--13.

[31]

Zhihong Zeng, Maja Pantic, Glenn I. Roisman, Thomas S. Huang. 2009. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(1): 39--58.

Digital Library

[32]

Philippe Zimmermann, Patrick Gomez, Brigitta Danuser, Sissel Guttormsen Schär. 2006. Extending usability: putting affect into the user-experience. Proceedings of NordiCHI'06: 27--32.

Cited By

van Erven RCanedo E(2023)Measurement of User's Satisfaction of Digital Products through Emotion RecognitionProceedings of the XXII Brazilian Symposium on Software Quality10.1145/3629479.3629488(62-71)Online publication date: 7-Nov-2023
https://dl.acm.org/doi/10.1145/3629479.3629488
Landowska AZawadzka TZawadzki M(2022)Mining Inconsistent Emotion Recognition Results With the Multidimensional ModelIEEE Access10.1109/ACCESS.2021.313907810(6737-6759)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2021.3139078
de Souza Veriscimo EBernardes Júnior JDigiampietri L(2021)Facial Emotion Recognition in UX Evaluation: A Systematic ReviewHuman-Computer Interaction. Theory, Methods and Tools10.1007/978-3-030-78462-1_40(521-534)Online publication date: 3-Jul-2021
https://doi.org/10.1007/978-3-030-78462-1_40
Show More Cited By

Recommendations

Emotional web usability evaluation
HCI'07: Proceedings of the 12th international conference on Human-computer interaction: applications and services

This paper presents a framework for emotional interface where a method for emotional interface evaluation is purposed and the emotion eliciting conditions in online graphic interfaces are explored. Those eliciting conditions are concerning the design ...
Emotion Recognition Using Physiological Signals
MIDI '15: Proceedings of the Mulitimedia, Interaction, Design and Innnovation

In this paper the problem of emotion recognition using physiological signals is presented. Firstly the problems with acquisition of physiological signals related to specific human emotions are described. It is not a trivial problem to elicit real ...
Emotion and mood recognition in response to video

This paper presents a subject-dependent homogenous emotion recognition method using electroencephalogram (EEG) signals in response to video contents, and a correlation between emotions and moods of subjects in resting state. In the recent years, there ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MIDI '15: Proceedings of the Mulitimedia, Interaction, Design and Innnovation

June 2015

165 pages

ISBN:9781450336017

DOI:10.1145/2814464

Conference Chairs:
Marcin Sikorski,
Anke Dittmar,
Program Chairs:
Krzysztof Marasek,
Tjerk de Greef

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 June 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

MIDI '15

MIDI '15: Mulitimedia, Interaction, Design and Innnovation

June 29 - 30, 2015

Warsaw, Poland

Acceptance Rates

MIDI '15 Paper Acceptance Rate 18 of 29 submissions, 62%;

Overall Acceptance Rate 35 of 62 submissions, 56%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
140
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

van Erven RCanedo E(2023)Measurement of User's Satisfaction of Digital Products through Emotion RecognitionProceedings of the XXII Brazilian Symposium on Software Quality10.1145/3629479.3629488(62-71)Online publication date: 7-Nov-2023
https://dl.acm.org/doi/10.1145/3629479.3629488
Landowska AZawadzka TZawadzki M(2022)Mining Inconsistent Emotion Recognition Results With the Multidimensional ModelIEEE Access10.1109/ACCESS.2021.313907810(6737-6759)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2021.3139078
de Souza Veriscimo EBernardes Júnior JDigiampietri L(2021)Facial Emotion Recognition in UX Evaluation: A Systematic ReviewHuman-Computer Interaction. Theory, Methods and Tools10.1007/978-3-030-78462-1_40(521-534)Online publication date: 3-Jul-2021
https://doi.org/10.1007/978-3-030-78462-1_40
Stefancova EMoro RBielikova M(2018)Towards Detection of Usability Issues by Measuring EmotionsNew Trends in Databases and Information Systems10.1007/978-3-030-00063-9_8(63-70)Online publication date: 31-Aug-2018
https://doi.org/10.1007/978-3-030-00063-9_8
Munim KIslam IKhatun MKarim MIslam M(2017)Towards developing a tool for UX evaluation using facial expression2017 3rd International Conference on Electrical Information and Communication Technology (EICT)10.1109/EICT.2017.8275227(1-6)Online publication date: Dec-2017
https://doi.org/10.1109/EICT.2017.8275227

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents