More Web Proxy on the site http://driver.im/

research-article

Affective effects of gamification: using biosignals to measure the effects on working and learning users

Authors:

Adrian ReesAuthors Info & Claims

PETRA '19: Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Pages 1 - 10

https://doi.org/10.1145/3316782.3316783

Published: 05 June 2019 Publication History

Abstract

What emotional effects does gamification have on users who work or learn with repetitive tasks? In this work, we use biosignals to analyze these affective effects of gamification. After a brief discussion of related work, we describe the implementation of an assistive system augmenting work by projecting elements for guidance and gamification. We also show how this system can be extended to analyse users' emotions. In a user study, we analyse both biosignals (facial expressions and electrodermal activity), and regular performance measures (error rate and task completion time).

For the performance measures, the results confirm known effects like increased speed and slightly increased error rate. In addition, the analysis of the biosignals provides strong evidence for two major affective effects: the gamification of work and learning tasks incites highly significantly more positive emotions and increases emotionality altogether. The results add to the design of assistive systems, which are aware of the physical as well as the affective context.

References

[1]

Hillel Aviezer, Yaacov Trope, and Alexander Todorov. 2012. Body Cues, Not Facial Expressions, Discriminate Between Intense Positive and Negative Emotions. Science 338, 6111: 1225--1229.

[2]

Nigel Bosch, Sidney D'Mello, Ryan Baker, Jaclyn Ocumpaugh, Valerie Shute, Matthew Ventura, Lubin Wang, and Weinan Zhao. 2015. Automatic Detection of Learning-Centered Affective States in the Wild. In Proceedings of the 20th International Conference on Intelligent User Interfaces (IUI '15), 379--388.

Digital Library

[3]

Nigel Bosch, Sidney K. D'mello, Jaclyn Ocumpaugh, Ryan S. Baker, and Valerie Shute. 2016. Using Video to Automatically Detect Learner Affect in Computer-Enabled Classrooms. ACM Trans. Interact. Intell. Syst. 6, 2: 17:1--17:26.

Digital Library

[4]

Wolfram Boucsein. 2012. Electrodermal Activity. Springer US, Boston, MA.

[5]

Karen Church, Eve Hoggan, and Nuria Oliver. 2010. A Study of Mobile Mood Awareness and Communication Through MobiMood. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (NordiCHI '10), 128--137.

Digital Library

[6]

Albert M. Cook. 2010. The future of assistive technologies. In ASSETS '10 Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility, 1.

Digital Library

[7]

Albert M Cook and Susan M Hussey. 1995. Assistive technologies: principles and practice. Mosby, St. Louis.

[8]

Mihály Csíkszentmihályi. 1975. Beyond boredom and anxiety. Jossey-Bass Publishers, San Francisco, USA.

[9]

Sebastian Deterding, Miguel Sicart, Lennart Nacke, Kenton O'Hara, and Dan Dixon. 2011. Gamification. using game-design elements in non-gaming contexts. In Proceedings of the 2011 annual conference extended abstracts on Human factors in computing systems (CHI EA '11), 2425--2428.

Digital Library

[10]

Marieke van Dooren, J. J. G. Gert-Jan de Vries, and Joris H. Janssen. 2012. Emotional sweating across the body: comparing 16 different skin conductance measurement locations. Physiology & Behavior 106, 2: 298--304.

[11]

Paul Ekman and Wallace V. Friesen. 1976. Measuring facial movement. Environmental psychology and nonverbal behavior 1, 1: 56--75. Retrieved April 18, 2017 from http://link.springer.com/article/10.1007/BF01115465

[12]

Markus Funk, Oliver Korn, and Albrecht Schmidt. 2014. Assisitive Augmentation at the Manual Assembly Workplace using In-Situ Projection. In CHI '14 Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems.

[13]

Ashish Kapoor, Winslow Burleson, and Rosalind W. Picard. 2007. Automatic prediction of frustration. International Journal of Human-Computer Studies 65, 8: 724--736.

Digital Library

[14]

Oliver Korn. 2012. Industrial playgrounds: how gamification helps to enrich work for elderly or impaired persons in production. In Proceedings of the 4th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '12), 313--316.

Digital Library

[15]

Oliver Korn, Stephan Abele, Albrecht Schmidt, and Thomas Hörz. 2013. Augmentierte Produktion. Assistenzsysteme mit Projektion und Gamification für leistungsgeminderte und leistungsgewandelte Menschen. In Mensch & Computer 2013 - Tagungsband, 119--128.

[16]

Oliver Korn, Sandra Boffo, and Albrecht Schmidt. 2015. The Effect of Gamification on Emotions - The Potential of Facial Recognition in Work Environments. In Human-Computer Interaction: Design and Evaluation, Masaaki Kurosu (ed.). Springer International Publishing, Cham, 489--499. Retrieved August 10, 2015 from http://link.springer.com/10.1007/978-3-319-20901-2_46

[17]

Oliver Korn and Alan Dix. 2016. Educational Playgrounds: How Context-aware Systems Enable Playful Coached Learning. interactions 24, 1: 54--57.

Digital Library

[18]

Oliver Korn, Markus Funk, and Albrecht Schmidt. 2015. Towards a gamification of industrial production: a comparative study in sheltered work environments. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '15), 84--93.

Digital Library

[19]

Oliver Korn, Markus Funk, and Albrecht Schmidt. 2015. Design Approaches for the Gamification of Production Environments. A Study Focusing on Acceptance. In PETRA '15 Proceedings of the 8th International Conference on PErvasive Technologies Related to Assistive Environments.

Digital Library

[20]

Oliver Korn, Markus Funk, and Albrecht Schmidt. 2015. Assistive Systems for the Workplace: Towards Context-Aware Assistance. In Assistive Technologies for Physical and Cognitive Disabilities, Lau Bee Theng (ed.). IGI Global, 121--133. Retrieved from

[21]

Oliver Korn, Adrian Rees, and Alan Dix. 2017. Designing a System for Playful Coached Learning in the STEM Curriculum. In Proceedings of the 2017 ACM Workshop on Intelligent Interfaces for Ubiquitous and Smart Learning (SmartLearn '17), 31--37.

Digital Library

[22]

G. Littlewort, J. Whitehill, T. Wu, I. Fasel, M. Frank, J. Movellan, and M. Bartlett. 2011. The computer expression recognition toolbox (CERT). In Face and Gesture 2011, 298--305.

[23]

Jane McGonigal. 2011. Reality is broken: Why games make us better and how they can change the world. Penguin books.

Digital Library

[24]

Rosalind W. Picard. 1997. Affective Computing. MIT Press, Cambridge, MA, USA.

Digital Library

[25]

Byron Reeves and J. Leighton Read. 2009. Total Engagement: Using Games and Virtual Worlds to Change the Way People Work and Businesses Compete. Harvard Business Press.

[26]

Verónica Rivera-Pelayo, Angela Fessl, Lars Müller, and Viktoria Pammer. 2017. Introducing Mood Self-Tracking at Work: Empirical Insights from Call Centers. ACM Trans. Comput.-Hum. Interact. 24, 1: 3:1--3:28.

Digital Library

[27]

Albrecht Schmidt. 2015. Biosignals in Human-computer Interaction. interactions 23, 1: 76--79.

Digital Library

[28]

Annika S. Schulz, Franziska Schulz, Rúben Gouveia, and Oliver Korn. 2018. Branded Gamification in Technical Education. In 2018 10th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), 1--8.

[29]

Hugo Plácido Da Silva, Stephen Fairclough, Andreas Holzinger, Robert Jacob, and Desney Tan. 2015. Introduction to the Special Issue on Physiological Computing for Human-Computer Interaction. ACM Trans. Comput.-Hum. Interact. 21, 6: 29:1--29:4.

Digital Library

[30]

Dominic A. Trevisan, Marleis Bowering, and Elina Birmingham. 2016. Alexithymia, but not autism spectrum disorder, may be related to the production of emotional facial expressions. Molecular Autism 7: 46.

[31]

Make Your Own 2d Games With Construct 2. Retrieved September 18, 2017 from https://www.scirra.com/construct2

[32]

Emotient FACET Statistics Export. iMotions Help Center. Retrieved September 13, 2017 from http://help.imotions.com/hc/en-us/articles/203609721-Emotient-FACET-Statistics-Export

[33]

iMotions' GSR peak detection, binarization and aggregation - iMotions Help Center. Retrieved September 28, 2017 from https://help.imotions.com/hc/en-us/articles/205167392-iMotions-GSR-peak-detection-binarization-and-aggregation#section_3

Cited By

Rendón Arenas ÁCantón Croda RMiranda Pérez AMayett Moreno Y(2024)Revisión sistemática de la literatura sobre gamificación en entornos de producciónEntreciencias: Diálogos en la Sociedad del Conocimiento10.22201/enesl.20078064e.2024.26.8867012:26(1-21)Online publication date: 7-Oct-2024
https://doi.org/10.22201/enesl.20078064e.2024.26.88670
Schubhan MAltmeyer MRogers KDegraen DLessel PKrüger A(2024)Auditory, Visual, or Both? Comparing Visual and Auditory Representations of Game Elements in a Gamified Image-Tagging TaskProceedings of the ACM on Human-Computer Interaction10.1145/36770598:CHI PLAY(1-28)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677059
Loch FFederspiel E(2024)Supporting Employee Engagement and Knowledge Transfer via Gamification in the Context of Sheltered Workplaces: A Literature Review and Interview StudyUniversal Access in Human-Computer Interaction10.1007/978-3-031-60884-1_7(94-111)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60884-1_7
Show More Cited By

Index Terms

Affective effects of gamification: using biosignals to measure the effects on working and learning users

Recommendations

Affective gaming using adaptive speed controlled by biofeedback
ICMI '23 Companion: Companion Publication of the 25th International Conference on Multimodal Interaction

This work is part of a larger project exploring how affective computing can support the design of player-adaptive video games. We investigate how controlling some of the game mechanics using biofeedback affects physiological reactions, performance, and ...
The influence of implicit and explicit biofeedback in first-person shooter games
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

To understand how implicit and explicit biofeedback work in games, we developed a first-person shooter (FPS) game to experiment with different biofeedback techniques. While this area has seen plenty of discussion, there is little rigorous ...
“I See You”: Comparing the Effects of Affective Empathy and Cognitive Empathy on Drivers' Affective States and Driving Behavior in Frustrating Driving Contexts.
AutomotiveUI '23 Adjunct: Adjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Despite extensive analysis into the relationship between emotion and driving, the effects of empathy on driving remain less explored. This paper focuses on the role of empathy, particularly cognitive and affective empathy, as a potential mitigator of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '19: Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments

June 2019

655 pages

ISBN:9781450362320

DOI:10.1145/3316782

Conference Chair:
Fillia Makedon
University of Texas at Arlington

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

PETRA '19

PETRA '19: The 12th PErvasive Technologies Related to Assistive Environments Conference

June 5 - 7, 2019

Rhodes, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
367
Total Downloads

Downloads (Last 12 months)61
Downloads (Last 6 weeks)7

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rendón Arenas ÁCantón Croda RMiranda Pérez AMayett Moreno Y(2024)Revisión sistemática de la literatura sobre gamificación en entornos de producciónEntreciencias: Diálogos en la Sociedad del Conocimiento10.22201/enesl.20078064e.2024.26.8867012:26(1-21)Online publication date: 7-Oct-2024
https://doi.org/10.22201/enesl.20078064e.2024.26.88670
Schubhan MAltmeyer MRogers KDegraen DLessel PKrüger A(2024)Auditory, Visual, or Both? Comparing Visual and Auditory Representations of Game Elements in a Gamified Image-Tagging TaskProceedings of the ACM on Human-Computer Interaction10.1145/36770598:CHI PLAY(1-28)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677059
Loch FFederspiel E(2024)Supporting Employee Engagement and Knowledge Transfer via Gamification in the Context of Sheltered Workplaces: A Literature Review and Interview StudyUniversal Access in Human-Computer Interaction10.1007/978-3-031-60884-1_7(94-111)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60884-1_7
Ulmer JBraun SCheng CDowey SWollert J(2023)A human factors-aware assistance system in manufacturing based on gamification and hardware modularisationInternational Journal of Production Research10.1080/00207543.2023.216614061:22(7760-7775)Online publication date: 13-Jan-2023
https://doi.org/10.1080/00207543.2023.2166140
Altmeyer MZenuni BSpelt HJegen TLessel PKrüger A(2022)Do Hexad User Types Matter? Effects of (Non-) Personalized Gamification on Task Performance and User Experience in an Image Tagging TaskProceedings of the ACM on Human-Computer Interaction10.1145/35494916:CHI PLAY(1-27)Online publication date: 31-Oct-2022
https://dl.acm.org/doi/10.1145/3549491
Altmeyer MHnatovskiy VRogers KLessel PNacke L(2022)Here Comes No Boom! The Lack of Sound Feedback Effects on Performance and User Experience in a Gamified Image Classification TaskProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517581(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517581
Korn OSchulz AHagley B(2022)Gamification: Grundlagen, Methoden und AnwendungsbeispieleDigitale Lernwelten – Serious Games und Gamification10.1007/978-3-658-35059-8_4(43-63)Online publication date: 29-Apr-2022
https://doi.org/10.1007/978-3-658-35059-8_4
Korn OWillwacher S(2022)Smarte Systeme in Rehabilitation und Prävention. Wie künstliche Intelligenz und Gamification das Bewegungstraining individualisierenKünstliche Intelligenz im Gesundheitswesen10.1007/978-3-658-33597-7_42(867-879)Online publication date: 17-Mar-2022
https://doi.org/10.1007/978-3-658-33597-7_42
Lampen ELehwald JPfeiffer T(2020)Virtual Humans in AR: Evaluation of Presentation Concepts in an Industrial Assistance Use CaseProceedings of the 26th ACM Symposium on Virtual Reality Software and Technology10.1145/3385956.3418974(1-5)Online publication date: 1-Nov-2020
https://dl.acm.org/doi/10.1145/3385956.3418974

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents