Abstract
We describe our planned research in using affective feedback from body movement and posture to recognize affective states of users. Bodily expression of affect has received far less attention in research than facial expression. The aim of our research is to further investigate how affective states are communicated through bodily expression and to develop an evaluation method for assessing affective states of video gamers based on this knowledge. Current motion capture systems are often intrusive to the user and restricted to lab environments, which results in biasing user experience. We propose a non-intrusive recognition system for bodily expression of affect in a video game context, which can be deployed in the wild.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(1), 39–58 (2009)
Hassenzahl, M., Tractinsky, N.: User experience – a research agenda. Behaviour & Information Technology 25(2), 91–97 (2006)
McCarthy, J., Wright, P.: Technology as Experience. MIT Press, Cambridge (2004)
Jordan, P.: Designing Pleasurable Products. Taylor & Francis, Abington (2002)
Gaver, W.W., Martin, H.: Alternatives. Exploring information appliances through conceptual design proposals. In: Proceedings of the CHI 2000 Conference on Human Factors in Computing, pp. 209–216. ACM Press, New York (2000)
Hassenzahl, M.: Emotions can be quite ephemeral. We cannot design them. Interactions 11, 46–48 (2004)
Norman, D.A.: Emotional Design. Why we love or hate everyday things. Basic Books, New York (2004)
Bargas-Avila, J.A., Hornbaek, K.: Old Wine in New Bottles or Novel Challenges? A Critical Analysis of Empirical Studies of User Experience. In: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems (CHI 2011), pp. 2689–2698 (2011)
Lottridge, D.: Evaluating human computer interaction through self-rated emotion. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5727, pp. 860–863. Springer, Heidelberg (2009)
Xu, D., Read, J.C., Sim, G., McManus, B.: Experience it, draw it, rate it: capture children’s experiences with their drawings. In: IDC 2009: Proceedings of the 8th International Conference on Interaction Design and Children, pp. 266–270. ACM Press, New York (2009)
Rinn, W.E.: The neuropsychology of facial expression: a review of the neurological and psychological mechanisms for producing facial expression. Psychological Bulletin 95(1), 52–77 (1984)
Ekman, P., Friesen, W.V.: Head and body cues in the judgment of emotion: a reformulation. Perceptual and Motor Skills 24(3), 711–724 (1967)
De Gelder, B.: Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Phil. Trans. R. Soc. B 364, 3475–3484 (2009)
James, W.T.: A study of expression of body posture. Journal of General Psychology 7, 405–437 (1932)
Ekman, P., Friesen, W.: Manual for the facial action coding system. Consulting Psychology Press, Palo Alto (1978)
Wallbott, H.G.: Bodily expression of emotion. European Journal of Social Psychology 28(6), 879–896 (1998)
Riskind, J.H., Gotay, C.C.: Physical Posture: Could It Have Regulatory or Feedback Effects on Motivation and Emotion? Motivation and Emotion 6(3), 273–298 (1982)
Pasch, M., Bianchi-Berthouze, N., van Dijk, B., Nijholt, A.: Movement-based sports video games: Investigating motivation and gaming experience. Entertainment Computing 1(2), 49–61 (2009)
Bianchi-Berthouze, N.: Does body movement affect the player engagement experience? In: Proc. of KEER 2010 - International Conference on Kansei Engineering and Emotion Research, pp. 1953–1963 (2010)
Calvo, R.A., D’Mello, S.: Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications. IEEE Trans. o. Aff. Computing 1(1), 18–37 (2010)
Ekman, P.: Basic emotions. In: Dalgleish, T., Power, M. (eds.) Handbook of Cognition and Emotion. John Wiley & Sons, Sussex (1999)
Ekman, P., Friesen, W.V.: Head and body cues in the judgment of emotion: a reformulation. Perceptual and Motor Skills 24(3), 711–724 (1967)
Coulson, M.: Attributing emotion to static body postures: recognition, accuracy, confusions, and viewpoint dependence. Journal of Nonverbal Behaviour 28(2), 117–139 (2004)
Kudoh, T., Matsumoto, D.: Crosscultural examination of the semantic dimensions of body posture. Journal of Personality and Social Psychology 48(6), 1440–1446 (1985)
Grammer, K., Fink, B., Oberzaucher, E., Atzmüller, M., Blantar, I., Mitteroecker, P.: The representation of self reported affect in body posture and body posture simulation. Collegium Antropologicum 28(suppl. 2), 159–173 (2004)
Kleinsmith, A., De Silva, P.R., Bianchi-Berthouze, N.: Cross-cultural differences in recognizing affect from body posture. Interacting w. Computers 18(6), 1371–1389 (2006)
De Silva, P.R., Bianchi-Berthouze, N.: Modeling human affective postures: an information theoretic characterization of posture features. Computer Animation and Virtual Worlds 15(3-4), 269–276 (2004)
Clay, A., Real, M., Wijdenes, P., Andre, J.M., Lespinet-Najib, V.:: Movement transcriptions of SECs in componential process model. Presented at the CHI 2011, Workshop on Embodied Interaction: Theory and Practice in HCI (2011)
Pitterman, H., Nowicki Jr., S.: A test of the ability to identify emotion in human standing and sitting postures. Genetic, Social, and General Psychology Monographs 130(2), 146–162 (2004)
Pasch, M., Poppe, R.: Person or Puppet? The Role of Stimulus Realism in Attributing Emotion to Static Body Postures. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 83–94. Springer, Heidelberg (2007)
Höök, K.: Mobile life – innovation in the wild. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5726, pp. 1–2. Springer, Heidelberg (2009)
Harper, R., Rodden, T., Rogers, Y., Sellen, A. (eds.): Being human: Human-Computer Interaction in the year 2020. Microsoft Research, Cambridge (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pasch, M., Landoni, M. (2011). Recognizing Bodily Expression of Affect in User Tests. In: D’Mello, S., Graesser, A., Schuller, B., Martin, JC. (eds) Affective Computing and Intelligent Interaction. ACII 2011. Lecture Notes in Computer Science, vol 6975. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24571-8_29
Download citation
DOI: https://doi.org/10.1007/978-3-642-24571-8_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24570-1
Online ISBN: 978-3-642-24571-8
eBook Packages: Computer ScienceComputer Science (R0)