Abstract
Expressions can vary by the authenticity level, i.e. the real amount of emotion present within the person when expressing it. They are often sincere, and thus authentic and natural; the person expresses what he/she feels. But play-acted expressions are also present in our lives in a form of deception, movies, theater, etc. It was shown in the literature that those two type of expressions are often hard to distinguish. While some studies concluded that play-acted expressions are more intense, exaggerated or stereotypical than the natural ones, other authors failed to detect such a behavior. The goal of our analysis is to investigate whether speech perturbation features, i.e. jitter, shimmer, variance and features of disturbances in laryngeal muscle coordination, can be used as a robust measure for the analysis of the stress expression authenticity. Two subsets of the SUSAS database (Speech Under Simulated and Actual Stress) – the Roller-coaster subset and the Talking Styles Domain – are used for this purpose. It was shown that perturbation features in general show statistically significant difference between realistic and acted expressions, only the jitter features generally failed to discriminate these two type of expressions. The rising trend of perturbation feature values is observed from acted- to real-stress expressions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
The reason we use three two-class classifications instead of a multiclass classification is that we want the classifier to perform as close to random as possible when discriminating the classes ‘neutral’ and ‘acted’, while giving a good discrimination of ‘stress’ at the same time.
References
Banse, R., Scherer, K.R.: Acoustic profiles in vocal emotion expression. J. Personal. Soc. Psych. 70(3), 614–636 (1996)
Gosselin, P., Kirouac, G., Dore, F.Y.: Components and recognition of facial expression in the communication of emotion by actors. J. Personal. Soc. Psych. 68, 83–96 (1995)
Scherer, K.R., Banziger, T.: On the use of actor portrayals in research on the emotional expression. In: Scherer, K.R., Bänziger, T., Roesch, E. (eds.) A Blueprint for an Affectively Competent Agent: Cross-Fertilization Between Emotion Psychology, Affective Neuroscience, and Affective Computing, pp. 166–176. Oxford University Press, Oxford (2010)
Auberge, V., Audibert, N., Rilliard, A.: E-Wiz: a trapper protocol for hunting the expressive speech corpora in Lab. In: Proceedings of the 4th LREC, Lisbon, Portugal (2004)
Drolet, M., Schubotz, R.I., Fischer, J.: Authenticity affects the recognition of emotions in speech: behavioral and fMRI evidence. Cogn. Affect. Behav. Neurosci. 12, 140–150 (2012)
Greasley, P., Sherrard, C., Waterman, M.: Emotion in language and speech: methodological issues in naturalistic approaches. Lang. Speech 43, 355–375 (2000)
Laukka, P., Audibert, N., Auberge, V.: Exploring the determinants of the graded structure of vocal emotion expressions. Cogn. Emot. 26, 710–719 (2012)
Williams, C.E., Stevens, K.N.: Emotions and speech: some acoustical correlates. J. Acoust. Soc. Am. 52, 1238–1250 (1972)
Wilting, J., Krahmer, E., Swerts, M.: Real vs. acted emotional speech. In: INTERSPEECH 2006, Pittburgh PA, USA (2006)
Barrett, L.F.: Was Darwin wrong about emotional expressions? Curr. Dir. Psychol. Sci. 20, 400–406 (2011)
Batliner, A., Fischer, K., Huber, R., Spilker, J., Noth, E.: Desperately seeking emotions or: actors, wizards and human beings. In: ISCA Workshop on Speech and Emotion, Newcastle, Northern Ireland (2000)
Douglas-Cowie, E., Campbell, N., Cowie, R., Roach, P.: Emotional speech: towards a new generation of databases. Speech Commun. 40, 33–60 (2003)
Drolet, M., Schubotz, R.I., Fischer, J.: Recognizing the authenticity of emotional expressions: \(F_0\) contour matters when you need to know. Front. Hum. Neurosci. 8, 1–11 (2014)
Jurgens, R., Grass, A., Drolet, M., Fischer, J.: Effect of acting experience on emotion expression and recognition in voice: non-actors provide better stimuli than expected. J. Nonverbal Behav. 39, 195–214 (2015)
Jurgens, R., Drolet, M., Pirow, R., Scheiner, E., Fischer, J.: Encoding conditions affect recognition of vocally expressed emotions across cultures. Front. Psychol. 4 (2013)
Scherer, K.R.: Vocal markers of emotion: comparing induction and acting elicitation. Comput. Speech Lang. 27, 40–58 (2013)
Jurgens, R., Hammerschmidt, K., Fischer, J.: Authentic and play-acted vocal emotion expressions reveal acoustic differences. Front. Psychol. 2, 1–11 (2011)
Scherer, K.R.: Vocal correlates of emotional arousal and affective disturbance. In: Wagner, H., Manstead, A. (eds.) Handbook of Psychophysiology: Emotion and Social Behavior, pp. 165–197. Wiley, London (1989)
Scherer, K.R.: Nonlinguistic vocal indicators of emotion and psychopathology. In: Izard, C.E. (ed.) Emotions in Personality and Psychopathology, pp. 495–529. Plenum Press, New York (1979)
Scherer, K.R.: Vocal affect expression: a review and a model for future research. Psychol. Bull. 99, 143–165 (1986)
Dropuljic, B., Petrinovic, D., Cosic, K.: Novel speech features of disturbances in laryngeal muscle coordination. In: 7th IEEE International Conference on Cognitive Infocommunications, pp. 175–180 (2016)
Schuller, B., et al.: Recognising realistic emotions and affect in speech: state of the art and lessons learnt from the first challenge. Speech Commun. 53(9), 1062–1087 (2011)
Dropuljic, B.: Emotional state estimation based on data mining of acoustic speech features. Ph.D. Thesis (in Croatian). University of Zagreb, Croatia (2014)
Hansen, J.H.L., et al.: The impact of speech under stress on military speech technology. Nato Project 4 (2000)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Dropuljić, B., Mršić, L., Kopal, R., Skansi, S., Brkić, A. (2017). Evaluation of Speech Perturbation Features for Measuring Authenticity in Stress Expressions. In: Nguyen, N., Tojo, S., Nguyen, L., Trawiński, B. (eds) Intelligent Information and Database Systems. ACIIDS 2017. Lecture Notes in Computer Science(), vol 10191. Springer, Cham. https://doi.org/10.1007/978-3-319-54472-4_64
Download citation
DOI: https://doi.org/10.1007/978-3-319-54472-4_64
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-54471-7
Online ISBN: 978-3-319-54472-4
eBook Packages: Computer ScienceComputer Science (R0)