More Web Proxy on the site http://driver.im/

Article

Out of the lab and into the fray: towards modeling emotion in everyday life

Authors:

Jennifer Healey,

Sushmita Subramanian,

Junaith Shahabdeen,

Margaret MorrisAuthors Info & Claims

Pervasive'10: Proceedings of the 8th international conference on Pervasive Computing

Pages 156 - 173

https://doi.org/10.1007/978-3-642-12654-3_10

Published: 17 May 2010 Publication History

Abstract

We conducted a 19 participant study using a system comprised of wireless galvanic skin response (GSR), heart rate (HR), activity sensors and a mobile phone for aggregating sensor data and enabling affect logging by the user. Each participant wore the sensors daily for five days, generating approximately 900 hours of continuous data. We found that analysis of emotional events was highly dependent on correct windowing and report results on synthesized windows around annotated events. Where raters agreed on the timing and quality of the emotion we were able to recognize 85% of the high and low energy emotions and 70% of the positive and negative emotions. We also gained many insights regarding participant's perception of their emotional state and the complexity of emotion in real life.

References

[1]

Langer, E.J.: Mindfulness. Perseus Books, USA (1989).

[2]

Kabat-Zinn, J.: Coming to Our Senses: Healing Ourselves and the World Through Mindfulness. Hyperion Books, New York (2005).

[3]

James, W.: William James writings 1878-1899, chapter on emotion, The Library of America, p. 1992 (1890).

[4]

Jung, C.G., Montague, D.E.: Studies in Word Association. Routledge and K. Paul (1969).

[5]

Marston, W.M.: The Lie Detector Test. R.R. Smith, New York (1938).

[6]

van den Broek, E., Janssen, J.H., Westerink, J.H.D.M.: Guidelines for Affective Signal Processing (ASP): From Lab to Life. In: Proceedings of the International Conference on Affective Computing and Intelligent Interaction, September 10-12, vol. 1, pp. 217-222. IEEE, Los Alamitos (2009).

[7]

Healey, J.A., Picard, R.W.: Detecting stress during real-world driving tasks using physiological sensors. IEEE Transactions on Intelligent Transportation Systems 6(2), 156-166 (2005).

Digital Library

[8]

Oatley, K., Duncan, E.: The Experience of Emotion in Everyday Life. Cognition & Emotion 8(4), 369-381 (1994).

[9]

Morris, M., Guilak, F.: Mobile Heart Health: Project Highlights. IEEE Pervasive Computing 8(2), 57-61 (2009).

Digital Library

[10]

Holter, N.J., Gengerelli, J.A.: Remote Recording of Physiological Data by Radio. Rocky Mountain Medical Journal Colorado Medical Society 46, 749-752 (1949).

[11]

Fahrenberg, J., Myrtek, M. (eds.): Progress in Ambulatory Assessment. Hogrefe and Huber Publishers (2001).

Digital Library

[12]

Hofmann, S.G., Barlow, D.H.: Ambulatory psychophysiological monitoring: A potentially useful tool when treating panic relapse. Cognitive and Behavioral Practice 3(1), 53-61 (1996).

[13]

Healey, J.A., Picard, R.W.: Affective Wearables. In: Proceedings of the IEEE 1st International Symposium on Wearable Computers, ISWC, Cambridge, MA USA, October 13-14, pp. 91-97 (1997).

Digital Library

[14]

Westerink, J., Ouwerkerk, M., de Vries, G., de Waele, S., van den Eerenbeemd, J., van Boven, M.: Emotion measurement platform for daily life situations. In: Proceedings of the International Conference on Affective Computing and Intellignet Interaction, September 10-12, vol. 1, pp. 704-708. IEEE, Los Alamitos (2009).

[15]

Hedman, E., Poh, M., Wilder-Smith, O., Fletcher, R., Goodwin, M.S., Picard, R.: iCalm: Measuring Electrodermal Activity in Almost Any Setting. In: Proceedings of the International Conference on Affective Computing and Intellignet Interaction, September 10-12, vol. 1, pp. 594-595. IEEE, Los Alamitos (2009).

[16]

Morris, M.: Technologies for Heart and Mind: New Directions in Embedded Assesssment. Intel. Technology Journal 11(1) (2007).

[17]

MSP Platform description, http://seattle.intel-research.net/MSP/

[18]

Choudhury, T., Consolvo, S., Harrison, B., Hightower, J., LaMarca, A., LeGrand, L., Rahimi, A., Rea, A., Bordello, G., Hemingway, B., Klasnja, P., Koscher, K., Landay, J.A., Lester, J., Wyatt, D., Haehnel, D.: The Mobile Sensing Platform: An Embedded Activity Recognition Syste. IEEE Pervasive Computing 7(2), 32-41 (2008).

Digital Library

[19]

Polar USA, http://www.polarusa.com/us-en/products

[20]

Picard, R.W., Vyzas, E., Healey, J.: Toward Machine Emotional Intelligence: Analysis of Affective Physiological State. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(10), 1175-1191 (2001).

Digital Library

[21]

Stern, R.M., Ray, W.J., Quigley, K.S.: Psychophysiological Recording, ch. 13, 2nd edn. Oxford University Press, Oxford (2001).

[22]

SHIMMER: http://shimmer-research.com/wordpress/?page_id=20

[23]

Wan, C., Sai, P.: Challenges to Building Bluetooth-based Sensing Solutions. In: International Conference on Body Area Networks (April 2009).

Digital Library

[24]

Russel, J.A., Mehrabian, A.: Evidence for a three-factor theory of emotions. Journal of Research in Personality 11, 273-294 (1977).

[25]

Levenson, R.W.: Autonomic Nervous System Differences Among Emotions. American Psychological Society 3(1), 23-27 (1992).

[26]

Ekman, P., Levenson, R.W., Friesen, W.V.: Autonomic Nervous System Activity Distinguishes Among Emotions. Science (221), 1208-1210 (1983).

[27]

Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann, San Francisco (1999).

Digital Library

[28]

Cooper, D.G., Arroyo, I., Park Woolf, B., Muldner, K., Burleson, W., Christopherson, R.: Sensors Model Student Self Concept in the Classroom. In: Houben, G.-J., McCalla, G., Pianesi, F., Zancanaro, M. (eds.) UMAP 2009. LNCS, vol. 5535, pp. 30-41. Springer, Heidelberg (2009).

Digital Library

[29]

Carroll, J.M., Russell, J.A.: Do facial expressions signal specific emotions? Judging emotion from the face in context. Journal of Personality and Social Psychology 70, 205-218 (1996).

[30]

Paradiso, R., Loriga, G., Taccini, N.: A wearable health care system based on knitted integrated sensors. IEEE Transactions on Information Technology in Biomedicine 9(3), 337-344 (2005).

Digital Library

[31]

Blaney, P.H.: Affect and memory: a review. Psychological Bulletin 99, 229-246 (1986).

[32]

Bower, G.H.: Mood and memory. American Psychologist 36, 129-148 (1981).

[33]

Morris, M., Kathawala, Q., Leen, T., Gorenstein, E.Q., Guilak, K., Deleeuw, B., Labhard, M.: Mobile therapy and mood sampling: Case study evaluations of a cell phone application for emotional self-awareness (submitted).

Cited By

Gebhardt CBrombach ALuong THilliges OHolz C(2024)Detecting Users' Emotional States during Passive Social Media UseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596068:2(1-30)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659606
Li JHe ZCui YWang CChen CYu CZhang MLiu YMa S(2022)Towards Ubiquitous Personalized Music Recommendation with Smart BraceletsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503336:3(1-34)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550333
Wampfler RKlingler SSolenthaler BSchinazi VGross MHolz C(2022)Affective State Prediction from Smartphone Touch and Sensor Data in the WildProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501835(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501835
Show More Cited By

Recommendations

Recording affect in the field: towards methods and metrics for improving ground truth labels
ACII'11: Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I

One of the primary goals of affective computing is enabling computers to recognize human emotion. To do this we need accurately labeled affective data. This is challenging to obtain in real situations where affective events are not scripted and occur ...
Survey of mood detection through various input modes
PETRA '19: Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Mood has a large impact on people's behavior and even health. Thus, detecting and monitoring mood can potentially benefit users, researchers, clinicians, and content providers. In recent years, advancements in affective computing have enabled the ...
The Effect of Different Affective Arousal Levels on Taste Perception
ICMI '20 Companion: Companion Publication of the 2020 International Conference on Multimodal Interaction

The emotions we experience shape our perception, and our emotion is shaped by our perceptions. Taste perception is also influenced by emotions. Positive and negative emotions alter sweetness, sourness, and bitterness perception. However, most previous ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

Pervasive'10: Proceedings of the 8th international conference on Pervasive Computing

May 2010

446 pages

ISBN:3642126537

Editors:
Patrik Floréen
Helsinki Institute for Information Technology – HIIT, Department of Computer Science,, University of Helsinki, Finland
,
Antonio Krüger
Helsinki Institute for Information Technology – HIIT, Department of Computer Science,, German Research Center for Artificial Intelligence (DFKI), Stuhlsatzenhausweg 3, Saarbrücken, Germany
,
Mirjana Spasojevic
Helsinki Institute for Information Technology – HIIT, Department of Computer Science,, Nokia Research Center, Stuhlsatzenhausweg 3, Palo Alto, CA, Germany

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 17 May 2010

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gebhardt CBrombach ALuong THilliges OHolz C(2024)Detecting Users' Emotional States during Passive Social Media UseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596068:2(1-30)Online publication date: 15-May-2024
Li JHe ZCui YWang CChen CYu CZhang MLiu YMa S(2022)Towards Ubiquitous Personalized Music Recommendation with Smart BraceletsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503336:3(1-34)Online publication date: 7-Sep-2022
Wampfler RKlingler SSolenthaler BSchinazi VGross MHolz C(2022)Affective State Prediction from Smartphone Touch and Sensor Data in the WildProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501835(1-14)Online publication date: 29-Apr-2022
Tian LOviatt SMuszynski MChamberlain BHealey JSano A(2022)Applied Affective ComputingundefinedOnline publication date: 25-Jan-2022
Sripian PAnuardi MIto TTobe YSugaya M(2021)Emotion-sensitive voice-casting care robot in rehabilitation using real-time sensing and analysis of biometric informationJournal of Ambient Intelligence and Smart Environments10.3233/AIS-21061413:6(413-431)Online publication date: 1-Jan-2021
Schmidt PDürichen RReiss AVan Laerhoven KPlötz TFarrahi KHarle RLane N(2019)Multi-target affect detection in the wildProceedings of the 2019 ACM International Symposium on Wearable Computers10.1145/3341163.3347741(211-219)Online publication date: 9-Sep-2019
Larradet FNiewiadomski RBarresi GMattos LHarle RFarrahi KLane N(2019)Appraisal theory-based mobile app for physiological data collection and labelling in the wildAdjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers10.1145/3341162.3345595(752-756)Online publication date: 9-Sep-2019
Schmidt PReiss ADürichen RVan Laerhoven K(2018)Labelling Affective States "in the Wild"Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers10.1145/3267305.3267551(654-659)Online publication date: 8-Oct-2018
Baltodano SGarcia-Mancilla JJu W(2018)Eliciting Driver Stress Using Naturalistic Driving Scenarios on Real RoadsProceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3239060.3239090(298-309)Online publication date: 23-Sep-2018
Ilarri SHermoso RTrillo-Lado RRodríguez-Hernández M(2016)A review of the role of sensors in mobile context-aware recommendation systemsInternational Journal of Distributed Sensor Networks10.1155/2015/4892642015(226-226)Online publication date: 1-Jan-2016
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents