OCOsense<sup>TM</sup> Smart Glasses for Analyzing Facial Expressions Using Optomyographic Sensors
Authors: 
James Archer, Ifigeneia Mavridou, Simon Stankoski, M. John Broulidakis, Andrew Cleal, Piotr Walas, Mohsen Fatoorechi, Hristijan Gjoreski, Charles NdukaAuthors Info & Claims
Abstract
This article introduces the Emteq's OCOsenseTM smart glasses equipped with a novel noncontact OCOTM sensor technology for measuring facial muscle activation and expressions based on high-resolution tracking of skin movement. We demonstrate that the OCOTM sensor technology based on optomyography is a sensitive and accurate approach for assessing skin movement in three dimensions, providing a means for measuring the facial expressions used to assess emotional valence such as smile, frown, and eyebrow raise. We propose that glasses-based optomyography sensing has the potential to herald a paradigm shift in real-world facial expression monitoring, thus enabling real-time emotional analytics with healthcare and research applications.
References
[1]
F. Kawsar, C. Min, A. Mathur, A. Montanari, O. Amft, and K. van Laerhoven, “Earables for personal-scale behavior analytics,” IEEE Pervasive Comput., vol. 17, no. 3, pp. 83–89, Jul.–Sep. 2018.
[2]
P. Ekman and W. V. Friesen, Facial Action Coding System: A Technique For the Measurement of Facial Movement. Palo Alto, CA, USA: Consulting Psychologists Press, 1978.
[3]
L. F. Barrett, R. Adolphs, S. Marsella, A. M. Martinez, and S. D. Pollak, “Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements,” Psychol. Sci. Public Int., vol. 20, no. 1, pp. 1–68, Jul. 2019.
[4]
U. Hess, R. Banse, and A. Kappas, “The intensity of facial expression is determined by underlying affective state and social situation,” J. Pers. Social Psychol., vol. 69, no. 2, pp. 280–288, 1995.
[5]
S. Singh and V. Teoh, “Enhancing pro-social behavior among college students: Exploring the role of abstract mindset,” J. Law Social Sci., vol. 3, pp. 154–157, 2014. Accessed: Nov. 24, 2022. [Online]. Available: https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Enhancing+pro-social+behavior+among+college+students%3A+Exploring+the+role+of+abstract+mindset&btnG=
[6]
M. Pastwa and K. K. Imbir, “Impact of subliminally presented words valence’ on risk-taking decisions in a game of chance,” Front. Psychol., vol. 10, 2019, Art. no.
[7]
J. T. Larsen, C. J. Norris, and J. T. Cacioppo, “Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii,” Psychophysiology, vol. 40, no. 5, pp. 776–785, Sep. 2003.
[8]
W. Sato, K. Murata, Y. Uraoka, K. Shibata, S. Yoshikawa, and M. Furuta, “Emotional valence sensing using a wearable facial EMG device,” Sci. Rep., vol. 11, no. 1, Mar. 2021, Art. no.
[9]
D. J. Matthies, C. Weerasinghe, B. Urban, and S. Nanayakkara, “Capglasses: Untethered capacitive sensing with smart glasses,” in Proc. Augmented Hum. Conf., 2021, pp. 121–130.
[10]
Z. Yan, Y. Wu, Y. Zhang, and X. A. Chen, “Emoglass: An end-to-end ai-enabled wearable platform for enhancing self-awareness of emotional health,” in Proc. CHI Conf. Hum. Factors Comput. Syst., 2022, pp. 1–19.
[11]
S. Rostaminia, A. Lamson, T. Rahman, D. Ganesan, and S. Maji, “W! nce: Unobtrusive sensing of upper facial action units with eog-based eyewear,” Proc. ACM Interactive, Mobile, Wearable Ubiquitous Technol., vol. 3, no. 1, pp. 1–26, Mar. 2019.
[12]
K. Masai, Y. Sugiura, M. Ogata, K. Kunze, M. Inami, and M. Sugimoto, “Facial expression recognition in daily life by embedded photo reflective sensors on smart eyewear,” in Proc. 21st Int. Conf. Intell. User Interfaces, 2016, pp. 317–326.
[13]
S. Polikovsky, Y. Kameda, and Y. Ohta, “Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor,” IET Seminar Dig., vol. 2009, no. 2, 2009.
[14]
H. Gjoreski et al., “Head-AR: Human activity recognition with head-mounted IMU using weighted ensemble learning,” Smart Innov., Syst. Technol., vol. 204, pp. 153–167, 2021.
[15]
H. H. Muhammed and J. Raghavendra, “Optomyography (OMG): A novel technique for the detection of muscle surface displacement using photoelectric sensors. Measurements,” Proc .10th Int. Conf. Bioelectromagnetism, ISBEM, vol. 10, no. 13, pp. 1–4, Dec. 2015.
[16]
S. Ploumpis et al., “Towards a complete 3D morphable model of the human head,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 43, no. 11, pp. 4142–4160, Nov. 2021.
[17]
V. Gohel and N. Mehendale, “Review on electromyography signal acquisition and processing,” Biophysical Rev., vol. 12, no. 6, pp. 1361–1367, Dec. 2020.
[18]
L. Ulrich, E. Vezzetti, S. Moos, and F. Marcolin, “Analysis of RGB-D camera technologies for supporting different facial usage scenarios,” Multimedia Tools Appl., vol. 79, no. 39–40, pp. 29375–29398, Oct. 2020.
[19]
A. Tramacere, P. F. Ferrari, M. Gentilucci, V. Giuffrida, and D. de Marco, “The emotional modulation of facial mimicry: A kinematic study,” Front. Psychol., vol. 8, 2018, Art. no.
[20]
S. Korb, S. With, P. Niedenthal, S. Kaiser, and D. Grandjean, “The perception and mimicry of facial movements predict judgments of smile authenticity,” PLoS One, vol. 9, no. 6, Jun. 2014.
Index Terms
- OCOsenseTM Smart Glasses for Analyzing Facial Expressions Using Optomyographic Sensors
Index terms have been assigned to the content through auto-classification.
Recommendations
Effective semantic features for facial expressions recognition using SVM
Most traditional facial expression-recognition systems track facial components such as eyes, eyebrows, and mouth for feature extraction. Though some of these features can provide clues for expression recognition, other finer changes of the facial ...
Face Recognition Through Different Facial Expressions
Face recognition has become an accessible issue for experts as well as ordinary people as it is a focal non-interfering biometric modality. In this paper, we introduced a new approach to perform face recognition under varying facial expressions. The ...
OCOsense Glasses – Monitoring Facial Gestures and Expressions for Augmented Human-Computer Interaction: OCOsense Glasses for Monitoring Facial Gestures and Expressions
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing SystemsThe paper presents the OCOsenseTM smart glasses system, which recognizes and monitors facial gestures and expressions by using non-contact optomyographic OCOTM sensors and an IMU placed inside the frames of the glasses. The glasses stream the sensor data ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
1536-1268 © 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See https://www.ieee.org/publications/rights/index.html for more information.
Publisher
IEEE Educational Activities Department
United States
Publication History
Published: 01 July 2023
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 01 Feb 2025