More Web Proxy on the site http://driver.im/

article

Evaluation of real-world and computer-generated stylized facial expressions

Authors:

Christian Wallraven,

Heinrich H. Bülthoff,

Douglas W. Cunningham,

Dirk BartzAuthors Info & Claims

ACM Transactions on Applied Perception (TAP), Volume 4, Issue 3

Pages 16 - es

https://doi.org/10.1145/1278387.1278390

Published: 01 November 2007 Publication History

Abstract

The goal of stylization is to provide an abstracted representation of an image that highlights specific types of visual information. Recent advances in computer graphics techniques have made it possible to render many varieties of stylized imagery efficiently making stylization into a useful technique, not only for artistic, but also for visualization applications. In this paper, we report results from two sets of experiments that aim at characterizing the perceptual impact and effectiveness of three different stylization techniques in the context of dynamic facial expressions. In the first set of experiments, animated facial expressions are stylized using three common techniques (brush, cartoon, and illustrative stylization) and investigated using different experimental measures. Going beyond the usual questionnaire approach, these experiments compare the techniques according to several criteria ranging from subjective preference to task-dependent measures (such as recognizability, intensity) allowing us to compare behavioral and introspective approaches. The second set of experiments use the same stylization techniques on real-world video sequences in order to compare the effect of stylization on natural and artificial stimuli. Our results shed light on how stylization of image contents affects the perception and subjective evaluation of both real and computer-generated facial expressions.

References

[1]

Adolphs, R. 2002. Recognizing emotions from facial expressions: Psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews 1, 1, 21--61.

[2]

Agrawala, M. and Stolte, C. 2001. Rendering effective route maps: Improving usability through generalization. In Proc. of ACM SIGGRAPH. ACM Press, New York. 241--249.

[3]

Breidt, M., Wallraven, C., Cunningham, D. W., and Bülthoff, H. H. 2003. Facial animation based on 3d scans and motion capture. SIGGRAPH '03 Sketches & Applications.

[4]

Bull, P. 2001. State of the art: Nonverbal communication. The Psychologist 14, 644--647.

[5]

Cunningham, D. W., Breidt, M., Kleiner, M., Wallraven, C., and Bülthoff, H. H. 2003. How believable are real faces: Towards a perceptual basis for conversational animation. In Computer Animation and Social Agents 2003. 23--39.

[6]

Cunningham, D., Nusseck, M., Wallraven, C., and Bülthoff, H. 2004. The role of image size in the recognition of conversational facial expressions. Computer Animation & Virtual Worlds 15, 3--4 (07), 305--310.

[7]

Cunningham, D., Kleiner, M., Wallraven, C., and Bülthoff, H. 2005. Manipulating video sequences to determine the components of conversational facial expressions. ACM Transactions on Applied Perception 2, 3 (07), 251--269.

Digital Library

[8]

DeCarlo, D. and Santella, A. 2002. Stylization and abstraction of photographs. In Proc. of ACM SIGGRAPH. 769--776.

[9]

Ekman, P. 1972. Universal and Cultural Differences in Facial Expressions of Emotion. University of Nebraska Press, Lincoln, NB. 207--283.

[10]

Ferwerda, J. 2003. Three varieties of realism in computer graphics. In Proc. of SPIE Human Vision and Electronic Imaging. 290--297.

[11]

Fischer, J., Bartz, D., and Strassr, W. 2005a. Artistic reality: Fast brush stroke stylization for augmented reality. In Proc. of ACM Symposium on Virtual Reality Software and Technology (VRST). 155--158.

[12]

Fischer, J., Bartz, D., and Strassr, W. 2005b. Illustrative display of hidden iso-surface structures. In Proc. of IEEE Visualization. 663--670.

[13]

Fischer, J., Cunningham, D., Bartz, D., Wallraven, C., Bülthoff, H., and Strassr, W. 2006a. Measuring the discernability of virtual objects in conventional and stylized augmented reality. In Eurographics Symposium on Virtual Environments (EGVE).

[14]

Fischer, J., Eichler, M., Bartz, D., and Strassr, W. 2006b. Model-based hybrid tracking for medical augmented reality. In Eurographics Symposium on Virtual Environments (EGVE).

[15]

Freudenberg, B., Masuch, M., and Strothotte, T. 2002. Real-time halftoning: A primitive for non-photorealistic shading. In Proc. of Eurographics Workshop on Rendering. 227--231.

[16]

Gooch, A. A. and Willemsen, P. 2002. Evaluating space perception in npr immersive environments. In NPAR '02: Proceedings of the 2nd International Symposium on Non-Photorealistic Animation and Rendering. ACM Press, New York. 105--110.

[17]

Gooch, B., Reinhard, E., and Gooch, A. 2004. Human facial illustrations: Creation and Psychophysical Evaluation. ACM Trans. Graph. 23, 1, 27--44.

Digital Library

[18]

Haeberli, P. 1990. Paint by numbers: Abstract image representations. In Proc. of ACM SIGGRAPH. 207--214.

[19]

Kleiner, M., Wallraven, C., and Bülthoff, H. 2004. The mpi videolab - a system for high quality synchronous recording of video and audio from multiple viewpoints. Tech. Rep. 123. May.

[20]

Litwinowicz, P. 1997. Processing images and video for an impressionist effect. In Proc. of ACM SIGGRAPH. 407--414.

[21]

Santella, A. and DeCarlo, D. 2004. Visual interest and npr: An evaluation and manifesto. In NPAR '04: Proceedings of the 3rd international symposium on Non-Photorealistic Animation and Rendering. ACM Press, New York. 71--150.

[22]

Stokes, W. A., Ferwerda, J. A., Walter, B., and Greenberg, D. P. 2004. Perceptual illumination components: A new approach to efficient, high quality global illumination rendering. ACM Trans. Graph. 23, 3, 742--749.

Digital Library

[23]

Strothotte, T. and Schlechtweg, S. 2002. Non-Photorealistic Computer Graphics - Modelling, Rendering, and Animation. Morgan Kaufmann Publi., San Francisco, CA.

[24]

Tomasi, C. and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proc. of IEEE International Conference on Computer Vision (ICCV). 839--846.

[25]

Wallraven, C., Cunningham, D., Breidt, M., and Bülthoff, H. 2004. View dependence of complex versus simple facial motions. H. H. Bülthoff and H. Rushmeier, Eds. Proceedings of the First Symposium on Applied Perception in Graphics and Visualization, 181.

[26]

Wallraven, C., Breidt, M., Cunningham, D. W., and Bülthoff, H. H. 2005. Psychophysical evaluation of animated facial expressions. In Proc. of APGV '05. ACM Press, New York, NY, USA, 17--24.

[27]

Winnemöller, H., Olsen, S. C., and Gooch, B. 2006. Real-time video abstraction. In SIGGRAPH '06: ACM SIGGRAPH 2006 Papers. ACM Press, New York. 1221--1226.

[28]

Yip, A. W. and Sinha, P. 2002. Contribution of color to face recognition. Perception 31, 8, 995--1003.

Cited By

Choudhary ZErickson ANorouzi NKim KBruder GWelch G(2023)Virtual Big Heads in Extended Reality: Estimation of Ideal Head Scales and Perceptual Thresholds for Comfort and Facial CuesACM Transactions on Applied Perception10.1145/357107420:1(1-31)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3571074
Berry MBrown S(2021)The dynamic mask: Facial correlates of character portrayal in professional actorsQuarterly Journal of Experimental Psychology10.1177/1747021821104793575:5(936-953)Online publication date: 4-Oct-2021
https://doi.org/10.1177/17470218211047935
McDonnell RMutlu B(2021)AppearanceThe Handbook on Socially Interactive Agents10.1145/3477322.3477327(105-146)Online publication date: 10-Sep-2021
https://dl.acm.org/doi/10.1145/3477322.3477327
Show More Cited By

Index Terms

Evaluation of real-world and computer-generated stylized facial expressions
1. Applied computing
  1. Law, social and behavioral sciences
    1. Psychology
2. Computing methodologies
  1. Computer graphics
    1. Animation

Recommendations

Evaluating the perceptual realism of animated facial expressions

The human face is capable of producing an astonishing variety of expressions—expressions for which sometimes the smallest difference changes the perceived meaning considerably. Producing realistic-looking facial animations that are able to transmit this ...
The evaluation of stylized facial expressions
APGV '06: Proceedings of the 3rd symposium on Applied perception in graphics and visualization

Stylized rendering aims to abstract information in an image making it useful not only for artistic but also for visualization purposes. Recent advances in computer graphics techniques have made it possible to render many varieties of stylized imagery ...
Psychophysical evaluation of animated facial expressions
APGV '05: Proceedings of the 2nd symposium on Applied perception in graphics and visualization

The human face is capable of producing an astonishing variety of expressions---expressions for which sometimes the smallest difference changes the perceived meaning noticably. Producing realistic-looking facial animations that are able to transport this ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Applied Perception

ACM Transactions on Applied Perception Volume 4, Issue 3

November 2007

109 pages

ISSN:1544-3558

EISSN:1544-3965

DOI:10.1145/1278387

Issue’s Table of Contents

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2007

Published in TAP Volume 4, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
816
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Choudhary ZErickson ANorouzi NKim KBruder GWelch G(2023)Virtual Big Heads in Extended Reality: Estimation of Ideal Head Scales and Perceptual Thresholds for Comfort and Facial CuesACM Transactions on Applied Perception10.1145/357107420:1(1-31)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3571074
Berry MBrown S(2021)The dynamic mask: Facial correlates of character portrayal in professional actorsQuarterly Journal of Experimental Psychology10.1177/1747021821104793575:5(936-953)Online publication date: 4-Oct-2021
https://doi.org/10.1177/17470218211047935
McDonnell RMutlu B(2021)AppearanceThe Handbook on Socially Interactive Agents10.1145/3477322.3477327(105-146)Online publication date: 10-Sep-2021
https://dl.acm.org/doi/10.1145/3477322.3477327
Wöhler LZembaty MCastillo SMagnor MKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Towards Understanding Perceptual Differences between Genuine and Face-Swapped VideosProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445627(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445627
Wisessing PMcDonnell R(2020)Evalu-light: A practical approach for evaluating character lighting in real-timeACM Symposium on Applied Perception 202010.1145/3385955.3407937(1-6)Online publication date: 12-Sep-2020
https://dl.acm.org/doi/10.1145/3385955.3407937
Wisessing PZibrek KCunningham DDingliana JMcDonnell R(2020)Enlighten MeACM Transactions on Graphics10.1145/338319539:3(1-12)Online publication date: 17-Apr-2020
https://dl.acm.org/doi/10.1145/3383195
Hahn PCastillo SCunningham D(2019)Fitting the StyleProceedings of the 32nd International Conference on Computer Animation and Social Agents10.1145/3328756.3328770(21-24)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1145/3328756.3328770
Zell EZibrek KMcDonnell R(2019)Perception of virtual charactersACM SIGGRAPH 2019 Courses10.1145/3305366.3328101(1-17)Online publication date: 28-Jul-2019
https://dl.acm.org/doi/10.1145/3305366.3328101
Rocha MParma VLundström JSoares S(2018)Anxiety Body Odors as Context for Dynamic Faces: Categorization and Psychophysiological BiasesPerception10.1177/030100661879722747:10-11(1054-1069)Online publication date: 19-Sep-2018
https://doi.org/10.1177/0301006618797227
Hahn PCastillo SCunningham DBogdanovych ARichards DSimoff SPelachaud CHeylen DTrescak T(2018)Look Me in the LinesProceedings of the 18th International Conference on Intelligent Virtual Agents10.1145/3267851.3267881(339-340)Online publication date: 5-Nov-2018
https://dl.acm.org/doi/10.1145/3267851.3267881
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents