More Web Proxy on the site http://driver.im/

research-article

Data-driven simulation methods in computer graphics: cloth, tissue and faces

Authors:

Miguel A. Otaduy,

Huamin WangAuthors Info & Claims

SIGGRAPH '12: ACM SIGGRAPH 2012 Courses

Article No.: 12, Pages 1 - 96

https://doi.org/10.1145/2343483.2343495

Published: 05 August 2012 Publication History

Abstract

In recent years, various methods have been introduced to exploit pre-recorded data to improve the performance and/or realism of dynamic deformations, but their differences and similarities have not been adequately analyzed or discussed. So far, the proposed methods have been explored mainly in the research context. They have not been adopted by the computer graphics industry.

This course bridges the gap between research labs and industry to present a unifying theory and understanding of data-driven methods for dynamic deformations that may inspire development of novel solutions. It focuses on application of data-driven methods to three areas of computer animation: dynamic deformation of faces, soft volumetric tissue, and cloth. And it describes how to approach these challenges in a data-driven manner, classifies the various methods, and demonstrates how data-driven methods can work in other settings.

Supplementary Material

Part 1 (crs114_1_12.mp4)

Download
40.78 MB

Part 2 (crs114_4_12.mp4)

Download
30.30 MB

References

[1]

Alexa, M., Gross, M., Pauly, M., Pfister, H., Stamminger, M., and Zwicker, M. 2004. Point-based computer graphics. ACM SIGGRAPH 2004 Course Notes.

Digital Library

[2]

Atcheson, B., Ihrke, I., Heidrich, W., Tevs, A., Bradley, D., Magnor, M., and Seidel, H.-P. 2008. Time-resolved 3d capture of non-stationary gas flows. ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 27, 5, 132.

Digital Library

[3]

Baker, S., Scharstein, D., Lewis, J., Roth, S., Black, M., and Szeliski, R. 2011. A database and evaluation methodology for optical flow. International Journal of Computer Vision 92, 1, 1--31.

Digital Library

[4]

Becker, M., and Teschner, M. 2007. Robust and efficient estimation of elasticity parameters using the linear finite element method. In SimVis, 15--28.

[5]

Beeler, T., Bickel, B., Sumner, R., Beardsley, P., and Gross, M. 2010. High-quality single-shot capture of facial geometry. ACM Trans. Graph. (Proc. SIGGRAPH).

Digital Library

[6]

Beeler, T., Hahn, F., Bradley, D., Bickel, B., Beardsley, P., Gotsman, C., Sumner, R. W., and Gross, M. 2011. High-quality passive facial performance capture using anchor frames. ACM Trans. Graph. 30, 75:1--75:10.

Digital Library

[7]

Bhat, K. S., Twigg, C. D., Hodgins, J. K., Khosla, P. K., Popović, Z., and Seitz, S. M. 2003. Estimating cloth simulation parameters from video. In Proc. ACM SIGGRAPH/Eurographics SCA, 37--51.

Digital Library

[8]

Bickel, B., Lang, M., Botsch, M., Otaduy, M. A., and Gross, M. 2008. Pose-space animation and transfer of facial details. In Proc. of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 57--66.

Digital Library

[9]

Bickel, B., Bächer, M., Otaduy, M. A., Matusik, W., Pfister, H., and Gross, M. 2009. Capture and modeling of non-linear heterogeneous soft tissue. ACM Trans. Graph. 28, 3 (July), 89:1--89:9.

Digital Library

[10]

Bickel, B., Bächer, M., Otaduy, M. A., Lee, H. R., Pfister, H., Gross, M., and Matusik, W. 2010. Design and fabrication of materials with desired deformation behavior. ACM Transactions on Graphics 29, 4 (July), 63:1--63:10.

Digital Library

[11]

Boubekeur, T., Reuter, P., and Schlick, C. 2005. Visualization of point-based surfaces with locally reconstructed subdivision surfaces. In Shape Modeling International.

Digital Library

[12]

Boubekeur, T., Heidrich, W., Granier, X., and Schlick, C. 2006. Volume-surface trees. Computer Graphics Forum (Proceedings of EUROGRAPHICS 2006) 25, 3, 399--406.

[13]

Bradley, D., and Heidrich, W. 2010. Binocular camera calibration using rectification error. IEEE Conference on Computer and Robot Vision (CRV).

Digital Library

[14]

Bradley, D., Boubekeur, T., and Heidrich, W. 2008. Accurate multi-view reconstruction using robust binocular stereo and surface meshing. In Proc. CVPR.

[15]

Bradley, D., Popa, T., Sheffer, A., Heidrich, W., and Boubekeur, T. 2008. Markerless garment capture. ACM Trans. Graph. (Proc. of SIGGRAPH) 27, 3, 99:1--99:9.

Digital Library

[16]

Bradley, D., Atcheson, B., Ihrke, I., and Heidrich, W. 2009. Synchronization and rolling shutter compensation for consumer video camera arrays. In International Workshop on Projector-Camera Systems (PROCAMS 2009).

[17]

Bradley, D., Heidrich, W., Popa, T., and Sheffer, A. 2010. High resolution passive facial performance capture. ACM Trans. Graph. (Proc. SIGGRAPH) 29, 4, 41:1--41:10.

Digital Library

[18]

Breen, D., House, D., and Wozny, M. 1994. Predicting the drape of woven cloth using interacting particles. In Proc. of ACM SIGGRAPH, 365--372.

Digital Library

[19]

de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., and Thrun, S. 2008. Performance capture from sparse multi-view video. ACM Trans. Graphics (Proc. SIGGRAPH), 98.

Digital Library

[20]

de Aguiar, E., Sigal, L., Treuille, A., and Hodgins, J. K. 2010. Stable spaces for real-time clothing. ACM Transactions on Graphics 29, 4 (July), 106:1--106:9.

Digital Library

[21]

Eberhardt, B., Weber, A., and Strasser, W. 1996. A fast, flexible, particle-system model for cloth draping. IEEE Computer Graphics and Applications 16, 5, 52--59.

Digital Library

[22]

Ekman, P., and Friesen, W. 1978. The facial action coding system: A technique for the measurement of facial movement. In Consulting Psychologists.

[23]

Feng, W.-W., Yu, Y., and Kim, B.-U. 2010. A deformation transformer for real-time cloth animation. ACM Transactions on Graphics 29, 4 (July), 108:1--108:9.

Digital Library

[24]

Furukawa, Y., and Ponce, J. 2008. Dense 3d motion capture from synchronized video streams. In Proc. CVPR.

[25]

Furukawa, Y., and Ponce, J. 2009. Dense 3d motion capture for human faces. In CVPR.

[26]

Furukawa, Y., and Ponce, J. 2010. Accurate, dense, and robust multi-view stereopsis. IEEE Trans. on Pattern Analysis and Machine Intelligence 32, 8, 1362--1376.

Digital Library

[27]

Fusiello, A., Trucco, E., and Verri, A. 2000. A compact algorithm for rectification of stereo pairs. Mach. Vision Appl. 12, 1, 16--22.

Digital Library

[28]

Gopi, M., Krishnan, S., and Silva, C. 2000. Surface reconstruction based on lower dimensional localized delaunay triangulation. In Eurographics.

[29]

Gross, M., and Pfister, H., Eds. 2007. Point-Based Graphics. Morgan Kaufmann Publishers.

Digital Library

[30]

Guenter, B., Grimm, C., Wood, D., Malvar, H., and Pighin, F. 1998. Making faces. In SIGGRAPH '98: Proceedings of the 25th annual conference on Computer graphics and interactive techniques, 55--66.

Digital Library

[31]

Kajberg, J., and Lindkvist, G. 2004. Characterisation of materials subjected to large strains by inverse modelling based on in-plane displacement fields. International Journal of Solids and Structures 41, 13, 3439--3459.

[32]

Kauer, M., Vuskovic, V., Dual, J., Szekely, G., and Bajka, M. 2002. Inverse finite element characterization of soft tissues. Medical Image Analysis 6, 3, 257--287.

[33]

Kavan, L., Gerszewski, D., Bargteil, A. W., and Sloan, P.-P. 2011. Physics-inspired upsampling for cloth simulation in games. Proc. of ACM SIGGRAPH.

Digital Library

[34]

Kazhdan, M., Bolitho, M., and Hoppe, H. 2006. Poisson surface reconstruction. In Symposium on Geometry Processing.

Digital Library

[35]

Kunitomo, S., Nakamura, S., and Morishima, S. 2010. Optimization of cloth simulation parameters by considering static and dynamic features. In ACM SIGGRAPH Posters, 15:1.

Digital Library

[36]

Lang, J., Pai, D. K., and Woodham, R. J. 2002. Acquisition of elastic models for interactive simulation. International Journal of Robotics Research 21, 8, 713--733.

[37]

Lin, I.-C., and Ouhyoung, M. 2005. Mirror mocap: Automatic and efficient capture of dense 3d facial motion parameters from video. The Visual Computer 21, 6, 355--372.

[38]

Ma, W.-C., Jones, A., Chiang, J.-Y., Hawkins, T., Frederiksen, S., Peers, P., Vukovic, M., Ouhyoung, M., and Debevec, P. 2008. Facial performance synthesis using deformation-driven polynomial displacement maps. ACM Trans. Graphics (Proc. SIGGRAPH Asia) 27, 5, 121.

Digital Library

[39]

Ma, W.-C., Jones, A., Chiang, J.-Y., Hawkins, T., Frederiksen, S., Peers, P., Vukovic, M., Ouhyoung, M., and Debevec, P. 2008. Facial performance synthesis using deformation-driven polynomial displacement maps. ACM Trans. Graph. (Proc. of ACM SIGGRAPH Asia) 27, 5.

Digital Library

[40]

Miguel, E., Bradley, D., Thomaszewski, B., Bickel, B., Matusik, W., Otaduy, M. A., and Marschner, S. 2012. Data-driven estimation of cloth simulation models. Computer Graphics Forum (Proc. of Eurographics) 31, 2.

Digital Library

[41]

mview. http://vision.middlebury.edu/mview/.

[42]

Open source computer vision library.

[43]

Pai, D. K., van den Doel, K., James, D. L., Lang, J., Lloyd, J. E., Richmond, J. L., and Yau, S. H. 2001. Scanning physical interaction behavior of 3d objects. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 87--96.

Digital Library

[44]

Schnur, D. S., and Zabaras, N. 1992. An inverse method for determining elastic material properties and a material interface. International Journal for Numerical Methods in Engineering 33, 10, 2039--2057.

[45]

Scholz, V., Stich, T., Keckeisen, M., Wacker, M., and Magnor, M. 2005. Garment motion capture using color-coded patterns. In Proc. Eurographics, 439--448.

[46]

Schoner, J. L., Lang, J., and Seidel, H.-P. 2004. Measurement-based interactive simulation of viscoelastic solids. Computer Graphics Forum (Proc. Eurographics) 23, 3, 547--556.

[47]

Seitz, S. M., Curless, B., Diebel, J., Scharstein, D., and Szeliski, R. 2006. A comparison and evaluation of multi-view stereo reconstruction algorithms. In CVPR.

Digital Library

[48]

Sorkine, O., Cohen-Or, D., Lipman, Y., Alexa, M., Rössl, C., and Seidel, H.-P. 2004. Laplacian surface editing. In Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing, 175--184.

Digital Library

[49]

Vlasic, D., Baran, I., Matusik, W., and Popović, J. 2008. Articulated mesh animation from multi-view silhouettes. ACM Trans. Graphics (Proc. SIGGRAPH), 97.

Digital Library

[50]

Volino, P., Magnenat-Thalmann, N., and Faure, F. 2009. A simple approach to nonlinear tensile stiffness for accurate cloth simulation. ACM Trans. Graph. 28, 4.

Digital Library

[51]

Wand, M., Mitra, N., Pauly, M., Chang, W., and Li, H. 2012. Dynamic geometry processing. In Eurographics Tutorials.

[52]

Wang, H., Hecht, F., Ramamoorthi, R., and O'Brien, J. 2010. Example-based wrinkle synthesis for clothing animation. ACM Transactions on Graphics 29, 4 (July), 107:1--107:8.

Digital Library

[53]

Wang, H., Ramamoorthi, R., and O'Brien, J. 2011. Data-driven elastic models for cloth: Modeling and measurement. ACM Trans. Graph. (Proc. SIGGRAPH) 30, 4, 71.

Digital Library

[54]

White, R., Crane, K., and Forsyth, D. 2007. Capturing and animating occluded cloth. ACM Trans. Graphics (Proc. SIGGRAPH), 34.

Digital Library

[55]

Wilburn, B., Joshi, N., Vaish, V., Levoy, M., and Horowitz, M. 2004. High-speed videography using a dense camera array. In Proc. of CVPR, vol. 2, 294--301.

Digital Library

[56]

Williams, L. 1990. Performance-driven facial animation. SIGGRAPH Comput. Graph. 24, 4, 235--242.

Digital Library

[57]

Zhang, Z. 1999. Flexible camera calibration by viewing a plane from unknown orientations. In ICCV, 666--673.

[58]

Zurdo, J. S., Brito, J. P., and Otaduy, M. A. 2012. Animating wrinkles by example on non-skinned cloth. IEEE Trans. on Visualization and Computer Graphics.

Cited By

Wang ZSong CLee JKim JKim S(2022)Controllable Swarm Animation Using Deep Reinforcement Learning With a Rule-Based Action GeneratorIEEE Access10.1109/ACCESS.2022.317249210(48472-48485)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3172492
Quan HWang NLi JWang C(2019)Extracting-mapping scheme for the dynamic details in fluid re-simulations from videosMultimedia Systems10.1007/s00530-019-00612-025:4(371-381)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.1007/s00530-019-00612-0
Luo RShao TWang HXu WChen XZhou KYang Y(2018)NNWarp: Neural Network-based Nonlinear DeformationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.2881451(1-1)Online publication date: 2018
https://doi.org/10.1109/TVCG.2018.2881451
Show More Cited By

Recommendations

Cloth Simulation for Computer Graphics
Learning Computer Graphics: From 3D Models to Animated Movies on Your PC
Heuristics for continuity editing of cinematic computer graphics scenes
Sandbox '09: Proceedings of the 2009 ACM SIGGRAPH Symposium on Video Games

We present a set of heuristics for editing footage of 3D computer graphics cinematic sequences into a coherent movie clip which obeys the conventions of continuity editing. Our approach mimics the decision processes of an editor assembling a clip out of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '12: ACM SIGGRAPH 2012 Courses

August 2012

1998 pages

ISBN:9781450316781

DOI:10.1145/2343483

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 August 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

SIGGRAPH '12

Sponsor:

SIGGRAPH

SIGGRAPH '12: Special Interest Group on Computer Graphics and Interactive Techniques Conference

August 5 - 9, 2012

California, Los Angeles

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
1,610
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)3

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wang ZSong CLee JKim JKim S(2022)Controllable Swarm Animation Using Deep Reinforcement Learning With a Rule-Based Action GeneratorIEEE Access10.1109/ACCESS.2022.317249210(48472-48485)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3172492
Quan HWang NLi JWang C(2019)Extracting-mapping scheme for the dynamic details in fluid re-simulations from videosMultimedia Systems10.1007/s00530-019-00612-025:4(371-381)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.1007/s00530-019-00612-0
Luo RShao TWang HXu WChen XZhou KYang Y(2018)NNWarp: Neural Network-based Nonlinear DeformationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.2881451(1-1)Online publication date: 2018
https://doi.org/10.1109/TVCG.2018.2881451
Zhang JChang JYang XZhang J(2017)Virtual Reality Surgery Simulation: A Survey on Patient Specific SolutionNext Generation Computer Animation Techniques10.1007/978-3-319-69487-0_16(220-233)Online publication date: 1-Nov-2017
https://doi.org/10.1007/978-3-319-69487-0_16
Monteagudo CLozano MGarcía-Fernández IMartinez-Gil FCorchado Rodríguez JGarcía-Alonso AMasia B(2016)Phase space data-driven simulation of elastic materialsProceedings of the XXVI Spanish Computer Graphics Conference10.5555/3056989.3057003(69-73)Online publication date: 13-Sep-2016
https://dl.acm.org/doi/10.5555/3056989.3057003
Martin TUmetani NBickel B(2015)OmniADACM Transactions on Graphics10.1145/276691934:4(1-12)Online publication date: 27-Jul-2015
https://dl.acm.org/doi/10.1145/2766919
Wang BWu LYin KAscher ULiu LHuang H(2015)Deformation capture and modeling of soft objectsACM Transactions on Graphics10.1145/276691134:4(1-12)Online publication date: 27-Jul-2015
https://dl.acm.org/doi/10.1145/2766911
Weng BSourin A(2015)Towards Meniscus Elasticity Simulation in Virtual Knee Arthroscopy2015 7th International Conference on Multimedia, Computer Graphics and Broadcasting (MulGraB)10.1109/MulGraB.2015.16(22-27)Online publication date: Nov-2015
https://doi.org/10.1109/MulGraB.2015.16
Choi MWilber SHong M(2015)Estimating material properties of deformable objects by considering global object behavior in video streamsMultimedia Tools and Applications10.1007/s11042-014-1995-174:10(3361-3375)Online publication date: 1-May-2015
https://dl.acm.org/doi/10.1007/s11042-014-1995-1
Umetani NKoyama YSchmidt RIgarashi T(2014)PteromysACM Transactions on Graphics10.1145/2601097.260112933:4(1-10)Online publication date: 27-Jul-2014
https://dl.acm.org/doi/10.1145/2601097.2601129

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents