[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/1275808.1276420acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
Article

Capturing and animating occluded cloth

Published: 29 July 2007 Publication History

Abstract

We capture the shape of moving cloth using a custom set of color markers printed on the surface of the cloth. The output is a sequence of triangle meshes with static connectivity and with detail at the scale of individual markers in both smooth and folded regions. We compute markers' coordinates in space using correspondence across multiple synchronized video cameras. Correspondence is determined from color information in small neighborhoods and refined using a novel strain pruning process. Final correspondence does not require neighborhood information. We use a novel data driven hole-filling technique to fill occluded regions. Our results include several challenging examples: a wrinkled shirt sleeve, a dancing pair of pants, and a rag tossed onto a cup. Finally, we demonstrate that cloth capture is reusable by animating a pair of pants using human motion capture data.

Supplementary Material

JPG File (pps034.jpg)
MP4 File (pps034.mp4)

References

[1]
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., and Davis, J. 2005. Scape: shape completion and animation of people. In SIGGRAPH.
[2]
Baraff, D., Witkin, A., and Kass, M. 2003. Untangling cloth. In SIGGRAPH.
[3]
Bhat, K., Twigg, C., Hodgins, J. K., Khosla, P., Popovic, Z., and Seitz, S. 2003. Estimating cloth simulation parameters from video. In SCA.
[4]
Bouguet, J.-Y., 2005. Camera calibration toolbox for matlab. http://www.vision.caltech.edu/bouguetj/calib_doc/.
[5]
Bradley, D., Roth, G., and Bose, P. 2005. Augmented clothing. In Graphics Interface.
[6]
Bridson, R., Marino, S., and Fedkiw, R. 2003. Simulation of clothing with folds and wrinkles. In SCA.
[7]
Choi, K.-J., and Ko, H.-S. 2002. Stable but responsive cloth. In SIGGRAPH.
[8]
Cover, T. M., and Thomas, J. A. 1991. Information Theory. John Wiley and Sons.
[9]
Forsyth, D., and Ponce, J. 2002. Computer Vision: a modern approach. Prentice-Hall.
[10]
Guskov, I., and Zhukov, L. 2002. Direct pattern tracking on flexible geometry. In WSCG.
[11]
Guskov, I., Klibanov, S., and Bryant, B. 2003. Trackable surfaces. In SCA.
[12]
Hartley, R., and Zisserman, A. 2000. Multiple View Geometry. Cambridge University Press.
[13]
Hasler, N., Asbach, M., Rosenhahn, B., Ohm, J.-R., and Seidel, H.-P. 2006. Physically based tracking of cloth. In VMV.
[14]
House, D., and Breen, D., Eds. 2000. Cloth Modelling and Animation. A. K. Peters.
[15]
Kircher, S., and Garland, M. 2006. Editing arbitrarily deforming surface animations. In SIGGRAPH.
[16]
Lin, W.-C., and Liu, Y. 2006. Tracking dynamic near-regular textures under occlusion and rapid movements. In ECCV.
[17]
Lipman, Y., Sorkine, O., Levin, D., and Cohen-Or, D. 2005. Linear rotation-invariant coordinates for meshes. In SIGGRAPH.
[18]
Lowe, D. 2004. Distinctive image features from scale-invariant keypoints. IJCV.
[19]
Park, S. I., and Hodgins, J. K. 2006. Capturing and animating skin deformation in human motion. In SIGGRAPH.
[20]
Perona, P., and Malik, J. 1990. Scale-space and edge detection using anisotropic diffusion. PAMI.
[21]
Pritchard, D., and Heidrich, W. 2003. Cloth motion capture. Eurographics.
[22]
Provot, X. 1995. Deformation constraints in a mass-spring model to describe rigid cloth behavior. In Graphics Interface.
[23]
Scholz, V., and Magnor, M. A. 2004. Cloth motion from optical flow. In VMV.
[24]
Scholz, V., and Magnor, M. 2006. Texture replacement of garments in monocular video sequences. In Rendering Techniques.
[25]
Scholz, V., Stich, T., Keckeisen, M., Wacker, M., and Magnor, M. 2005. Garment motion capture using color-coded patterns. In Eurographics.
[26]
Sorkine, O., Cohen-Or, D., Lipman, Y., Alexa, M., Rössl, C., and Seidel, H.-P. 2004. Laplacian surface editing. In Symposium of Geometry Processing.
[27]
Sumner, R. W., and Popovic, J. 2004. Deformation transfer for triangle meshes. In SIGGRAPH.
[28]
Sumner, R. W., Zwicker, M., Gotsman, C., and Popovic, J. 2005. Mesh-based inverse kinematics. In SIGGRAPH.
[29]
Tanie, H., Yamane, K., and Nakamura, Y. 2005. High marker density motion capture by retroreflective mesh suit. In ICRA.
[30]
Terzopoulos, D., Platt, J., Barr, A., and Fleischer, K. 1987. Elastically deformable models. In SIGGRAPH.
[31]
White, R., and Forsyth, D., 2005. Deforming objects provide better camera calibration. UC Berkeley Technical Report.
[32]
White, R., and Forsyth, D. 2006. Retexturing single views using texture and shading. In ECCV.
[33]
White, R., Lobay, A., and Forsyth, D., 2005. Cloth capture. UC Berkeley Technical Report.
[34]
White, R., Forsyth, D., and Vasanth, J., 2006. Capturing real folds in cloth. UC Berkeley Technical Report.
[35]
Zhang, Z. 2002. A flexible new technique for camera calibration. PAMI.

Cited By

View all
  • (2023)PERGAMO: Personalized 3D Garments from Monocular VideoComputer Graphics Forum10.1111/cgf.1464441:8(293-304)Online publication date: 20-Mar-2023
  • (2022)DiffCloth: Differentiable Cloth Simulation with Dry Frictional ContactACM Transactions on Graphics10.1145/352766042:1(1-20)Online publication date: 3-Oct-2022
  • (2021)GarmentNets: Category-Level Pose Estimation for Garments via Canonical Space Shape Completion2021 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV48922.2021.00331(3304-3313)Online publication date: Oct-2021
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGGRAPH '07: ACM SIGGRAPH 2007 papers
August 2007
1019 pages
ISBN:9781450378369
DOI:10.1145/1275808
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2007

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Article

Conference

SIGGRAPH07
Sponsor:

Acceptance Rates

SIGGRAPH '07 Paper Acceptance Rate 108 of 455 submissions, 24%;
Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2023)PERGAMO: Personalized 3D Garments from Monocular VideoComputer Graphics Forum10.1111/cgf.1464441:8(293-304)Online publication date: 20-Mar-2023
  • (2022)DiffCloth: Differentiable Cloth Simulation with Dry Frictional ContactACM Transactions on Graphics10.1145/352766042:1(1-20)Online publication date: 3-Oct-2022
  • (2021)GarmentNets: Category-Level Pose Estimation for Garments via Canonical Space Shape Completion2021 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV48922.2021.00331(3304-3313)Online publication date: Oct-2021
  • (2020)Fully Convolutional Graph Neural Networks for Parametric Virtual Try‐OnComputer Graphics Forum10.1111/cgf.1410939:8(145-156)Online publication date: 24-Nov-2020
  • (2020)HUMBI: A Large Multiview Dataset of Human Body Expressions2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR42600.2020.00306(2987-2997)Online publication date: Jun-2020
  • (2019)Convex Relaxations for Consensus and Non-Minimal Problems in 3D Vision2019 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV.2019.01033(10232-10241)Online publication date: Oct-2019
  • (2018)Inextensible Non-Rigid Structure-from-Motion by Second-Order Cone ProgrammingIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2017.276266940:10(2428-2441)Online publication date: 1-Oct-2018
  • (2018)Force-Based Representation for Non-Rigid Shape and Elastic Model EstimationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2017.275271040:9(2137-2150)Online publication date: 1-Sep-2018
  • (2018)Incremental Non-Rigid Structure-from-Motion with Unknown Focal LengthComputer Vision – ECCV 201810.1007/978-3-030-01261-8_46(776-793)Online publication date: 6-Oct-2018
  • (2018)Model-free Consensus Maximization for Non-Rigid ShapesComputer Vision – ECCV 201810.1007/978-3-030-01225-0_8(123-140)Online publication date: 6-Oct-2018
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media