[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Springer Nature Link
Log in

Detailed wrinkle generation of virtual garments from a single image

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The presence of proper wrinkles is important while modeling realistic virtual garments. Unlike previously used full 3D information methods, our approach achieves detailed garment generation from a single image. First, we retrieve a garment image similar to the initial virtual garment based on content-based image retrieval (CBIR) method. Then, we preprocess the image with a combination of human body reshaping, image segmentation and shape recovery, to obtain the 3D wrinkle details. Finally, the garment height are synthesized into the virtual garment. For better suit the posture of the human body, excess garment energy are released to remove the unmatched wrinkles. We apply our method to various styles of virtual garments, and it enable virtual characters in general pose to be dressed in these garments and complete wrinkle generation. Compared with existing garment modeling methods, the experimental results show that the proposed method could quickly capture the realistic wrinkles of virtual garments with less manual operation and achieve more realistic wrinkles for virtual garments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6.
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Data availability

The research data used to support the findings of this study are available from the corresponding author upon request. [Corresponding name: Yanjun Peng, Email: pengyanjuncn@163.com].

References

  1. Abdel-Hakim AE, Farag AA (2006) CSIFT: a SIFT descriptor with color invariant characteristics. Comput Vision Pattern Recog 2:1978–1983

    Google Scholar 

  2. Aguiar ED, Sigal L, Treuille A et al (2010) Stable Spaces for Real-Time Clothing. ACM Trans Graphics 29(4):106:1–106:9

    Article  Google Scholar 

  3. Berthouzoz F, Garg A, Kaufman DM et al (2013) Parsing sewing patterns into 3d garments. ACM Trans Graph 32(4):1–12

    Article  Google Scholar 

  4. Bradley D, Popa T, Sheffer A et al (2008) Markerless garment capture. ACM Trans Graph 27(3):1–9

    Article  Google Scholar 

  5. W. Chen, B. Zhou, F. X. Lu et. al., “Garment modeling with a depth camera,” ACM Trans Graph, vol. 34, no. 6, pp. 1–12, 2015.

  6. Daněřek R, Dibra E, Öztireli C et al (2017) DeepGarment: 3d garment shape estimation from a single image. Comput Graphics Forum 36(2):269–280

    Article  Google Scholar 

  7. A. Gordo, J. Almazan, J. Revaud et. al., “Deep image retrieval: learning global representations for image search,” Eur Conf Comp Vision, pp. 241–257, 2016.

  8. Guo JM, Li JM (2015) CNN based hashing for image retrieval. Computer Vision & Pattern Recognition

  9. H. Jegou, M. Douze, C. Schmid et. al., “Aggregating local descriptors into a compact image representation,” Comput Vision Pattern Recog, vol. 238, no. 6, pp. 3304–3311, 2010.

  10. Li Y, Sun J, Tang CK et al (2004) Lazy Snapping. ACM Trans Graph 23(3):303–308

    Article  Google Scholar 

  11. Liu ZQ, Wang SJ, Tian Q (2016) Fine-Residual Vlad for Image Retrieval. Neurocomputing 173(P3):1183–1191

    Article  Google Scholar 

  12. Meng YW, Mok PY, Jin XG (2012) Computer aided clothing pattern design with 3d editing and pattern alteration. Computer Aided Design 44(8):721–734

    Article  Google Scholar 

  13. Perronnin F, Sanchez J, Mensink T (2010) Improving the fisher kernel for large-scale image classification. Eur Conf Comput Vision 115(7):143–156

    Google Scholar 

  14. Popa T, Zhou Q, Bradley D et al (2009) Wrinkling captured garments using space-time data-driven deformation. Eurographics 28(2):427–436

    Google Scholar 

  15. Robson C, Maharik R, Sheffer A et al (2011) Context-Aware Garment Modeling from Sketches. Comput Graph 35(3):604–613

    Article  Google Scholar 

  16. D. Rohmer, T. Popa, M. P. Cani et. al., “Animation wrinkling: augmenting coarse cloth simulations with realistic-looking wrinkles,” ACM Trans Graph, vol. 29, no. 6, pp. 1–8, 2010.

  17. Seddati O, Dupont S, Mahmoudi S et al (2017) Towards good practices for image retrieval based on CNN features. IEEE Int Conf Comput Vision Workshop:1246–1255

  18. Simonyan K, Zisserman A (2015) “Very deep convolutional networks for large-scale image recognition,” In ICLR.

  19. Vlasic D, Peers P, Baran L et al (2009) Dynamic shape capture using multi-view photometric stereo. ACM Trans Graph 28(5):1–11

    Article  Google Scholar 

  20. Wang HM (2018) Ruel-Free Sewing Pattern Adjustment with Precision and Efficiency. ACM Trans Graphics 37(4):53:1–53:13

    Google Scholar 

  21. Wang HM, Hecht F, Ramamoorthi R et al (2010) Example-Based Wrinkle Synthesis for Clothing Animation. ACM Trans Graphics 29(4):107:1–107:8

    Google Scholar 

  22. Yang S, Pan ZR, Amert TY et al (2018) Physics-inspired garment recovery from a single-view image. ACM Trans Graph 37(5):1–14

    Article  Google Scholar 

  23. Yu W, Yang KY, Yao HX et al (2016) Exploiting the complementary strengths of multi-layer CNN features for image retrieval. Neurocomputing 237:235–241

    Article  Google Scholar 

  24. Zhang MM, Lin L, Pan ZG et al (2015) Topology-independent 3D garment fitting for virtual clothing. Multimedia Tools Appl 74(9):3137–3153

    Article  Google Scholar 

  25. Zheng L, Yang Y, Tian Q (2018) SIFT Meets CNN: A Decade Survey of Instance Retrieval. IEEE Trans Pattern Anal Mach Intell 40(5):1224–1244

    Article  Google Scholar 

  26. Zhou SZ, Fu HB, Liu LG et al (2010) Parametric Reshaping of Human Bodies in Images. ACM Trans Graphics 29(4):126:1–126:10

    Article  Google Scholar 

  27. Zhou B, Chen XW, Fu Q et al (2013) Garment modeling from a single image. Comput Graphics Forum 32(7):85–91

    Article  Google Scholar 

  28. Y. X. Zhu, Y. J. Peng, A. Boodaghian Asl (2019) “Dual Adaptive Adjustement for Customized Garment Pattern”. Sci Prog. vol. 2019, Article ID 8069373, 12 pages

  29. Zurdo JS, Brito JP, Otaduy MA (2012) Animating wrinkles by example on non-skinned cloth. IEEE Trans Vis Comp Graphics 19(1):149–158

    Article  Google Scholar 

Download references

Acknowledgments

We would like to thank Assoc Prof. Mingmin Zhang at Zhejiang University for his valuable comments, and Prof. Zhigeng Pan at Hangzhou Normal University for discussion.

Funding

This work is supported by the National Key Research and Development Program of China under Grant No. 2018YFB1004902, the Natural Science Foundation of Shandong Province under Grant No. ZR2019MF003, the Natural Science Foundation of Shandong Province under Grant No. ZR2017FM054, the National Natural Science Foundation of China under Grant No. 61976126.

Author information

Authors and Affiliations

  1. College of Information Engineering, Huanghuai University, Zhumadian, 463000, Henan, China

    Yuxiang Zhu

  2. College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao, China

    Yuxiang Zhu & Yanjun Peng

  3. Henan Provincial Key Laboratory of Smart Lighting, Huanghuai University, Zhumadian, 463000, Henan, China

    Yuxiang Zhu

  4. College of Computer Science and Technology, Zhejiang University, Hangzhou, China

    Mingmin Zhang

  5. Information System, Karlstad University, Karlstad, Sweden

    Arsineh Boodaghian Asl

Authors
  1. Yuxiang Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mingmin Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yanjun Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Arsineh Boodaghian Asl
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yanjun Peng.

Ethics declarations

Conflict of interest

No conflict of interest exits in the submission of this manuscript, and manuscript is approved by all authors for publication to your journal. We confirm that the content of the manuscript has not been published or submitted for publication elsewhere.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhu, Y., Zhang, M., Peng, Y. et al. Detailed wrinkle generation of virtual garments from a single image. Multimed Tools Appl 80, 4053–4071 (2021). https://doi.org/10.1007/s11042-020-09917-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09917-z

Keywords

Search

Navigation