Skip to main content
Springer Nature Link
Log in

Scanning and animating characters dressed in multiple-layer garments

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Despite the development of user-friendly interfaces for modeling garments and putting them onto characters, preparing a character dressed in multiple layers of garments can be very time-consuming and tedious. In this paper, we propose a novel scanning-based solution for modeling and animating characters wearing multiple layers of clothes. This is achieved by making use of real clothes and human bodies. We first scan the naked body of a subject by an RGBD camera, and a statistical body model is fit to the scanned data. This results in a skinned articulated model of the subject. The subject is then asked to put on one piece of garment after another, and the articulated body model dressed up to the previous step is fit to the newly scanned data. The new garment is segmented in a semi-automatic fashion and added as an additional layer to the multi-layer garment model. During runtime, the skinned character is controlled based on the motion capture data and the multi-layer garment model is controlled by blending the movements computed by physical simulation and linear blend skinning, such that the cloth preserves its shape while it shows realistic physical motion. We present results where the character is wearing multiple layers of garments including a shirt, coat and a skirt. Our framework can be useful for preparing and animating dressed characters for computer games and films.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Alexiadis, D.S., Zarpalas, D., Daras, P.: Real-time, full 3-D reconstruction of moving foreground objects from multiple consumer depth cameras. IEEE Trans. Multimed. 15(2), 339–358 (2013)

    Article  Google Scholar 

  2. Baran, I., Popović, J.: Automatic rigging and animation of 3d characters. ACM Trans. Graph. 26(3), 72:1–72:8 (2007)

  3. Bouaziz, S., Martin, S., Liu, T., Kavan, L., Pauly, M.: Projective dynamics: fusing constraint projections for fast simulation. ACM Trans. Graph. 33(4), 154:1–154:13 (2014)

  4. Brouet, R., Sheffer, A., Boissieux, L.: Marie-Paule Cani. Design Preserving Garment Transfer. ACM Trans. Graph. 31(4), 36:1–36:12 (2012)

  5. Clegg, A., Tan, J., Turk, G., Liu, C.K.: Animating human dressing. ACM Trans. Graph. 34(4), 116:1–116:9 (2015)

  6. Cordier, F., Magnena-Thalmann, N.: Real-time animation of dressed virtual humans. Comput. Graph. Forum 21(3), 327–335 (2002)

    Article  Google Scholar 

  7. Cordier, F., Seo, H., Magnenat-Thalmann, N.: Made-to-measure technologies for an online clothing store. IEEE Comput. Graph. Appl. 23(1), 38–48 (2003)

    Article  Google Scholar 

  8. Cui, Y., Chang, W., Nöll, T., et al.: KinectAvatar: fully automatic body capture using a single Kinect. In: Asian Conference on Computer Vision, pp. 133–147 (2012)

  9. Feng, A., Casas, D., Shapiro, A.: Avatar reshaping and automatic rigging using a deformable model. In: Proceedings of the 8th ACM SIGGRAPH Conference on Motion in Games, pp. 57–64 (2015)

  10. Han, J., Shao, L., Xu, D., Shotton, J.: Enhanced computer vision with microsoft kinect sensor: a review. IEEE Trans. Cyber. 43(5), 1318–1334 (2013) 490

  11. Ho, E.S.L., Komura, T.: Character motion synthesis by topology coordinates. Comput. Graph. Forum 28(2), 299–308 (2009)

    Article  Google Scholar 

  12. Igarashi, T., Hughes, J.F.: Clothing manipulation. In: Proceedings of 15th Annual Symposium on User Interface Software and Technology, pp. 91–100 (2006)

  13. Istook, C.L., Hwang, S.J.: 3D body scanning systems with application to the apparel industry. J. Fash. Mark. Manag. Int. J. 5(2), 120–132 (2001)

    Article  Google Scholar 

  14. Izadi, S., Kim, D., Hilliges, O., et al.: KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, pp. 559–568 (2011)

  15. Jakob, W., Tarini, M., Panozzo, D., et al.: Instant field-aligned meshes. ACM Trans. Graph. 34(6), 189:1–189:15 (2015)

  16. Ju, T., Schaefer, S., Warren, J.: Mean value coordinates for closed triangular meshes. ACM Trans. Graph. 24(3), 561–566 (2005)

    Article  Google Scholar 

  17. Oh, S., Kim, H., Magnenat-Thalmann, N., et al.: Generating unified model for dressed virtual humans. Vis. Comput. 21(8), 522–531 (2005)

    Article  Google Scholar 

  18. Rocchini, C., Cignoni, P., Montani, C., et al.: Alowcost 3Dscanner based on structured light. Comput. Graph. Forum 20(3), 299–308 (2001)

    Article  Google Scholar 

  19. Stoll, C., Gall, J., De Aguiar, E., et al.: Video-based reconstruction of animatable human characters. ACMTrans. Graph. 29(6), 139:1–139:10 (2010)

  20. Tagliasacchi, A.: Schröder, M., Tkach, A., et al.: Robust articulated-ICP for real-time hand tracking. Comput. Graph. Forum 34(5), 101–114 (2015)

    Google Scholar 

  21. Tang, M., Wang, H., Tang, L., Tong, R., Manocha, D.: CAMA: Contact-aware matrix assembly with unified collision handling for GPU-based cloth simulation. Comput. Graph. Forum 35(2), 511–521 (2016)

    Article  Google Scholar 

  22. Tong, J., Zhou, J., Liu, L., et al.: Scanning 3d full human bodies using kinects. IEEE Trans. Vis. Comput. Graph. 18(4), 643–650 (2012)

    Article  Google Scholar 

  23. Umetani, N., Kaufman, D.M., Igarashi, T., et al.: Sensitive couture for interactive garment editing and modeling. ACM Trans. Graph. (SIGGRAPH 2011), 30(4), 90:1–90:12 (2011)

  24. Vlasic, D., Peers, P., Baran, I., et al.: Dynamic shape capture using multi-view photometric stereo. ACM Trans. Graph. 28(5), 174:1–174:12 (2009)

  25. Wang, H.: A chebyshev semi-iterative approach for accelerating projective and position-based dynamics[J]. ACM Trans. Graph. (TOG) 34(6), 246 (2015)

    Google Scholar 

  26. Wang, H., Sidorov, K., Sandilands, P., Komura, T.: Harmonic parameterization by electrostatics. ACM Trans. Graph. 32(5), 155:1–155:12 (2013)

  27. Wu, C., Stoll, C., Valgaerts, L., et al.: On-set performance capture of multiple actors with a stereo camera. ACMTrans. Graph. 32(6), 161 (2013)

    Google Scholar 

  28. Xu, W., Umetani, N., Chao, Q., Mao, J., Jin, X., Tong, X.: Sensitivity-optimized rigging for example-based real-time clothing synthesis. ACM Trans. Graph. 33(4), 107:1–107:11 (2014)

  29. Yamazaki, S., Kouchi, M., Mochimaru, M.: Markerless landmark localization on body shape scans by non-rigidmodel fitting. In: Proceedings of the 2nd Digital Human Modeling Symposium (2013)

  30. Zeng, M., Zheng, J., Cheng, X., et al.: Template-less quasi-rigid shape modeling with implicit loop-closure. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 145–152 (2013)

  31. Zhang, Z.: Microsoft kinect sensor and its effect. IEEE Multimed. 19(2), 4–10 (2012)

    Article  MathSciNet  Google Scholar 

  32. Zhang, M., Lin, L., Pan, Z., et al.: Topology-independent 3D garment fitting for virtual clothing. Multimed. Tools Appl. 74(9), 3137–3153 (2015)

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by Natural Science Foundation of China (Grant No. 61572124), Shanghai Natural Science Foundation (14ZR1401100) and China Scholarship Council (File No. 201506630055).

Author information

Authors and Affiliations

  1. Donghua University, Shanghai, China

    Pengpeng Hu & Yueqi Zhong

  2. Edinburgh University, Edinburgh, UK

    Taku Komura & Daniel Holden

  3. Key Lab of Textile Science and Technology, Ministry of Education, Shanghai, China

    Yueqi Zhong

Authors
  1. Pengpeng Hu
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Taku Komura
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Daniel Holden
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Yueqi Zhong
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Yueqi Zhong.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (mp4 7011 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hu, P., Komura, T., Holden, D. et al. Scanning and animating characters dressed in multiple-layer garments. Vis Comput 33, 961–969 (2017). https://doi.org/10.1007/s00371-017-1388-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-017-1388-3

Keywords