[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3359566.3364692acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmigConference Proceedingsconference-collections
abstract

Emotion Transfer for Hand Animation

Published: 28 October 2019 Publication History

Abstract

We propose a new data-driven framework for synthesizing hand motion at different emotion levels. Specifically, we first capture high-quality hand motion using VR gloves. The hand motion data is then annotated with the emotion type and a latent space is constructed from the motions to facilitate the motion synthesis process. By interpolating the latent representation of the hand motion, new hand animation with different levels of emotion strength can be generated. Experimental results show that our framework can produce smooth and consistent hand motions at an interactive rate.

References

[1]
Y. Bai and C. K. Liu. 2014. Dexterous manipulation using both palm and fingers. In Proceedings of ICRA 2014. 1560–1565. https://doi.org/10.1109/ICRA.2014.6907059
[2]
Jinxiang Chai and Jessica K. Hodgins. 2005. Performance Animation from Low-dimensional Control Signals. In ACM SIGGRAPH 2005 Papers(SIGGRAPH ’05). ACM, New York, NY, USA, 686–696. https://doi.org/10.1145/1186822.1073248
[3]
Jacky C. P. Chan, Hubert P. H. Shum, He Wang, Li Yi, Wei Wei, and Edmond S. L. Ho. 2019. A generic framework for editing and synthesizing multimodal data with relative emotion strength. Computer Animation and Virtual Worlds 0, 0 (2019), e1871. https://doi.org/10.1002/cav.1871 e1871 cav.1871.
[4]
Edmond S. L. Ho, Hubert P. H. Shum, Yiu-ming Cheung, and P. C. Yuen. 2013. Topology Aware Data-Driven Inverse Kinematics. Computer Graphics Forum 32, 7 (2013), 61–70. https://doi.org/10.1111/cgf.12212
[5]
Edmond S. L. Ho, Hubert P. H. Shum, H Wang, and L Yi. 2017. Synthesizing Motion with Relative Emotion Strength. In ACM SIGGRAPH ASIA Workshop: Data-Driven Animation Techniques (D2AT). http://eprints.whiterose.ac.uk/121250/
[6]
C. Karen Liu. 2008. Synthesis of Interactive Hand Manipulation. In Proceedings of SCA ’08(SCA ’08). Eurographics Association, Aire-la-Ville, Switzerland, 163–171.
[7]
C. Karen Liu. 2009. Dextrous Manipulation from a Grasping Pose. In ACM SIGGRAPH 2009 Papers(SIGGRAPH ’09). ACM, New York, NY, USA, Article 59, 6 pages.
[8]
H. P. H. Shum, E. S. L. Ho, Y. Jiang, and S. Takagi. 2013. Real-Time Posture Reconstruction for Microsoft Kinect. IEEE Transactions on Cybernetics 43, 5 (Oct 2013), 1357–1369. https://doi.org/10.1109/TCYB.2013.2275945
[9]
Yuting Ye and C. Karen Liu. 2012. Synthesis of Detailed Hand Manipulations Using Contact Sampling. ACM Trans. Graph. 31, 4, Article 41 (July 2012), 10 pages.

Cited By

View all
  1. Emotion Transfer for Hand Animation

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    MIG '19: Proceedings of the 12th ACM SIGGRAPH Conference on Motion, Interaction and Games
    October 2019
    329 pages
    ISBN:9781450369947
    DOI:10.1145/3359566
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 October 2019

    Check for updates

    Author Tags

    1. emotion
    2. hand animation
    3. motion capture
    4. style transfer

    Qualifiers

    • Abstract
    • Research
    • Refereed limited

    Conference

    MIG '19
    Sponsor:
    MIG '19: Motion, Interaction and Games
    October 28 - 30, 2019
    Newcastle upon Tyne, United Kingdom

    Acceptance Rates

    Overall Acceptance Rate -9 of -9 submissions, 100%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)4
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 01 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media