[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/2159616.2159630acmconferencesArticle/Chapter ViewAbstractPublication Pagesi3dConference Proceedingsconference-collections
research-article

Sleight of hand: perception of finger motion from reduced marker sets

Published: 09 March 2012 Publication History

Abstract

Subtle animation details such as finger or facial movements help to bring virtual characters to life and increase their appeal. However, it is not always possible to capture finger animations simultaneously with full-body motion, due to limitations of the setup or tight production schedules. Therefore, hand motions are often either omitted, manually created by animators, or captured during a separate session and spliced with full body animation. In this paper, we investigate the perceived fidelity of hand animations where all the degrees of freedom of the hands are computed from reduced marker sets. In a set of perceptual experiments, we found that finger motions reconstructed with inverse kinematics from a reduced marker set of eight markers per hand are perceived to be very similar to the corresponding motions reconstructed using a full set of twenty markers. We demonstrate how using this reduced set of eight large markers enabled us to capture the finger and full-body motions of two actors performing a range of relatively unconstrained actions using a 13-camera motion capture system. This serves to simplify the capture process and to significantly reduce the time for cleanup, while preserving the natural biological movements of the hands relative to the actions performed.

Supplementary Material

JPG File (p79-hoyet.jpg)
AVI File (p79-hoyet.avi)

References

[1]
Albrecht, I., Haber, J., and Seidel, H.-P. 2003. Construction and animation of anatomically based human hand models. In Proc. of SCA 2003, 98--109.
[2]
Cassell, J., Pelachaud, C., Badler, N., Steedman, M., Achorn, B., Becket, T., Douville, B., Prevost, S., and Stone, M. 1994. Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents. In Proc. of the 21st annual conference on Computer graphics and interactive techniques, 413--420.
[3]
Chai, J., and Hodgins, J. K. 2005. Performance animation from low-dimensional control signals. ACM Trans. Graph. 24, 686--696.
[4]
Chang, L., and Pollard, N. 2008. Method for determining kinematic parameters of the in vivo thumb carpometacarpal joint. IEEE Trans. on Biomedical Engineering 55, 7, 1897--1906.
[5]
Chang, L., Pollard, N., Mitchell, T., and Xing, E. 2007. Feature selection for grasp recognition from optical markers. In IEEE/RSJ International Conference on Intelligent Robots and Systems, 2007, 2944--2950.
[6]
Edwards, S. J., Buckland, D. J., and McCoy-Powlen, J. D. 2002. Developmental & Functional Hand Grasps. Thorofare, New Jersey: Slack Incorporated.
[7]
El-Sawah, A., Georganas, N., and Petriu, E. 2006. Finger inverse kinematics using error model analysis for gesture enabled navigation in virtual environments. In IEEE International Workshop on Haptic Audio Visual Environments and their Applications, 2006, 34--39.
[8]
ElKoura, G., and Singh, K. 2003. Handrix: animating the human hand. In Proc. of SCA 2003, 110--119.
[9]
Ennis, C., McDonnell, R., and O'Sullivan, C. 2010. Seeing is believing: body motion dominates in multisensory conversations. ACM Trans. Graph. 29, 91, 91:1--91:9.
[10]
Giorgolo, G., and Verstraten, F. 2008. Perception of speech-and-gesture integration. In Proc. of the International Conference on Auditory-Visual Speech Processing 2008, 31--36.
[11]
Greiner, T. M. 1991. Hand anthropometry of US Army personnel. Security, ADA244533, 434.
[12]
Hodgins, J. K., O'Brien, J. F., and Tumblin, J. 1998. Perception of human motion with different geometric models. IEEE Trans. on Visualization and Computer Graphics 4, 4, 307--316.
[13]
Jin, G., and Hahn, J. 2005. Adding hand motion to the motion capture based character animation. ISVC 2005, 17--24.
[14]
Jörg, S., and O'Sullivan, C. 2009. Exploring the dimensionality of finger motion. In Proc. of the 9th Eurographics Ireland Workshop (EGIE 2009), 1--11.
[15]
Jörg, S., Hodgins, J., and O'Sullivan, C. 2010. The perception of finger motions. In Proc. of the 7th Symposium on Applied Perception in Graphics and Visualization, 129--133.
[16]
Kipp, M., Neff, M., Kipp, K. H., and Albrecht, I. 2007. Towards natural gesture synthesis: Evaluating gesture units in a data-driven approach to gesture synthesis. In Proc. of the 7th international conference on Intelligent Virtual Agents, 15--28.
[17]
Lee, J., and Kunii, T. 1995. Model-based analysis of hand posture. IEEE Computer Graphics & Applications 15, 5, 77--86.
[18]
Liu, C. K. 2009. Dextrous manipulation from a grasping pose. ACM Trans. Graph. 28, 59:1--59:6.
[19]
Majkowska, A., Zordan, V. B., and Faloutsos, P. 2006. Automatic splicing for hand and body animations. In Proc. of SCA 2006, 309--316.
[20]
McDonnell, R., Larkin, M., Dobbyn, S., Collins, S., and O'Sullivan, C. 2008. Clone attack! perception of crowd variety. ACM Trans. Graph. 27, 26:1--26:8.
[21]
McNeill, D. 2005. Gesture and Thought. University of Chicago Press.
[22]
Pollard, N. S., and Zordan, V. B. 2005. Physically based grasping control from example. In Proc. of SCA 2005, 311--318.
[23]
Reitsma, P., Andrews, J., and Pollard, N. 2008. Effect of character animacy and preparatory motion on perceptual magnitude of errors in ballistic motion. In Proc. of Eurographics '08.
[24]
Rijpkema, H., and Girard, M. 1991. Computer animation of knowledge-based human grasping. In Proc. of the 18th annual conference on Computer graphics and interactive techniques, 339--348.
[25]
Sueda, S., Kaufman, A., and Pai, D. K. 2008. Musculotendon simulation for hand animation. ACM Trans. Graph. 27, 83:1--83:8.
[26]
Tsang, W., Singh, K., and Eugene, F. 2005. Helping hand: an anatomically accurate inverse dynamics solution for unconstrained hand motion. In Proc. of SCA 2005, 319--328.
[27]
Wang, R. Y., and Popović, J. 2009. Real-time hand-tracking with a color glove. ACM Trans. Graph. 28, 63:1--63:8.
[28]
Wu, Y., and Huang, T. 2001. Hand modeling, analysis and recognition. IEEE Signal Processing Magazine 18, 3, 51--60.

Cited By

View all
  • (2024)SKEL-Betweener: a Neural Motion Rig for Interactive Motion AuthoringACM Transactions on Graphics10.1145/368794143:6(1-11)Online publication date: 19-Dec-2024
  • (2024)A Survey on Realistic Virtual Human Animations: Definitions, Features and EvaluationsComputer Graphics Forum10.1111/cgf.1506443:2Online publication date: 30-Apr-2024
  • (2024)Incorporating Physics Principles for Precise Human Motion Prediction2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00605(6152-6162)Online publication date: 3-Jan-2024
  • Show More Cited By

Index Terms

  1. Sleight of hand: perception of finger motion from reduced marker sets

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    I3D '12: Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
    March 2012
    220 pages
    ISBN:9781450311946
    DOI:10.1145/2159616
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 March 2012

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. finger animation
    2. motion capture
    3. perception

    Qualifiers

    • Research-article

    Conference

    I3D '12
    Sponsor:
    I3D '12: Symposium on Interactive 3D Graphics and Games
    March 9 - 11, 2012
    California, Costa Mesa

    Acceptance Rates

    Overall Acceptance Rate 148 of 485 submissions, 31%

    Upcoming Conference

    I3D '25
    Symposium on Interactive 3D Graphics and Games
    May 7 - 9, 2025
    Jersey City , NJ , USA

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)36
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 02 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)SKEL-Betweener: a Neural Motion Rig for Interactive Motion AuthoringACM Transactions on Graphics10.1145/368794143:6(1-11)Online publication date: 19-Dec-2024
    • (2024)A Survey on Realistic Virtual Human Animations: Definitions, Features and EvaluationsComputer Graphics Forum10.1111/cgf.1506443:2Online publication date: 30-Apr-2024
    • (2024)Incorporating Physics Principles for Precise Human Motion Prediction2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00605(6152-6162)Online publication date: 3-Jan-2024
    • (2024)Berkeley Open Extended Reality Recordings 2023 (BOXRR-23): 4.7 Million Motion Capture Recordings from 105,000 XR UsersIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337208730:5(2239-2246)Online publication date: 4-Mar-2024
    • (2024)Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinement2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00080(777-787)Online publication date: 16-Jun-2024
    • (2024)Stretchable glove for accurate and robust hand pose reconstruction based on comprehensive motion dataNature Communications10.1038/s41467-024-50101-w15:1Online publication date: 11-Jul-2024
    • (2023)How Important are Detailed Hand Motions for Communication for a Virtual Character Through the Lens of Charades?ACM Transactions on Graphics10.1145/357857542:3(1-16)Online publication date: 31-May-2023
    • (2023)Back to MLP: A Simple Baseline for Human Motion Prediction2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV56688.2023.00479(4798-4808)Online publication date: Jan-2023
    • (2023)MotionBERT: A Unified Perspective on Learning Human Motion Representations2023 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV51070.2023.01385(15039-15053)Online publication date: 1-Oct-2023
    • (2022)UNOC: Understanding Occlusion for Embodied Presence in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.308540728:12(4240-4251)Online publication date: 1-Dec-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media