More Web Proxy on the site http://driver.im/

Article

Marker-free kinematic skeleton estimation from sequences of volume data

Authors:

Christian Theobalt,

Edilson de Aguiar,

Marcus A. Magnor,

Holger Theisel,

Hans-Peter SeidelAuthors Info & Claims

VRST '04: Proceedings of the ACM symposium on Virtual reality software and technology

Pages 57 - 64

https://doi.org/10.1145/1077534.1077546

Published: 10 November 2004 Publication History

Abstract

For realistic animation of an artificial character a body model that represents the character's kinematic structure is required. Hierarchical skeleton models are widely used which represent bodies as chains of bones with interconnecting joints. In video motion capture, animation parameters are derived from the performance of a subject in the real world. For this acquisition procedure too, a kinematic body model is required. Typically, the generation of such a model for tracking and animation is, at best, a semi-automatic process. We present a novel approach that estimates a hierarchical skeleton model of an arbitrary moving subject from sequences of voxel data that were reconstructed from multi-view video footage. Our method does not require a-priori information about the body structure. We demonstrate its performance using synthetic and real data.

References

[1]

F. Banégas, M. Jaeger, D. Michelucci, and M. Roelens. The ellipsoidal skeleton in medical applications. In Proc. of the sixth ACM symposium on Solid modeling and applications, pages 30--38. ACM Press, 2001.]]

Digital Library

[2]

A. Bottino and A. Laurentini. A silhouette-based technique for the reconstruction of human movement. CVIU, 83:79--95, 2001.]]

Digital Library

[3]

C. Bregler and J. Malik. Tracking people with twists and exponential maps. In Proc. of CVPR 98, pages 8--15, 1998.]]

Digital Library

[4]

R. Byrd, P. Lu, J. Nocedal, and C. Zhu. A limited memory algorithm for bound constrained optimization. SIAM J. Sci. Comp., 16(5):1190--1208, 1995.]]

Digital Library

[5]

J. Carranza, C. Theobalt, M. Magnor, and H.-P. Seidel. Free-viewpoint video of human actors. In Proc. of SIGGRAPH'03, pages 569--577, 2003.]]

Digital Library

[6]

G. Cheung, B. S., and T. Kanada. Shape-from-silhouette of articulated objects and its use for human body kinematics estiamtion and motion capture. In Proc. of CVPR, 2003.]]

[7]

K. Cheung, T. Kanade, J.-Y. Bouguet, and M. Holler. A real time system for robust 3D voxel reconstruction of human motions. In Proc. of CVPR, volume 2, pages 714--720, 2000.]]

[8]

L. Chevalier, F. Jaillet, and B. A. Segmentation and superquadric modeling of 3D objects. In Proc. of WSCG 2003, 2003.]]

[9]

E. de Aguiar, C. Theobalt, M. Magnor, H. Theisel, and H.-P. Seidel. M3: Marker-free model reconstruction and motion tracking from 3d voxel data. In Proc. of Pacific Graphics'04. to appear, 2004.]]

Digital Library

[10]

Q. Delamarre and O. Faugeras. 3D articulated models and multi-view tracking with silhouettes. In Proc. of ICCV 99, pages 716--721, 1999.]]

Digital Library

[11]

B. Deutscher, A. Blake, and I. Reid. Articulated body motion capture by annealed particle filtering. In Proc. of CVPR'00, 2000.]]

[12]

D. Gavrila. The visual analysis of human movement. CVIU, 73(1):82--98, January 1999.]]

Digital Library

[13]

D. Gavrila and L. Davis. 3D model-based tracking of humans in action: A multi-view approach. In Proc. of CVPR 96, pages 73--80, 1996.]]

Digital Library

[14]

I. Kakadiaris and D. Metaxas. 3D human body model acquisition from multiple views. In Proc. of ICCV'95, pages 618--623, 1995.]]

Digital Library

[15]

S. Katz and A. Tal. Hierarchical mesh decomposition using fuzzy clustering and cuts. In Proc. of SIGGRAPH'03, pages 954--961, 2003.]]

Digital Library

[16]

K. N. Kutulakos and S. M. Seitz. A theory of shape by space carving. Int. J. Comput. Vision, 38(3):199--218, 2000.]]

Digital Library

[17]

A. Leonardis, A. Jaklic, and F. Solina. Superquadrics for segmenting and modeling range data. IEEE PAMI, 19(11):1289--1295, 1997.]]

Digital Library

[18]

M. Leung and Y. Yang. First sight: A human body outline labeling system. PAMI, 17(4):359--379, 1995.]]

Digital Library

[19]

S. Loncaric. A survey of shape analysis techniques. Pattern Recognition, 31(8):983--1001, 1998.]]

[20]

J. Luck and D. Small. Real-time markerless motion tracking using linked kinematic chains. In Proc. of CVPRIP02, 2002.]]

[21]

A. Menache. Understanding Motion Capture for Computer Animation and Video Games. Morgan Kaufmann, 1995.]]

Digital Library

[22]

I. Mikić, M. Triverdi, E. Hunter, and P. Cosman. Articulated body posture estimation from multicamera voxel data. In Proc. of CVPR, 2001.]]

[23]

R. Plaenkers and P. Fua. Tracking and modeling people in video sequences. CVIU, 81(3):285--302, March 2001.]]

Digital Library

[24]

W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery. Numerical recipes in C++. Cambridge University Press, 2002.]]

Digital Library

[25]

K. Rohr. Incremental recognition of pedestrians from image sequences. In Proc. of CVPR, pages 8--13, 1993.]]

[26]

M.-C. Silaghi, R. Plaenkers, R. Boulic, P. Fua, and D. Thalmann. Local and global skeleton fitting techniques for optical motion capture. In Modeling and Motion Capture Techniques for Virtual Environments, number 1537 in LNAI, No1537, pages 26--40. Springer, 1998.]]

Digital Library

[27]

M. Sniedovich. Dynamic programming. Marcel Dekker, Inc., 1992.]]

Digital Library

[28]

C. Theobalt, M. Li, M. Magnor, and H.-P. Seidel. A flexible and versatile studio for synchronized multi-view video recording. In Proc. of Vision, Video and Graphics, pages 9--16, 2003.]]

[29]

C. Theobalt, M. Magnor, P. Schueler, and H.-P. Seidel. Combining 2D feature tracking and volume reconstruction for online video-based human motion capture. In Proc. of Pacific Graphics 2002, pages 96--103, 2002.]]

Digital Library

[30]

C. Wren, A. Azarbayejani, T. Darrell, and A. Pentland. Pfinder: Real-time tracking of the human body. PAMI, 19(7):780--785, 1997.]]

Digital Library

[31]

S. Yonemoto, D. Arita, and R. Taniguchi. Real-time human motion analysis and IK-based human figure control. In Proc. of IEEE Workshop on Human Motion, pages 149--154, 2000.]]

Digital Library

Cited By

Lv NJiang ZHuang YMeng XMeenakshisundaram GPeng J(2018)Generic Content-Based Retrieval of Marker-Based Motion Capture DataIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.270262024:6(1969-1982)Online publication date: 1-Jun-2018
https://doi.org/10.1109/TVCG.2017.2702620
Tagliasacchi ADelame TSpagnuolo MAmenta NTelea AMadeira JPatow G(2016)3D skeletonsProceedings of the 37th Annual Conference of the European Association for Computer Graphics: State of the Art Reports10.5555/3059330.3059333(573-597)Online publication date: 9-May-2016
https://dl.acm.org/doi/10.5555/3059330.3059333
Tagliasacchi ADelame TSpagnuolo MAmenta NTelea A(2016)3D Skeletons: A State‐of‐the‐Art ReportComputer Graphics Forum10.1111/cgf.1286535:2(573-597)Online publication date: 27-May-2016
https://doi.org/10.1111/cgf.12865
Show More Cited By

Index Terms

Marker-free kinematic skeleton estimation from sequences of volume data
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Animation
      1. Motion capture
      2. Motion processing
    2. Graphics systems and interfaces
      1. Virtual reality

Recommendations

Real time automatic skeleton and motion estimation for character animation
International Workshop Motion in Games (MIG08)

Motion capture is prevalent in the pipeline of realistic articulated character animation. To define accurate joint positions and joint orientations for the movement of a hierarchical human-like character without using a pre-defined skeleton remains a ...
Sketch-based skeleton-driven 2D animation and motion capture
Transactions on edutainment VI

We present a novel sketch-based 2D animation technique, which allows the user to produce 2D character animations efficiently. It consists of two parts, sketch-based skeleton-driven 2D animation production and 2D motion capture. The user inputs one image ...
Research on Skeleton Animation Motion Data Based on Kinect
ISCID '12: Proceedings of the 2012 Fifth International Symposium on Computational Intelligence and Design - Volume 02

Skeleton animation motion data is the connection of motion capture and computer skeleton animation technologies. This paper presents a method which creates standard motion data file in real time. First, get original coordinate data of human skeleton ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

VRST '04: Proceedings of the ACM symposium on Virtual reality software and technology

November 2004

226 pages

ISBN:1581139071

DOI:10.1145/1077534

Program Chairs:
Rynson W. H. Lau
City University of Hong Kong, Hong Kong
,
George Baciu
The Hong Kong Polytechnic University, Hong Kong

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 November 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

VRST04

Sponsor:

VRST04: The ACM Symposium on Virtual Reality Software and Technology 2004

November 10 - 12, 2004

Hong Kong

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
522
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lv NJiang ZHuang YMeng XMeenakshisundaram GPeng J(2018)Generic Content-Based Retrieval of Marker-Based Motion Capture DataIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.270262024:6(1969-1982)Online publication date: 1-Jun-2018
https://doi.org/10.1109/TVCG.2017.2702620
Tagliasacchi ADelame TSpagnuolo MAmenta NTelea AMadeira JPatow G(2016)3D skeletonsProceedings of the 37th Annual Conference of the European Association for Computer Graphics: State of the Art Reports10.5555/3059330.3059333(573-597)Online publication date: 9-May-2016
https://dl.acm.org/doi/10.5555/3059330.3059333
Tagliasacchi ADelame TSpagnuolo MAmenta NTelea A(2016)3D Skeletons: A State‐of‐the‐Art ReportComputer Graphics Forum10.1111/cgf.1286535:2(573-597)Online publication date: 27-May-2016
https://doi.org/10.1111/cgf.12865
Wu XXu Y(2015)A Robust Rigid Skeleton Extraction Method from Noisy Visual Hull ModelInternational Journal of Advanced Robotic Systems10.5772/5986312:4Online publication date: 1-Jan-2015
https://doi.org/10.5772/59863
Popa TGermann MZiegler RKeiser RGross M(2015)Geometry Reconstruction of Players for Novel-View Synthesis of Sports BroadcastsComputer Vision in Sports10.1007/978-3-319-09396-3_7(133-160)Online publication date: 20-Jan-2015
https://doi.org/10.1007/978-3-319-09396-3_7
Simas Gde Bem RBotelho S(2013)A 3D motion tracking method based on Nonparametric Belief Propagation2013 IEEE International Conference on Robotics and Automation10.1109/ICRA.2013.6630786(1616-1622)Online publication date: May-2013
https://doi.org/10.1109/ICRA.2013.6630786
Germann MPopa TZiegler RKeiser RGross M(2011)Space-Time Body Pose Estimation in Uncontrolled EnvironmentsProceedings of the 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission10.1109/3DIMPVT.2011.38(244-251)Online publication date: 16-May-2011
https://dl.acm.org/doi/10.1109/3DIMPVT.2011.38
Quah CGagalowicz ASeah H(2010)An Efficient and Accurate Method for Constructing 3d Human Models from Multiple CamerasThe Impact of Technology on Sport II10.1201/9781439828427.ch15Online publication date: 13-Apr-2010
https://doi.org/10.1201/9781439828427.ch15
Zheng QSharf ATagliasacchi AChen BZhang HSheffer ACohen‐Or D(2010)Consensus Skeleton for Non‐rigid Space‐time RegistrationComputer Graphics Forum10.1111/j.1467-8659.2009.01633.x29:2(635-644)Online publication date: 7-Jun-2010
https://doi.org/10.1111/j.1467-8659.2009.01633.x
He YXiao XSeah H(2009)Harmonic 1-form based skeleton extraction from examplesGraphical Models10.1016/j.gmod.2008.12.00871:2(49-62)Online publication date: 1-Mar-2009
https://dl.acm.org/doi/10.1016/j.gmod.2008.12.008
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten