More Web Proxy on the site http://driver.im/

Article

Rhythmic-motion synthesis based on motion-beat analysis

Authors:

Sung Yong ShinAuthors Info & Claims

SIGGRAPH '03: ACM SIGGRAPH 2003 Papers

Pages 392 - 401

https://doi.org/10.1145/1201775.882283

Published: 01 July 2003 Publication History

Abstract

Real-time animation of human-like characters is an active research area in computer graphics. The conventional approaches have, however, hardly dealt with the rhythmic patterns of motions, which are essential in handling rhythmic motions such as dancing and locomotive motions. In this paper, we present a novel scheme for synthesizing a new motion from unlabelled example motions while preserving their rhythmic pattern. Our scheme first captures the motion beats from the example motions to extract the basic movements and their transitions. Based on those data, our scheme then constructs a movement transition graph that represents the example motions. Given an input sound signal, our scheme finally synthesizes a novel motion in an on-line manner while traversing the motion transition graph, which is synchronized with the input sound signal and also satisfies kinematic constraints given explicitly and implicitly. Through experiments, we have demonstrated that our scheme can effectively produce a variety of rhythmic motions.

Supplementary Material

MP4 File (kim_rhythmic.mp4)

Download
40.50 MB

References

[1]

ARIKAN, O., AND FORSYTH, D. A. 2002. Interactive Motion Generation from Examples. ACM Transactions on Graphics (Proc. SIGGRAPH 2002) 21, 3 (July), 483--490.]]

Digital Library

[2]

BEZDEK, J. C. 1981. Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York.]]

[3]

BINDIGANAVALE, R., AND BADLER, N. I. 1998. Motion Abstraction and Mapping with Spatial Constraints. In Proc. International Workshop, CAPTECH '98, 70--82.]]

Digital Library

[4]

BLOM, L., AND CHAPLIN, L. T. 1982. The Intimate Act of Choreography. Pittsburgh: University of Pittsburgh Press.]]

[5]

BOTTOMER, P. 1998. Let's Dance! Black Dog & Leventhal Publishers.]]

[6]

BRAND, M., AND HERTZMANN, A. 2000. Style Machines. Computer Graphics (Proc. SIGGRAPH 2000) 34 (July), 183--192.]]

Digital Library

[7]

BRUDERLIN, A., AND WILLIAMS, L. 1995. Motion Signal Processing. Computer Graphics (Proc. SIGGRAPH '95) 29 (Aug.), 97--104.]]

Digital Library

[8]

CASSELL, J., VILHJÁLMSSON, H. H., AND BICKMORE, T. 2001. BEAT: the Behavior Expression Animation Toolkit. Computer Graphics (Proc. SIGGRAPH 2001) 35 (Aug.), 477--486.]]

Digital Library

[9]

CHIU, S. 1994. Fuzzy Model Identification Based on Cluster Estimation. Journal of Intelligent & Fuzzy Systems 2, 3 (Sept.).]]

[10]

DUBES, R., AND JAIN, A. K. 1976. Clutering Techniques: The User's Dilemma. Pattern Recognition 8, 247--260.]]

[11]

ECK, D., GASSER, M., AND PORT, R. 2000. Dynamics and Embodiment in Beat Induction. In Rhythm Perception and Production, 157--170.]]

[12]

ESSENS, P. J., AND POVEL, D. 1985. Metrical and Nonmetrical Representation of Temporal Patterns. Perception and Psychophysics 37, 1--7.]]

[13]

FOGEL, E., AND GAVISH, M. 1988. Parameter Estimation of Quasiperiodic Sequences. In IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 4, 2348--2351.]]

[14]

FORGY, E. 1965. Cluster Analysis of Multivariate Data: Efficiency vs. Interpretability of Classifications. Biometrics 21, 768.]]

[15]

GALATA, A., JOHNSON, N., AND HOGG, D. 2001. Learning Variable-Length Markov Models of Behavior. Computer Vision and Image Understanding 81, 398--413.]]

Digital Library

[16]

GLEICHER, M. 1998. Retargetting Motion to New Characters. Computer Graphics (Proc. SIGGRAPH '98) 32 (July), 33--42.]]

Digital Library

[17]

GOMES, J., AND VELHO, L. 1999. From Fourier Analysis to Wavelets. In Course Notes #5 (SIGGRAPH '99).]]

[18]

GUO, S., AND ROBERGÉ, J. 1996. A High-level Control Mechanism for Human Locomotion Based on Parametric Frame Space Interpolation. In Proc. Eurographics Workshop on Computer Animation and Simulation 96, 97--107.]]

Digital Library

[19]

HAWKINS, A. 1988. Creating through dance, revised ed. Princeton.]]

[20]

HELBING, D., AND MOLNAR, P. 1995. Social force model for pedestrian dynamics. Physical Review E 51, 4282--4286.]]

[21]

HELBING, D., FARKAS, I. J., AND T. VICSEK. 2000. Simulating dynamic features of escape panic. Nature 407, 487--490.]]

[22]

HUBER, P. J. 1981. Robust Statistics. John Wiley & Sons, New York.]]

[23]

J VAN CAMP. 1994. Copyright of Choreographic Works. 1994--1995 Entertainment, Publishing and the Arts Handbook, 59--92.]]

[24]

JONES, M. R., AND BOLTZ, M. 1989. Dynamic Attending and Responses to Time. Psychological Review 96, 3, 459--491.]]

[25]

KIM, D., KIM, H. K., AND SHIN, S. Y. 2003. An Event-driven Approach to Crowd Simulation with Example Motions. Tech. Rep. CS-TR-2002-186, Dept. Comput. Sci., KAIST, Taejon, Korea (Republic of).]]

[26]

KIM, M. J. 1996. General Schemes for Unit Quaternion Curve Construction. PhD thesis, DCS88343, Department of Computer Science, KAIST.]]

[27]

KIM, H. K. 2002. Efficient Collision Detection Among Moving Spheres with Unknown Trajectories. PhD thesis, DCS02009, Department of Computer Science, KAIST.]]

[28]

KOVAR, L., GLEICHER, M., AND PIGHIN, F. 2002. Motion Graphs. ACM Transactions on Graphics (Proc. SIGGRAPH 2002) 21, 3 (July), 473--482.]]

Digital Library

[29]

LARGE, E. W., AND KOLEN, J. F. 1994. Resonance and the Perception of Musical Meter. Connection Science 6, 2/3, 177--208.]]

[30]

LAYBOURNE, K. 1998. The Animation Book. Three Rivers Press.]]

[31]

LEE, J., AND SHIN, S. Y. 1999. A Hierarchical Approach to Interactive Motion Editing for Human-like Figures. Computer Graphics (Proc. SIGGRAPH '99) 33 (Aug.), 395--408.]]

Digital Library

[32]

LEE, J., CHAI, J., REITSMA, P. S. A., HODGINS, J. K., AND POLLARD, N. S. 2002. Interactive Control of Avatars Animated with Human Motion Data. ACM Transactions on Graphics (Proc. SIGGRAPH 2002) 21, 3 (July), 491--500.]]

Digital Library

[33]

LI, X., AND PARIZEAU, M. 2000. Training Hidden Markov Models with Multiple Observations - A Combinatorial Method. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 4 (Apr.), 371--377.]]

Digital Library

[34]

LI, Y., WANG, T., AND SHUM, H. 2002. Motion Texture: A Two-Level Statistical Model for Character Motion Synthesis. ACM Transactions on Graphics (Proc. SIGGRAPH 2002) 21, 3 (July), 465--472.]]

Digital Library

[35]

MINTON, S. C. 1997. Choreography: A Basic Approach Using Improvisation, 2nd ed. Human Kinetics.]]

[36]

PARK, S. I., SHIN, H. J., AND SHIN, S. Y. 2002. On-line Locomotion Generation Based on Motion Blending. In Proc. ACM SIGGRAPH Symposium on Computer Animation, 105--111.]]

Digital Library

[37]

PAUSCH, R., SNODDY, J., TAYLOR, R., WATSON, S., AND HASELTINE, E 1996. Disney's Aladdin: First Steps Toward Storytelling in Virtual Reality. Computer Graphics (Proc. SIGGRAPH '96) 30 (Aug.), 193--203.]]

Digital Library

[38]

POPOVIć, Z., AND WITKIN, A. 1999. Physically-based Motion Transformation. Computer Graphics (Proc. SIGGRAPH '99) 33, 11--20.]]

Digital Library

[39]

PRESS, W. H., TEUKOLSKY, S. A., VETTERLING, W. T., AND FLANNERY, B. P. 1999. Numerical Recipes in C - The Art of Scientific Computing, second ed. Cambridge University Press.]]

Digital Library

[40]

PROAKIS, J. G., AND MANOLAKIS, D. G. 1996. Digital Signal Processing: Principles, algorithms, and applications, third ed. Prentice Hall International Editions.]]

Digital Library

[41]

PULLEN, K., AND BREGLER, C. 2002. Motion Capture Assisted Animation: Texturing and Synthesis. ACM Transactions on Graphics (Proc. SIGGRAPH 2002) 21, 3 (July), 501--508.]]

Digital Library

[42]

RABINER, L. R. 1989. A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. Proc. the IEEE 77, 2 (Feb.), 257--286.]]

[43]

ROSE, C., GUENTER, B., BODENHEIMER, B., AND COHEN, M. F. 1996. Efficient Generation of Motion Transitions using Spacetime Constraints. Computer Graphics (Proc. SIGGRAPH '96) 30 (Aug.), 147--154.]]

Digital Library

[44]

ROSE, C., BODENHEIMER, B., AND COHEN, M. 1998. Verbs and Adverbs: Multidimensional Motion Interpolation. IEEE Computer Graphics and Applications 18, 5, 32--40.]]

Digital Library

[45]

SADLER, B. M., AND CASEY, S. D. 1998. On Periodic Pulse Interval Analysis with Outliers and Missing Observations. IEEE Transactions on Signal Processing 46, 11 (November), 2990--3002.]]

Digital Library

[46]

SCARBOROUGH, D., MILLER, P., AND JONES, J. A. 1992. On the perception of Meter. In M. Balaban, K. Ebcioglu, and O. Laske (Eds.) Understanding Music with AI: Perspectives in Music Cognition, Cambridge:MIT Press, 427--447.]]

Digital Library

[47]

SCHÖDL, A., SZELISKI, R., SALESIN, D. H., AND ESSA, I. 2000. Video Textures. Computer Graphics (Proc. SIGGRAPH 2000) 34 (July), 489--498.]]

Digital Library

[48]

SHIN, H. J., LEE, J., GLEICHER, M., AND SHIN, S. Y. 2001. Computer Puppetry: An Importance-Based Approach. ACM Transactions On Graphics 20.]]

Digital Library

[49]

SHOEMAKE, K. 1985. Animating Rotation with Quaternion Curves. Computer Graphics (Proc. SIGGRAPH '85) 19 (Aug.), 245--54.]]

Digital Library

[50]

SILVESTER, V. 1993. Modern Ballroom Dancing, new rev. ed. Trafalgar Square.]]

[51]

SLOAN, P., ROSE, C. F., AND COHEN, M. F. 2001. Shape by Example. In Proc. of 2001 ACM Symposium on Interactive 3D Graphics, 135--144.]]

Digital Library

[52]

TANCO, L. M., AND HILTON, A. 2000. Realistic Synthesis of Novel Human Movements from a Database of Motion Capture Examples. In Proc. the IEEE Workshop on Human Motion, 137--142.]]

Digital Library

[53]

UNUMA, M., ANJYO, K., AND TAKEUCHI, R. 1995. Fourier Principles for Emotion-based Human Figure Animation. Computer Graphics (Proc. SIGGRAPH '95) 29 (Aug.), 91--96.]]

Digital Library

[54]

WILEY, D., AND HAHN, J. K. 1997. Interpolation Synthesis of Articulated Figure Motion. IEEE Computer Graphics and Applications 17, 6, 39--45.]]

Digital Library

[55]

WITKIN, A., AND POPOVIĆ, Z. 1995. Motion Warping. Computer Graphics (Proc. SIGGRAPH '95) 29 (Aug.), 105--108.]]

Digital Library

Cited By

Le NPham TDo TTjiputra ETran QNguyen A(2023)Music-Driven Group Choreography2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00838(8673-8682)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00838
Yalta NWatanabe SNakadai KOgata T(2019)Weakly-Supervised Deep Recurrent Neural Networks for Basic Dance Step Generation2019 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN.2019.8851872(1-8)Online publication date: Jul-2019
https://doi.org/10.1109/IJCNN.2019.8851872
Zhou AHadfield-Menell DNagabandi ADragan AMutlu BTscheligi MWeiss AYoung J(2017)Expressive Robot Motion TimingProceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction10.1145/2909824.3020221(22-31)Online publication date: 6-Mar-2017
https://dl.acm.org/doi/10.1145/2909824.3020221
Show More Cited By

Index Terms

Rhythmic-motion synthesis based on motion-beat analysis
1. Social and professional topics
  1. Professional topics
    1. Computing profession
      1. Codes of ethics
    2. Management of computing and information systems
      1. Project and people management

Recommendations

Rhythmic-motion synthesis based on motion-beat analysis

Real-time animation of human-like characters is an active research area in computer graphics. The conventional approaches have, however, hardly dealt with the rhythmic patterns of motions, which are essential in handling rhythmic motions such as dancing ...
Rhythmic motion synthesis using motion thread networks
VRCAI '11: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry

Automatic approach for motion synthesis is challenging and interesting in character animations. However, previous works indicate that smoothness of transitions and connectivity of behaviours are difficult to achieve simultaneously. We propose a novel ...
Hybrid motion graph for character motion synthesis

Objective: This paper proposes a novel framework of Hybrid Motion Graph (HMG) for creating character animations, which enhances the graph-based structural control by motion field representations for efficient motion synthesis of diverse and interactive ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '03: ACM SIGGRAPH 2003 Papers

July 2003

683 pages

ISBN:1581137095

DOI:10.1145/1201775

Conference Chair:
Alyn P. Rockwood
Colorado School of Mines

Copyright © 2003 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH03

Sponsor:

SIGGRAPH

SIGGRAPH03: Special Interest Group on Computer Graphics and Interactive Techniques

July 27 - 31, 2003

California, San Diego

Acceptance Rates

SIGGRAPH '03 Paper Acceptance Rate 81 of 424 submissions, 19%;

Overall Acceptance Rate 1,631 of 7,639 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
2,401
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)2

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Le NPham TDo TTjiputra ETran QNguyen A(2023)Music-Driven Group Choreography2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00838(8673-8682)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00838
Yalta NWatanabe SNakadai KOgata T(2019)Weakly-Supervised Deep Recurrent Neural Networks for Basic Dance Step Generation2019 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN.2019.8851872(1-8)Online publication date: Jul-2019
https://doi.org/10.1109/IJCNN.2019.8851872
Zhou AHadfield-Menell DNagabandi ADragan AMutlu BTscheligi MWeiss AYoung J(2017)Expressive Robot Motion TimingProceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction10.1145/2909824.3020221(22-31)Online publication date: 6-Mar-2017
https://dl.acm.org/doi/10.1145/2909824.3020221
Choi JKim SKim CLee J(2016)Let's be a virtual jugglerComputer Animation and Virtual Worlds10.1002/cav.170127:3-4(443-450)Online publication date: 1-May-2016
https://dl.acm.org/doi/10.1002/cav.1701
Moreira RRodrigues M(2014)Animation of Articulated Figures Controlled by Inverse Kinematics with StyleProceedings of the 2014 Fifth International Conference on Intelligent Systems Design and Engineering Applications10.1109/SVR.2014.33(20-23)Online publication date: 15-Jun-2014
https://dl.acm.org/doi/10.1109/SVR.2014.33
Wenner SBazin JSorkine‐Hornung AKim CGross M(2013)Scalable Music: Automatic Music Retargeting and SynthesisComputer Graphics Forum10.1111/cgf.1205432:2pt3(345-354)Online publication date: 6-May-2013
https://doi.org/10.1111/cgf.12054
Şimşekli USönmez OKurt BCemgil A(2012)Combined perception and control for timing in robotic music performancesEURASIP Journal on Audio, Speech, and Music Processing10.1186/1687-4722-2012-82012:1Online publication date: 3-Feb-2012
https://doi.org/10.1186/1687-4722-2012-8
Xu JTakagi KSakazawa S(2011)Motion synthesis for synchronizing with streaming music by segment-based search on metadata motion graphsProceedings of the 2011 IEEE International Conference on Multimedia and Expo10.1109/ICME.2011.6011912(1-6)Online publication date: 11-Jul-2011
https://dl.acm.org/doi/10.1109/ICME.2011.6011912
Guerra-Filho GRaphael GDevarajan V(2011)A quantitative methodology to evaluate motion-based animation techniquesProceedings of the 4th international conference on Motion in Games10.1007/978-3-642-25090-3_32(377-388)Online publication date: 13-Nov-2011
https://dl.acm.org/doi/10.1007/978-3-642-25090-3_32
Soga ABoulic RThalmann D(2010)Motion Planning and Animation Variety Using Dance Motion ClipsProceedings of the 2010 International Conference on Cyberworlds10.1109/CW.2010.62(421-424)Online publication date: 20-Oct-2010
https://dl.acm.org/doi/10.1109/CW.2010.62
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents