More Web Proxy on the site http://driver.im/

Article

Controlled animation of video sprites

Authors:

Irfan A. EssaAuthors Info & Claims

SCA '02: Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation

Pages 121 - 127

https://doi.org/10.1145/545261.545281

Published: 21 July 2002 Publication History

Abstract

We introduce a new optimization algorithm for video sprites to animate realistic-looking characters. Video sprites are animations created by rearranging recorded video frames of a moving object. Our new technique to find good frame arrangements is based on repeated partial replacements of the sequence. It allows the user to specify animations using a flexible cost function. We also show a fast technique to compute video sprite transitions and a simple algorithm to correct for perspective effects of the input footage. We use our techniques to create character animations of animals, which are difficult both to train in the real world and to animate as 3D models.

References

[1]

ARIKAN, O., AND FORSYTH, D. A. 2002. Interactive motion generation from examples. In Proceedings of SIGGRAPH 2002, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series.

Digital Library

[2]

BARJOSEPH, Z. 1999. Statistical learning of multi-dimensional textures. Master's thesis, The Hebrew University of Jerusalem.

[3]

BONET, J. S. D. 1997. Multiresolution sampling procedure for analysis and synthesis of texture images. Proceedings of SIGGRAPH 97 (August), 361-368. ISBN 0-89791-896-7. Held in Los Angeles, California.

Digital Library

[4]

BRADKSI, G., AND PISAREVSKY, V. 2000. Intel's computer vision library: Applications in calibration, stereo, segmentation, tracking, gesture, face, and object recognition. In In Proceedings of IEEE Computer Vision and Pattern Recognition Conference 2000, vol. II, II:796-797. Demonstration Paper.

[5]

BREGLER, C., AND MALIK, J. 1998. Tracking people with twists and exponential maps. In Proceedings of Computer Vision and Pattern Recognition 1998, 8-15.

Digital Library

[6]

BREGLER, C., COVELL, M., AND SLANEY, M. 1997. Video rewrite: Driving visual speech with audio. Proceedings of SIGGRAPH 97 (August), 353-360. ISBN 0-89791-896-7. Held in Los Angeles, California.

Digital Library

[7]

BUEHLER, C., BOSSE, M., MCMILLAN, L., GORTLER, S. J., AND COHEN, M. F. 2001. Unstructured lumigraph rendering. In Proceedings of SIGGRAPH 2001, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, 425-432. ISBN 1-58113-292-1.

Digital Library

[8]

CHEN, S. E. 1995. Quicktime VR-an image-based approach to virtual environment navigation. Proceedings of SIGGRAPH 95 (August), 29-38. ISBN 0-201-84776-0. Held in Los Angeles, California.

Digital Library

[9]

COHEN, M. F. 1992. Interactive spacetime control for animation. Computer Graphics (Proceedings of SIGGRAPH 92) 26, 2 (July), 293-302. ISBN 0-201-51585-7. Held in Chicago, Illinois.

Digital Library

[10]

COSATTO, E., AND GRAF, H. P. 1998. Sample-based synthesis of photo-realistic talking heads. Computer Animation '98 (June). Held in Philadelphia, Pennsylvania, USA.

Digital Library

[11]

DANA, P. 1992. Issues and techniques for keyframing transformations. In Graphics Gems III. Academic Press, Boston, 121-123. ISBN 0-12-409673-5.

Digital Library

[12]

DEBEVEC, P. E., TAYLOR, C. J., AND MALIK, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. Proceedings of SIGGRAPH 96 (August), 11-20. ISBN 0-201-94800-1. Held in New Orleans, Louisiana.

Digital Library

[13]

ESSA, I., BASU, S., DARRELL, T., AND PENTLAND, A. 1996. Modeling, tracking and interactive animation of faces and heads using input from video. In Proceedings of Computer Animation Conference 1996, IEEE Computer Society Press, 68-79.

Digital Library

[14]

FITZGIBBON, A. W. 2001. Stochastic rigidity: Image registration for nowhere-static scenes. In Proceeding of IEEE International Conference on Computer Vision 2001, I: 662-669.

[15]

GLEICHER, M. 1998. Retargeting motion to new characters. Proceedings of SIGGRAPH 98 (July), 33-42. ISBN 0-89791-999-8. Held in Orlando, Florida.

Digital Library

[16]

GORTLER, S. J., GRZESZCZUK, R., SZELISKI, R., AND COHEN, M. F. 1996. The lumigraph. Proceedings of SIGGRAPH 96 (August), 43-54. ISBN 0-201-94800-1. Held in New Orleans, Louisiana.

Digital Library

[17]

HEEGER, D. J., AND BERGEN, J. R. 1995. Pyramid-based texture analysis/synthesis. Proceedings of SIGGRAPH 95 (August), 229-238. ISBN 0-201-84776-0. Held in Los Angeles, California.

Digital Library

[18]

HODGINS, J. K., WOOTEN, W. L., BROGAN, D. C., AND O'BRIEN, J. F. 1995. Animating human athletics. Proceedings of SIGGRAPH 95 (August), 71-78. ISBN 0-201-84776-0. Held in Los Angeles, California.

Digital Library

[19]

HODGINS, J. K. 1998. Animating human motion. Scientific American 278, 3 (Mar.), 64-69 (Intl. ed. 46-51).

[20]

KAELBLING, L. P., LITTMAN, M. L., AND MOORE, A. P. 1996. Reinforcement learning: A survey. Journal of Artificial Intelligence Research 4, 237-285.

Digital Library

[21]

KOVAR, L., GLEICHER, M., AND PIGHIN, F. 2002. Motion graphs. In Proceedings of SIGGRAPH 2002, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series.

Digital Library

[22]

LASSETER, J. 1987. Principles of traditional animation applied to 3d computer animation. Computer Graphics (Proceedings of SIGGRAPH 87) 21, 4 (July), 35-44. Held in Anaheim, California.

Digital Library

[23]

LASZLO, J. F., VAN DE PANNE, M., AND FIUME, E. 1996. Limit cycle control and its application to the animation of balancing and walking. Proceedings of SIGGRAPH 96 (August), 155-162. ISBN 0-201-94800-1. Held in New Orleans, Louisiana.

Digital Library

[24]

LEE, J., CHAI, J., REITSMA, P. S. A., HODGINS, J., AND POLLARD, N. 2002. Interactive control of avatars animated with human motion data. In Proceedings of SIGGRAPH 2002, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series.

Digital Library

[25]

LEVOY, M., AND HANRAHAN, P. 1996. Light field rendering. Proceedings of SIGGRAPH 96 (August), 31-42. ISBN 0-201-94800-1. Held in New Orleans, Louisiana.

Digital Library

[26]

MCMILLAN, L.,AND BISHOP, G. 1995. Plenoptic modeling: An image-based rendering system. Proceedings of SIGGRAPH 95 (August), 39-46. ISBN 0-201-84776-0. Held in Los Angeles, California.

Digital Library

[27]

NGO, J. T., AND MARKS, J. 1993. Spacetime constraints revisited. Proceedings of SIGGRAPH 93 (August), 343-350. ISBN 0-201-58889-7. Held in Anaheim, California.

Digital Library

[28]

POPOVIC, Z., AND WITKIN, A. 1999. Physically based motion transformation. Proceedings of SIGGRAPH 99 (August), 11-20. ISBN 0-20148-560-5. Held in Los Angeles, California.

Digital Library

[29]

ROSE, C., COHEN, M. F., AND BODENHEIMER, B. 1998. Verbs and adverbs: Multidimensional motion interpolation. IEEE Computer Graphics & Applications 18, 5 (September-October), 32-40. ISSN 0272-1716.

Digital Library

[30]

SCHÖDL, A., AND ESSA, I. A. 2001. Machine learning for video-based rendering. In Advances in Neural Information Processing Systems, MIT Press, USA, T. K. Leen, T. G. Dietterich, and V. Tresp, Eds., vol. 13, 1002-1008.

[31]

SCHÖDL, A., SZELISKI, R., SALESIN, D. H., AND ESSA, I. A. 2000. Video textures. Proceedings of SIGGRAPH 2000 (July), 489-498. ISBN 1-58113-208-5.

Digital Library

[32]

SEITZ, S. M., AND DYER, C. R. 1996. View morphing: Synthesizing 3d metamorphoses using image transforms. Proceedings of SIGGRAPH 96 (August), 21-30. ISBN0-201-94800-1. Held in New Orleans, Louisiana.

Digital Library

[33]

SOATTO, S., DORETTO, G., AND WU, Y. N. 2001. Dynamic textures. In Proceeding of IEEE International Conference on Computer Vision, II: 439-446.

[34]

SZELISKI, R., AND SHUM, H.-Y. 1997. Creating full view panoramic mosaics and environment maps. Proceedings of SIGGRAPH 97 (August), 251-258. ISBN 0-89791-896-7. Held in Los Angeles, California.

Digital Library

[35]

SZUMMER, M., AND PICARD, R. W. 1996. Temporal texture modeling. In Proceeding of IEEE International Conference on Image Processing, vol. 3, 823-826.

[36]

TERZOPOULOS, D., AND WATERS, K. 1993. Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Transactions on Pattern Analysis and Machine Intelligence 15, 6, 56-579.

Digital Library

[37]

WEI, L.-Y., AND LEVOY, M. 2000. Fast texture synthesis using tree-structured vector quantization. Proceedings of SIGGRAPH 2000 (July), 479-488. ISBN 1-58113-208-5.

Digital Library

[38]

WILLIAMS, L. 1990. Performance-driven facial animation. Computer Graphics (Proceedings of SIGGRAPH 90) 24, 4 (August), 235-242. ISBN 0-201-50933-4. Held in Dallas, Texas.

Digital Library

[39]

WITKIN, A., AND KASS, M. 1988. Spacetime constraints. Computer Graphics (Proceedings of SIGGRAPH 88) 22, 4 (August), 159-168. Held in Atlanta, Georgia.

Digital Library

[40]

ZHANG, Z. 1998. A flexibe new technique for camera calibration. Tech. Rep. 98-71, Microsoft Research. www.research.microsoft.com/~zhang/Calib/.

Cited By

Le TYao SWu CLee T(2024)Regenerating Arbitrary Video Sequences With Distillation Path-FindingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323773930:7(3622-3635)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3237739
Jia SWang SLi TChern A(2023)Physical Cyclic AnimationsProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36069386:3(1-18)Online publication date: 24-Aug-2023
https://dl.acm.org/doi/10.1145/3606938
Chong TShin HAneja DIgarashi T(2023)SoundToons: Exemplar-Based Authoring of Interactive Audio-Driven Animation SpritesProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584047(710-722)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584047
Show More Cited By

Index Terms

Controlled animation of video sprites
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
  2. Computer graphics
    1. Animation

Recommendations

Layered acting for character animation

We introduce an acting-based animation system for creating and editing character animation at interactive speeds. Our system requires minimal training, typically under an hour, and is well suited for rapidly prototyping and creating expressive motion. A ...
Layered acting for character animation
SIGGRAPH '03: ACM SIGGRAPH 2003 Papers

We introduce an acting-based animation system for creating and editing character animation at interactive speeds. Our system requires minimal training, typically under an hour, and is well suited for rapidly prototyping and creating expressive motion. A ...
Music-driven character animation

Music-driven character animation extracts musical features from a song and uses them to create an animation. This article presents a system that builds a new animation directly from musical attributes, rather than simply synchronizing it to the music ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SCA '02: Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation

July 2002

203 pages

ISBN:1581135734

DOI:10.1145/545261

Conference Chairs:
Jessica Hodgins
Carnegie Mellon University
,
Michiel van de Panne
University of British Columbia
,
Program Chairs:
Michael F. Cohen
Microsoft Research
,
Nancy Pollard
Brown University

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 July 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SCA02

Sponsor:

SIGGRAPH
EUROGRAPHICS

SCA02: Symposium on Computer Animation

July 21 - 22, 2002

Texas, San Antonio

Acceptance Rates

SCA '02 Paper Acceptance Rate 22 of 53 submissions, 42%;

Overall Acceptance Rate 183 of 487 submissions, 38%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

94
Total Citations
View Citations
1,344
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)1

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Le TYao SWu CLee T(2024)Regenerating Arbitrary Video Sequences With Distillation Path-FindingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323773930:7(3622-3635)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3237739
Jia SWang SLi TChern A(2023)Physical Cyclic AnimationsProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36069386:3(1-18)Online publication date: 24-Aug-2023
https://dl.acm.org/doi/10.1145/3606938
Chong TShin HAneja DIgarashi T(2023)SoundToons: Exemplar-Based Authoring of Interactive Audio-Driven Animation SpritesProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584047(710-722)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584047
Narasimhan MGinosar SOwens AEfros ADarrell T(2022)Strumming to the Beat: Audio-Conditioned Contrastive Video Textures2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV51458.2022.00058(507-516)Online publication date: Jan-2022
https://doi.org/10.1109/WACV51458.2022.00058
Kania KMoo Yi KKowalski MTrzciniski TTagliasacchi A(2022)CoNeRF: Controllable Neural Radiance Fields2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52688.2022.01807(18602-18611)Online publication date: Jun-2022
https://doi.org/10.1109/CVPR52688.2022.01807
Morace CLe TYao SZhang SLee T(2022)Learning a perceptual manifold with deep features for animation video resequencingMultimedia Tools and Applications10.1007/s11042-022-12251-181:17(23687-23707)Online publication date: 18-Mar-2022
https://doi.org/10.1007/s11042-022-12251-1
Wei DXu XShen HHuang K(2021)GAC-GAN: A General Method for Appearance-Controllable Human Video Motion TransferIEEE Transactions on Multimedia10.1109/TMM.2020.301129023(2457-2470)Online publication date: 2021
https://doi.org/10.1109/TMM.2020.3011290
Liu LXu WZollhöfer MKim HBernard FHabermann MWang WTheobalt C(2019)Neural Rendering and Reenactment of Human Actor VideosACM Transactions on Graphics10.1145/333300238:5(1-14)Online publication date: 25-Oct-2019
https://dl.acm.org/doi/10.1145/3333002
Aberman KShi MLiao JLischinski DChen BCohen‐Or D(2019)Deep Video‐Based Performance CloningComputer Graphics Forum10.1111/cgf.1363238:2(219-233)Online publication date: 7-Jun-2019
https://doi.org/10.1111/cgf.13632
Ilisescu CKanaci HRomagnoli MCampbell NBrostow GMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Responsive Action-based Video SynthesisProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025880(6569-6580)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025880
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents