More Web Proxy on the site http://driver.im/

research-article

Video Textures

Authors:

Richard Szeliski,

David H. Salesin,

Irfan EssaAuthors Info & Claims

Seminal Graphics Papers: Pushing the Boundaries, Volume 2

August 2023

Article No.: 57, Pages 557 - 570

https://doi.org/10.1145/3596711.3596769

Published: 02 August 2023 Publication History

Editorial Notes

This paper was originally published as https://doi.org/10.1145/344779.345012.

Abstract

This paper introduces a new type of medium, called a video texture, which has qualities somewhere between those of a photograph and a video. A video texture provides a continuous infinitely varying stream of images. While the individual frames of a video texture may be repeated from time to time, the video sequence as a whole is never repeated exactly.Video textures can be used in place of digital photos to infuse a static image with dynamic qualities and explicit action. We present techniques for analyzing a video clip to extract its structure, and for synthesizing a new, similar looking video of arbitrary length. We combine video textures with view morphing techniques to obtain 3D video textures. We also introduce videobased animation, in which the synthesis of video textures can be guided by a user through high-level interactive controls. Applications of video textures and their extensions include the display of dynamic scenes on web pages, the creation of dynamic backdrops for special effects and games, and the interactive control of video-based animation.

References

[1]

Z. Bar-Joseph. Statistical learning of multi-dimensional textures. Master's thesis, The Hebrew University of Jerusalem, June 1999.

[2]

D. Beymer. Feature correspondence by interleaving shape and texture computations. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'96), pages 921--928, San Francisco, California, June 1996.

Digital Library

[3]

C. Bregler, M. Covell, and M. Slaney. Video rewrite: Driving visual speech with audio. Computer Graphics (SIGGRAPH'97), pages 353--360, August 1997.

[4]

P. J. Burt and E. H. Adelson. A multiresolution spline with applications to image mosaics. ACM Transactions on Graphics, 2(4):217--236, October 1983.

Digital Library

[5]

S. E. Chen. QuickTime VR -- an image-based approach to virtual environment navigation. Computer Graphics (SIGGRAPH'95), pages 29--38, August 1995.

[6]

J. De Bonet. Multiresolution sampling procedure for analysis and synthesis of texture images. Computer Graphics (SIGGRAPH'97), pages 361--368, August 1997.

[7]

P. Debevec et al., editors. Image-Based Modeling, Rendering, and Lighting, SIGGRAPH'99 Course 39, August 1999.

[8]

P. E. Debevec, C. J. Taylor, and J. Malik. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. Computer Graphics (SIGGRAPH'96), pages 11--20, August 1996

[9]

A. A. Efros and T. K. Leung. Texture synthesis by nonparametric sampling. In Seventh International Conference on Computer Vision (ICCV'99), pages 1033--1038, Kerkyra, Greece, September 1999.

Digital Library

[10]

A. Finkelstein, C. E. Jacobs, and D. H. Salesin. Multiresolution video. Proceedings of SIGGRAPH 96, pages 281--290, August 1996. ISBN 0--201--94800--1. Held in New Orleans, Louisiana.

Digital Library

[11]

W. T. Freeman, E. H. Adelson, and D. J. Heeger. Motion without movement. Computer Graphics (Proceedings of SIGGRAPH 91), 25(4):27--30, July 1991.

Digital Library

[12]

D. J. Heeger and J. R. Bergen. Pyramid-based texture analysis/synthesis. Proceedings of SIGGRAPH 95, pages 229--238, August 1995.

Digital Library

[13]

Workshop on Image-Based Modeling and Rendering, Stanford University, March 1998. http://graphics.stanford.edu/workshops/ibr98/.

[14]

C. E. Jacobs, A. Finkelstein, and D. H. Salesin. Fast multiresolution image querying. Proceedings of SIGGRAPH 95, pages 277--286, August 1995.

Digital Library

[15]

L. P. Kaelbling, M. L. Littman, and A. W. Moore. Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4, 1996.

Digital Library

[16]

T. Kanade, P. W. Rander, and P. J. Narayanan. Virtualized reality: constructing virtual worlds from real scenes. IEEE MultiMedia Magazine, 1(1):34--47, Jan-March 1997.

[17]

M. Levoy and P. Hanrahan. Light field rendering. In Computer Graphics Proceedings, Annual Conference Series, pages 31-- 42, Proc. SIGGRAPH'96 (New Orleans), August 1996. ACM SIGGRAPH.

Digital Library

[18]

L. McMillan and G. Bishop. Plenoptic modeling: An image-based rendering system. Computer Graphics (SIGGRAPH'95), pages 39--46, August 1995.

[19]

S. Moezzi et al. Reality modeling and visualization from multiple video sequences. IEEE Computer Graphics and Applications, 16(6):58--63, November 1996.

Digital Library

[20]

S. A. Niyogi and E. H. Adelson. Analyzing and recognizing walking figures in xyt. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'94), pages 469--474, Seattle, Washington, June 1994.

[21]

F. Pighin, J. Hecker, D. Lischinski, D. H. Salesin, and R. Szeliski. Synthesizing realistic facial expressions from photographs. In Computer Graphics (SIGGRAPH'98) Proceedings, pages 75--84, Orlando, July 1998. ACM SIGGRAPH.

[22]

R. Polana and R. C. Nelson. Detection and recognition of periodic, nonrigid motion. International Journal of Computer Vision, 23(3):261--282, 1997.

Digital Library

[23]

S. Pollard et al. View synthesis by trinocular edge matching and transfer. In British MachineVision Conference (BMVC98), Southampton, England, September 1998.

[24]

S. M. Seitz and C. M. Dyer. View morphing. In Computer Graphics Proceedings, Annual Conference Series, pages 21-- 30, Proc. SIGGRAPH'96 (New Orleans), August 1996. ACM SIGGRAPH.

Digital Library

[25]

S. M. Seitz and C. R. Dyer. View invariant analysis of cyclic motion. International Journal of Computer Vision, 25(3):231-- 251, December 1997.

Digital Library

[26]

J. Shade, S. Gortler, L.-W. He, and R. Szeliski. Layered depth images. In Computer Graphics (SIGGRAPH'98) Proceedings, pages 231--242, Orlando, July 1998. ACM SIGGRAPH.

[27]

J. Shade, D. Lischinski, D. Salesin, T. DeRose, and J. Snyder. Hierarchical images caching for accelerated walkthroughs of complex environments. In Computer Graphics (SIGGRAPH'96) Proceedings, pages 75--82, Proc. SIGGRAPH'96 (New Orleans), August 1996. ACM SIGGRAPH.

Digital Library

[28]

B. Shaw. Light of other days. In Other Days, Other Eyes. Ace Books, NewYork, 1972. (also published in Analog and various sci-fi anthologies).

[29]

H.-Y. Shum and R. Szeliski. Construction of panoramic mosaics with global and local alignment. International Journal of Computer Vision, 36(2):101--130, February 2000.

Digital Library

[30]

A. R. Smith and J. F. Blinn. Blue screen matting. In Computer Graphics Proceedings, Annual Conference Series, pages 259-- 268, Proc. SIGGRAPH'96 (New Orleans),August 1996.ACM SIGGRAPH.

Digital Library

[31]

R. Szeliski and H.-Y. Shum. Creating full view panoramic image mosaics and texture-mapped models. In Computer Graphics (SIGGRAPH'97) Proceedings, pages 251--258, Los Angeles, August 1997. ACM SIGGRAPH.

[32]

J. Torborg and J. T. Kajiya. Talisman: Commodity realtime 3D graphics for the PC. In Computer Graphics Proceedings, Annual Conference Series, pages 353--363, Proc. SIGGRAPH'96 (New Orleans), August 1996. ACM SIGGRAPH.

Digital Library

Cited By

Li JCheng LWang ZMu THe JCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)LoopGaussian: Creating 3D Cinemagraph with Multi-view Images via Eulerian Motion FieldProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681025(476-485)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681025
Fan SPiao JQian CLi HLin K(2023)Simulating Fluids in Real-World Still Images2023 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV51070.2023.01459(15876-15885)Online publication date: 1-Oct-2023
https://doi.org/10.1109/ICCV51070.2023.01459
Le TYao SWu CLee T(2024)Regenerating Arbitrary Video Sequences With Distillation Path-FindingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323773930:7(3622-3635)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3237739
Show More Cited By

Recommendations

Video textures
SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques

This paper introduces a new type of medium, called a video texture, which has qualities somewhere between those of a photograph and a video. A video texture provides a continuous infinitely varying stream of images. While the individual frames of a ...
Animating pictures with stochastic motion textures
SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

In this paper, we explore the problem of enhancing still pictures with subtly animated motions. We limit our domain to scenes containing passive elements that respond to natural forces in some fashion. We use a semi-automatic approach, in which a human ...
A fast relighting engine for interactive cinematic lighting design
SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques

We present new techniques for interactive cinematic lighting design of complex scenes that use procedural shaders. Deep-framebuffers are used to store the geometric and optical information of the visible surfaces of an image. The geometric information ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Overlay Books

Seminal Graphics Papers: Pushing the Boundaries, Volume 2

August 2023

893 pages

ISBN:9798400708978

DOI:10.1145/3596711

Editor:
Mary C. Whitton
Department of Computer Science, UNC Chapel Hill, USA

SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques
July 2000
547 pages
ISBN:1581132085
Chairmen:
Judith R. Brown
Coralville, IA
,
Kurt Akeley

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 August 2023

Permissions

Request permissions for this article.

Request Permissions

Badges

Seminal Paper

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

441
Total Citations
View Citations
4,358
Total Downloads

Downloads (Last 12 months)404
Downloads (Last 6 weeks)53

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li JCheng LWang ZMu THe JCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)LoopGaussian: Creating 3D Cinemagraph with Multi-view Images via Eulerian Motion FieldProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681025(476-485)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681025
Fan SPiao JQian CLi HLin K(2023)Simulating Fluids in Real-World Still Images2023 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV51070.2023.01459(15876-15885)Online publication date: 1-Oct-2023
https://doi.org/10.1109/ICCV51070.2023.01459
Le TYao SWu CLee T(2024)Regenerating Arbitrary Video Sequences With Distillation Path-FindingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323773930:7(3622-3635)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3237739
Bai YGeng XMangalam KBar AYuille ADarrell TMalik JEfros A(2024)Sequential Modeling Enables Scalable Learning for Large Vision Models2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.02157(22861-22872)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.02157
Liu SRen ZGupta SWang S(2024)PhysGen: Rigid-Body Physics-Grounded Image-to-Video GenerationComputer Vision – ECCV 202410.1007/978-3-031-73007-8_21(360-378)Online publication date: 1-Oct-2024
https://doi.org/10.1007/978-3-031-73007-8_21
Mahapatra ASiarohin ALee HTulyakov SZhu J(2023)Text-Guided Synthesis of Eulerian CinemagraphsACM Transactions on Graphics10.1145/361832642:6(1-13)Online publication date: 5-Dec-2023
https://dl.acm.org/doi/10.1145/3618326
Cho HKomar MLindlbauer D(2023)RealityReplayProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108887:3(1-25)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610888
Jia SWang SLi TChern A(2023)Physical Cyclic AnimationsProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36069386:3(1-18)Online publication date: 24-Aug-2023
https://doi.org/10.1145/3606938
Kovar LGleicher MPighin F(2023)Motion GraphsSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596788(723-732)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3596711.3596788
Kwatra VSchödl AEssa ITurk GBobick A(2023)Graphcut Textures: Image and Video Synthesis Using Graph CutsSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596773(583-592)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3596711.3596773
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents