More Web Proxy on the site http://driver.im/

Article

Free access

A video-based rendering acceleration algorithm for interactive walkthroughs

Authors:

Dinesh ManochaAuthors Info & Claims

MULTIMEDIA '00: Proceedings of the eighth ACM international conference on Multimedia

Pages 75 - 83

https://doi.org/10.1145/354384.354431

Published: 30 October 2000 Publication History

Abstract

We present a new approach for faster rendering of large synthetic environments using video-based representations. We decompose the large environment into cells and pre-compute video based impostors using MPEG compression to represent sets of objects that are far from each cell. At runtime, we decode the MPEG streams and use rendering algorithms that provide nearly constant-time random access to any frame. The resulting system has been implemented and used for an interactive walkthrough of a model of a house with 260,000 polygons and realistic lighting and textures. It is able to render this model at 16 frames per second (an eightfold improvement over simpler algorithms) on average on a Pentium II PC with an off-the-shelf graphics card.

References

[1]

J. Airey, J. Rohlf, and F. Brooks, "Towards image realism with interactive update rates in complex virtual building environments", In Proc. of ACM Symposium on Interactive 3D Graphics, 1990, pp. 41--50.

Digital Library

[2]

D. G. Aliaga, "Visualization of Complex Models Using Dynamic Texture-based Simplification", IEEE Visualization '96,October 1996.

Digital Library

[3]

D. Aliaga et al., "MMR: An integrated massive model rendering system using geometric and image-based acceleration", Proc. of ACM Symposium on Interactive 3D Graphics, April 1999.

Digital Library

[4]

J. Boyd, E. Hunter, P. Kelly, L. Tai, C. Phillips and R. Jain, "MPI-Video Infrastructure for Dynamic Environments", to appear in IEEE International Conference on Multimedia Systems 98.

Digital Library

[5]

F. Brooks. Walkthrough: A dynamic graphics system for simulating virtual buildings. In ACM Symposium on Interactive 3D Graphics, Chapel Hill, NC, 1986.

Digital Library

[6]

G. Carraro, J. Edmark and J. Ensor, "Techniques for Handling Video in Virtual Environments", Proc. of ACM SIGGRAPH, 1998, pp. 353-360.

Digital Library

[7]

S. Eric Chen and Lance Williams, "View Interpolation for Image Synthesis", In Computer Graphics (SIGGRAPH '93 Proceedings), vol. 27, J. T. Kajiya, Ed., August 1993, pp. 279--288.

Digital Library

[8]

S. Chen, "Quicktime VR: An image based approach to virtual environment navigation", Proc. of ACM SIGGRAPH, 1995.

Digital Library

[9]

J. Chim, M. Green, R. Lau, H. l.gong and A. Si, "On Caching and Prefetching of Virtual Objects in Distributed Virtual Environments", Proc. of ACM Multimedia, 1998, pp. 171- 180.

Digital Library

[10]

J. Cohen, D. Manocha, and M. Olano. "Simplifying Polygonal Models Using Successive Mappings". In Proc. of IEEE Visualization, Tampa, AZ, 1997.

Digital Library

[11]

C. Erikson and D. Manocha, "GAPS: General and Arbitrary Polygon Simplification", Proc. of ACM Symposium on Interactive 3D Graphics, 1999.

Digital Library

[12]

T. A. Funkhouser. "Database and Display Algorithms for Interactive Visualization of Architecture Model". Ph.D. thesis. CS Division, UC Berkeley, 1993.

Digital Library

[13]

M. Garland and P. Heekbert, "Surface simplification based on Quadric Error Metric", Proc. of ACM SIGGRAPH, 1997.

Digital Library

[14]

S. J. Gortler, R. Grzeszezuk, R. Szeliski, and M. F. Cohen, "The Lumigmph" In SIGGRAPH 96 Conference Proceedings, August 1996, pp. 43--54.

Digital Library

[15]

N. Greene, M. Kass, G. Miller, "Hierarchical Z-buffer visibility", Proc. of ACM SIGGRAPH 1993.

Digital Library

[16]

H. Hoppe. Progressive Meshes. In SIGGRAPH 96 Conference Proceedings: ACM SIGGRAPH, 1996, pp. 99-- 108.

Digital Library

[17]

A. Katkere, S. Moessi, D. Kuramura, P. Kelly and R. Jain, "Towards video-based immersive environments", Multimedia Systems, May 1997, pp. 69-87.

Digital Library

[18]

John Kender and B. Yeo, "Video Scene Segmentation via Continuous Video Coherence", IBM Research Report RC 21061, December 1997.

[19]

A. Lastra, Private communication, University of North Carolina at Chapel Hill, 1999.

[20]

M. Levoy and P. Hanrahan. "Light Field Rendering", in SIGGRAPH 96 Conference Proceedings, August 1996, pp. 31-42.

Digital Library

[21]

W. C. Maciel and Peter Shirley. "Visual Navigation of Large Environments Using Textured Clusters." In 1995 Symposium on Interactive 3D Graphics, April 1995, pp. 95-102.

Digital Library

[22]

B. Mannoni, "A Virtual Museum", Communications of the ACM, vol. 40, no. 9, pp. 61-62, 1997.

Digital Library

[23]

L McMillan and Gary Bishop, "Plenoptic Modeling: An Image-Based Rendering System", in SIGGRAPH 95 Conference Proceedings, August 1995, pp. 39-46.

Digital Library

[24]

G. Millersoa. The Technique of Television Production. Focal Press, Oxford, England, 1990.

[25]

MPEO-2, ISO, ISO/IEC JTCI CD 13818, Generic Coding of moving pictures and associated audio, 1994.

[26]

MPEG4 Home Page. In httpY/drogo.cselt.stet.it/mpeg.

[27]

MPEG Software Simulation Group home page, htto://www.moeg.org/MSSG.

[28]

Ketan Patel and Lawrence Rowe, "Exploiting Temporal Parallelism for Software-only Video Effects Processing", Proc. of ACM Multimedia, pp. 161-170, 1998.

Digital Library

[29]

J. Rohlf and J. Heiman, "Iris Performer: A high performance multiprocessor toolkit for realtime 3D Graphics". In Proc. of ACMSiggraph, 1994, pp. 381--394.

Digital Library

[30]

J. Shade, D. Lischinski, D. Salesin, T. DeRose, and J. Snyder, "Hierarchical Image Caching for Accelerated Walkthroughs of Complex Environments", In SIGGRAPH 96 Conference Proceedings, August 1996, pp. 75--82.

Digital Library

[31]

K. Shen and E. J. Deip, "A fast algorithm for video parsing using MPEG compressed sequences", International Conference on Image Processing, vol. II, pp. 252-255, Oct. 1995.

Digital Library

[32]

S. Teller and C. H. Sequln.-.Visibility preprocessing for interactive walkthroughs. In Proc. of ACM Siggraph, 1991, pp. 61--69.

Digital Library

[33]

X. Tu and B. L. Yeo, "Interactive .Video for E-Merchandising", Intel Internal Report, Jan. 2000. "A

[34]

Q. Wei, H. Zhang and Y. Zhong, robust approach to video segmentation using compressed data", Proceedings SPIE Storage and Retrieval for Still Images and Video Databases V, vol. SPIE 3022, pp. 448-456, Feb. 1997.

[35]

M. Yeung and B. Yeo, "Video visualization for compact presentation and fast browsing of pictorial content", IEEE Transactions on Circuits and Systems for Video Technology, vol. 7, pp. 771-785, Oct. 1997.

Digital Library

[36]

B.L. Yeo, M. M. Yeung, and V. Kuriakin. "MPEG Processing Library (MPL)", Intel Internal Report, Jan. 2000.

[37]

H. Zhang, A. Kankanhalli and S. Smoliar, "Automatic partitioning of full-motion video", Multimedia Systems, vol. 1, pp. 10-28, July 1993.

Digital Library

[38]

H. Zhang, D. Manocha, T. Hudson, and K. Hoff, "Visibility culling using hierarchical occlusion maps", In Proc. of ACM Siggraph, 1997.

Digital Library

Cited By

Chen YAygün R(2015)SpriteCamMultimedia Tools and Applications10.1007/s11042-013-1711-674:3(1067-1089)Online publication date: 1-Feb-2015
https://dl.acm.org/doi/10.1007/s11042-013-1711-6
Wong GWang J(2010)Dynamics of 3D polygonal rendering2010 IEEE Region 8 International Conference on Computational Technologies in Electrical and Electronics Engineering (SIBIRCON)10.1109/SIBIRCON.2010.5555085(766-771)Online publication date: Jul-2010
https://doi.org/10.1109/SIBIRCON.2010.5555085
Magnor M(2005)A Definition of TermsVideo-Based Rendering10.1201/b10627-11(179-180)Online publication date: 8-Aug-2005
https://doi.org/10.1201/b10627-11
Show More Cited By

Index Terms

A video-based rendering acceleration algorithm for interactive walkthroughs
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
    2. Image compression
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

Interactive rendering of realistic illumination models using wavelet-based precomputation
Interactive hair rendering under environment lighting

We present an algorithm for interactive hair rendering with both single and multiple scattering effects under complex environment lighting. The outgoing radiance due to single scattering is determined by the integral of the product of the environment ...
Interactive Ray Tracing of Large Models Using Voxel Hierarchies

We propose an efficient approach for interactive visualization of massive models with CPU ray tracing. A voxel-based hierarchical level-of-detail (LOD) framework is employed to minimize rendering time and required system memory. In a pre-processing ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MULTIMEDIA '00: Proceedings of the eighth ACM international conference on Multimedia

October 2000

523 pages

ISBN:1581131984

DOI:10.1145/354384

Chairmen:
Shahram Ghandeharizadeh
USC
,
Shih-Fu Chang
Columbia Univ., New York, NY
,
Stephen Fischer
GMD-IPSI
,
Joseph A. Konstan
Univ. of Minnesota
,
Klara Nahrstedt
Univ. of Illinois, Urbana-Champaign

Copyright © 2000 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 October 2000

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM00

Sponsor:

MM00: ACM Multimedia 2000

California, Marina del Rey, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
229
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)5

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen YAygün R(2015)SpriteCamMultimedia Tools and Applications10.1007/s11042-013-1711-674:3(1067-1089)Online publication date: 1-Feb-2015
https://dl.acm.org/doi/10.1007/s11042-013-1711-6
Wong GWang J(2010)Dynamics of 3D polygonal rendering2010 IEEE Region 8 International Conference on Computational Technologies in Electrical and Electronics Engineering (SIBIRCON)10.1109/SIBIRCON.2010.5555085(766-771)Online publication date: Jul-2010
https://doi.org/10.1109/SIBIRCON.2010.5555085
Magnor M(2005)A Definition of TermsVideo-Based Rendering10.1201/b10627-11(179-180)Online publication date: 8-Aug-2005
https://doi.org/10.1201/b10627-11
Jeschke SWimmer MSchumann HPurgathofer WLastra AOlano MLuebke DPfister H(2005)Automatic impostor placement for guaranteed frame rates and low memory requirementsProceedings of the 2005 symposium on Interactive 3D graphics and games10.1145/1053427.1053444(103-110)Online publication date: 3-Apr-2005
https://dl.acm.org/doi/10.1145/1053427.1053444
Aygun RAidong Zhang (2004)Integrating virtual camera controls into digital video2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763)10.1109/ICME.2004.1394531(1503-1506)Online publication date: 2004
https://doi.org/10.1109/ICME.2004.1394531
Gotz DMayer-Patel KManocha DRowe LMerialdo BMuhlhauser MRoss KDimitrova N(2002)IRWProceedings of the tenth ACM international conference on Multimedia10.1145/641007.641018(67-76)Online publication date: 1-Dec-2002
https://dl.acm.org/doi/10.1145/641007.641018
Nielsen F(2002)High resolution full spherical videosProceedings. International Conference on Information Technology: Coding and Computing10.1109/ITCC.2002.1000397(260-267)Online publication date: 2002
https://doi.org/10.1109/ITCC.2002.1000397
Wilson AMayer-Patel KManocha DGeorganas NPopescu-Zeletin R(2001)Spatially-encoded far-field representations for interactive walkthroughsProceedings of the ninth ACM international conference on Multimedia10.1145/500141.500193(348-357)Online publication date: 1-Oct-2001
https://dl.acm.org/doi/10.1145/500141.500193

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents