[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/1163698.1163708acmconferencesArticle/Chapter ViewAbstractPublication PagesmswimConference Proceedingsconference-collections
Article

Scheduling and buffering mechanisms for remote rendering streaming in virtual walkthrough class of applications

Published: 06 October 2006 Publication History

Abstract

With the recent advances of wireless networking and mobile devices technologies, exploration of remote 3D virtual environments has received a great deal of attention nowadays where many applications can be envisioned, such as virtual guides malls, online gaming, just to name a few. The primary objective of this paper is to present the specification of a buffering mechanism and a scheduling solution for on-time image delivery for a class of applications that is based upon a remote virtual environment exploration. Similar to a video buffering, our approach involves buffering the images closest to the user's position within the virtual environment, thereby, providing the client device with the necessary imagery data for rendering future user's viewpoints, removing network jitter, and providing smooth virtual interactionIn this paper, in order to overcome the limitations of current mobile device graphics performance, we propose to use a remote rendering approach that streams the necessary images to a client device as the user explores the virtual environment, leaving only the display and a number of minor image-based rendering tasks to the local, less powerful mobile hardware. Using ns-2, we present and extensive set of simulation experiments to evaluate the performance of our scheme. Our results indicate clearly that our solution is able to guarantee on-time delivery for approximately 40 sessions with a 10 Mbps link

References

[1]
Adelson, E. H., Bergen, J. R. The plenoptic function and the elements of early vision. Computational Models of Visual Processing, Chapter 1, Edited by Michael Landy and J. Anthony Movshon. The MIT Press, Cambridge, Mass., 1991.
[2]
Biermann, H., Hertzmann, A., Meyer, J., Perlin, K., Stateless Remote Environment Navigation with View Compression, NYU Technical Report 1999-784. April 22, 1999.
[3]
Boukerche, A., Pazzi, R. W. N. "Performance Evaluation of a Streaming Based Protocol for 3D Virtual Environment Exploration on Mobile Devices". Proceedings of the 9th ACM International Symposium MSWiM 2006.
[4]
Chang, C. and Ger, S. 2002. Enhancing 3D Graphics on Mobile Devices by Image-Based Rendering. In Proceedings of the Third IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia information Processing (December 16 - 18, 2002). Y. Chen, L. Chang, and C. Hsu, Eds. Lecture Notes In Computer Science, vol. 2532. Springer-Verlag, London, 1105--1111.
[5]
Dobbyn, S., Hamill, J., O'Conor, K., and O'Sullivan, C. 2005. Geopostors: a real-time geometry / impostor crowd rendering system. In Proceedings of the 2005 Symposium on interactive 3D Graphics and Games (Washington, District of Columbia, April 03 - 06, 2005). SI3D '05. ACM Press, New York, NY, 95--102.
[6]
Evans, W. and Kirkpatrick, D. 2004. Optimally scheduling video-on-demand to minimize delay when server and receiver bandwidth may differ. In Proceedings of the Fifteenth Annual ACM-SIAM Symposium on Discrete Algorithms (New Orleans, Louisiana, January 11-14, 2004.
[7]
Gortler, S. J., Grzeszczuk, R., Szeliski, R., Cohen, M. F. The lumigraph. In Computer Graphics Proceedings, Annual Conference Series, pages 43-54, Proc. SIGGRAPH'96 (New Orleans), August 1996.
[8]
Half Life 2 Computer Game from Valve Corporation, 2005. http://half-life2.com/
[9]
Hoppe, H.: 'Progressive Meshes'. Proc. SIGGRAPH'96, New Orleans, LA, USA, 1996, pp. 99--108.
[10]
Java Specification Request 184 (2005) - Mobile 3D Graphics API for J2ME http://www.jcp.org/en/jsr/detail?id=184
[11]
Jeschke, S., Wimmer, M., Schumann, H., and Purgathofer, W. 2005. Automatic impostor placement for guaranteed frame rates and low memory requirements. In Proceedings of the 2005 Symposium on interactive 3D Graphics and Games (Washington, District of Columbia, April 03-06, 2005). SI3D'05. ACM Press, New York, NY, 103--110.
[12]
Kircher, S. and Garland, M. 2005. Progressive multiresolution meshes for deforming surfaces. In Proceedings of the 2005 ACM Siggraph/Eurographics Symposium on Computer Animation (Los Angeles, California, July 29-31, 2005). SCA'05. ACM Press, New York, NY, 191--200.
[13]
Koller, D., Turitzin, M., Levoy, M., Tarini, M., Croccia, G., Cignoni, P., and Scopigno, R. 2004. Protected interactive 3D graphics via remote rendering. ACM Trans. Graph. 23, 3 (Aug. 2004), 695--703.
[14]
Lee, S., Whang, K., Moon, Y., and Song, I. 2001. Dynamic buffer allocation in video-on-demand systems. In Proceedings of the 2001 ACM SIGMOD international Conference on Management of Data (Santa Barbara, California, United States, May 21 - 24, 2001). T. Sellis, Ed. SIGMOD '01. ACM Press, New York, NY, 343--354.
[15]
Levoy, M., Hanrahan, P. Light field rendering. In Computer Graphics Proceedings, Annual Conference Series, pages 31--42, Proc. SIGGRAPH'96 (New Orleans), August 1996. ACM SIGGRAPH.
[16]
Li, J., Tong, Y., Wang, Y., Shum, H.-Y., Zhang, Y.-Q. "Image-based Walkthrough over the Internet", International Workshop on Very Low Bitrate Video Coding (VLBV01), October 2001, Athens, Greece.
[17]
Ma, H. and Shin, K. G. 2002. Multicast Video-on-Demand services. SIGCOMM Comput. Commun. Rev. 32, 1 (Jan. 2002), 31--43.
[18]
McMillan, L. "An Image-Based Approach to Three-Dimensional Computer Graphics", Ph.D. Thesis, Department of Computer Science, University of North Carolina at Chapel Hill, 1997.
[19]
NS-2 - The Network Simulator. Version 2.29 http://www.isi.edu/nsnam/ns/ 2006.
[20]
OpenGL - The Industry's Foundation for High Performance Graphics http://www.opengl.org/ 2006.
[21]
OpenGL Embeded System. http://www.khronos.org/opengles/ 2006.
[22]
Peng, J. and Kuo, C. J. 2005. Geometry-guided progressive lossless 3D mesh coding with octree (OT) decomposition. ACM Trans. Graph. 24, 3 (Jul. 2005), 609--616.
[23]
Reddy, A. L., Wyllie, J., and Wijayaratne, K. B. 2005. Disk scheduling in a multimedia I/O system. ACM Trans. Multimedia Comput. Commun. Appl. 1, 1 (Feb. 2005), 37--59.
[24]
Salehi, J., Li, Z., Kurose, J., Towsley, D. Supporting Stored Video: REducing Rate Variability and End-end-End Resource Requirements through Optimal Smoothing. IEEE/ACM Transactions on Networking.
[25]
Seitz, S. M., Dyer, C. M. View morphing. In Computer Graphics Proceedings, Annual Conference Series, pages 21--30, Proc. SIGGRAPH'96 (New Orleans), August 1996. ACM SIGGRAPH.
[26]
Shade, J., Lischinski, D., Salesin, D. H., DeRose, T., Snyder, J. Hierarchical image caching for accelerated walkthroughs of complex environments. In Computer Graphics Proceedings, Annual Conference Series, pages 75--82, 1996.
[27]
Szeliski, R., Shum, H.-Y. Creating full view panoramic image mosaics and environment maps. In SIGGRAPH, pages 251-258. ACM Press/Addison-Wesley Publishing Co., 1997.
[28]
Thomas, G., Point, G., Bouatouch, K. A client-server approach to image-based rendering on mobile terminals. Technical Report, ISSN 0249-6399, France, January 2005.
[29]
VRML - Virtual Reality Modelling Language - Web3D Consortium. 2006 http://www.web3d.org/
[30]
Wu, M., Ma, S., and Shu, W. Scheduled video delivery for scalable on-demand service. In Proceedings of the 12th international Workshop on Network and Operating Systems Support For Digital Audio and Video (Miami, Florida, USA, May 12 - 14, 2002).
[31]
Yang, S., Lee, C., and Kuo, C. J. 2004. Optimized mesh and texture multiplexing for progressive textured model transmission. In Proceedings of the 12th Annual ACM international Conference on Multimedia (New York, NY, USA, October 10 - 16, 2004). MULTIMEDIA '04. ACM Press, New York, NY, 676--683.
[32]
Yau, D. K. and Lam, S. S. 1997. Adaptive rate-controlled scheduling for multimedia applications. IEEE/ACM Trans. Netw. 5, 4 (Aug. 1997), 475--488.
[33]
Zhao, J., Li, B., Kok, C., and Ahmad, I. 2004. MPEG-4 Video transmission over wireless networks: a link level performance study. Wirel. Netw. 10, 2 (Mar. 2004), 133--146.

Cited By

View all
  • (2018)Scalable Remote Rendering Using Synthesized Image Quality AssessmentIEEE Access10.1109/ACCESS.2018.28531326(36595-36610)Online publication date: 2018
  • (2016)A performance evaluation of mobility management and multihop supplying partner strategies for 3D streaming systems over thin mobile devicesConcurrency and Computation: Practice & Experience10.1002/cpe.310628:6(1769-1795)Online publication date: 25-Apr-2016
  • (2013)An efficient object discovery and selection protocol in 3D streaming-based systems over thin mobile devices2013 IEEE Wireless Communications and Networking Conference (WCNC)10.1109/WCNC.2013.6554935(2393-2398)Online publication date: Apr-2013
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
WMuNeP '06: Proceedings of the 2nd ACM international workshop on Wireless multimedia networking and performance modeling
October 2006
88 pages
ISBN:1595934855
DOI:10.1145/1163698
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 October 2006

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. remote virtual walkthrough
  2. wireless multimedia

Qualifiers

  • Article

Conference

MSWiM06
Sponsor:

Acceptance Rates

WMuNeP '06 Paper Acceptance Rate 10 of 28 submissions, 36%;
Overall Acceptance Rate 36 of 90 submissions, 40%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 30 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2018)Scalable Remote Rendering Using Synthesized Image Quality AssessmentIEEE Access10.1109/ACCESS.2018.28531326(36595-36610)Online publication date: 2018
  • (2016)A performance evaluation of mobility management and multihop supplying partner strategies for 3D streaming systems over thin mobile devicesConcurrency and Computation: Practice & Experience10.1002/cpe.310628:6(1769-1795)Online publication date: 25-Apr-2016
  • (2013)An efficient object discovery and selection protocol in 3D streaming-based systems over thin mobile devices2013 IEEE Wireless Communications and Networking Conference (WCNC)10.1109/WCNC.2013.6554935(2393-2398)Online publication date: Apr-2013
  • (2012)A multihop supplying partner protocol for 3D streaming systems over thin mobile devicesProceedings of the second ACM international symposium on Design and analysis of intelligent vehicular networks and applications10.1145/2386958.2386971(81-88)Online publication date: 21-Oct-2012
  • (2011)Energy-aware analysis for supplying partner selection in mobile P2P 3D streamingProceedings of the 2011 IEEE Symposium on Computers and Communications10.1109/ISCC.2011.5984030(74-79)Online publication date: 28-Jun-2011
  • (2011)Energy management control for supplying partner selection protocol in mobile peer‐to‐peer three‐dimensional streamingConcurrency and Computation: Practice and Experience10.1002/cpe.181425:5(752-769)Online publication date: 19-Jul-2011
  • (2010)A supplying partner strategy for mobile networks-based 3D streaming - proof of concept2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW)10.1109/IPDPSW.2010.5470795(1-6)Online publication date: Apr-2010
  • (2010)Load balancing model for mobile peer-to-peer networks-based 3D streaming2010 IEEE International Symposium on Haptic Audio Visual Environments and Games10.1109/HAVE.2010.5623987(1-6)Online publication date: Oct-2010
  • (2010)MOSAIC - A Mobile Peer-to-Peer Networks-Based 3D Streaming Supplying Partner ProtocolProceedings of the 2010 IEEE/ACM 14th International Symposium on Distributed Simulation and Real Time Applications10.1109/DS-RT.2010.16(61-68)Online publication date: 17-Oct-2010
  • (2007)Prediction-based Prefetching for Remote Rendering Streaming in Mobile Virtual Environments2007 IEEE International Symposium on Signal Processing and Information Technology10.1109/ISSPIT.2007.4458059(760-765)Online publication date: Dec-2007

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media