[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Bandwidth adaptation for 3D mesh preview streaming

Published: 05 January 2014 Publication History

Abstract

Online galleries of 3D models typically provide two ways to preview a model before the model is downloaded and viewed by the user: (i) by showing a set of thumbnail images of the 3D model taken from representative views (or keyviews); (ii) by showing a video of the 3D model as viewed from a moving virtual camera along a path determined by the content provider. We propose a third approach called preview streaming for mesh-based 3D objects: by streaming and showing parts of the mesh surfaces visible along the virtual camera path. This article focuses on the preview streaming architecture and framework and presents our investigation into how such a system would best handle network congestion effectively. We present three basic methods: (a) stop-and-wait, where the camera pauses until sufficient data is buffered; (b) reduce-speed, where the camera slows down in accordance to reduce network bandwidth; and (c) reduce-quality, where the camera continues to move at the same speed but fewer vertices are sent and displayed, leading to lower mesh quality. We further propose two advanced methods: (d) keyview-aware, which trades off mesh quality and camera speed appropriately depending on how close the current view is to the keyviews, and (e) adaptive-zoom, which improves visual quality by moving the virtual camera away from the original path. A user study reveals that our keyview-aware method is preferred over the basic methods. Moreover, the adaptive-zoom scheme compares favorably to the keyview-aware method, showing that path adaptation is a viable approach to handling bandwidth variation.

References

[1]
G. Al-Regib and Y. Altunbasak. 2005. 3TP: An application-layer protocol for streaming 3D models. IEEE Trans. Multimedia 7, 6, 1149--1156.
[2]
G. Al-Regib, Y. Altunbasak, and J. Rossignac. 2005. Error-resilient transmission of 3D models. ACM Trans. Graph. 24, 2, 182--208.
[3]
C. Andújar, P. Vázquez, and M. Fairén. 2004. Way-Finder: Guided tours through complex walkthrough models. Comput. Graph. Forum 23, 3, 499--508.
[4]
P. Burelli and G. N. Yannakakis 2011. Towards adaptive virtual camera control in computer games. In Proceedings of the 11th International Symposium on Smart Graphics. Lecture Notes in Computer Science, vol. 6815, Springer, Berlin Heidelberg, 25--36.
[5]
N. Burtnyk, A. Khan, G. Fitzmaurice, and G. Kurtenbach. 2006. ShowMotion - camera motion based 3D design review. In Proceedings of the Symposium on Interactive 3D Graphics and Games (I3D'06). ACM, 167--174.
[6]
J. Chen and J. Thropp. 2007. Review of low frame rate effects on human performance. IEEE Trans. Syst., Man Cybernet. Part A: Syst. Hum. 37, 6, 1063--1076.
[7]
Z. Chen, J. F. Barnes, and B. Bodenheimer. 2005. Hybrid and forward error correction transmission techniques for unreliable transport of 3D geometry. Multimedia Syst. 10, 3, 230--244.
[8]
W. Cheng, D. Liu, and W. T. Ooi. 2009. Peer-assisted view-dependent progressive mesh streaming. In Proceedings of the 17th ACM International Conference on Multimedia (MM'09). ACM, 441--450.
[9]
W. Cheng and W. T. Ooi. 2008. Receiver-driven view-dependent streaming of progressive mesh. In Proceedings of the 18th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV'08). ACM, 9--14.
[10]
W. Cheng, W. T. Ooi, S. Mondet, R. Grigoras, and G. Morin. 2007. An analytical model for progressive mesh streaming. In Proceedings of the 15th ACM International Conference on Multimedia (MM'07). ACM, 737--746.
[11]
R. N. De Silva, W. Cheng, D. Liu, W. T. Ooi, and S. Zhao. 2009. Towards characterizing user interaction with progressively transmitted 3D meshes. In Proceedings of the 17th ACM International Conference on Multimedia (MM'09). ACM, 881--884.
[12]
R. N. De Silva, W. Cheng, W. T. Ooi, and S. Zhao. 2010. Towards understanding user tolerance to network latency and data rate in remote viewing of progressive meshes. In Proceedings of the 20th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV'10). ACM, 123--128.
[13]
H. Dutagaci, C. P. Cheung, and A. Godil. 2010. A benchmark for best view selection of 3D objects. In Proceedings of the ACM Workshop on 3D Object Retrieval (3DOR'10). ACM, 45--50.
[14]
M. Feixas, M. Sbert, and F. Gonzalez. 2009. A unified information-theoretic framework for viewpoint selection and mesh saliency. ACM Trans. App. Perception 6, 1, 1:1--1:23.
[15]
S.-R. Han, T. Yamasaki, and K. Aizawa. 2010. Automatic preview video generation for mesh sequences. In Proceedings of the 17th IEEE International Conference on Image Processing (ICIP'10). IEEE, 2945--2948.
[16]
A. F. Harris III and R. Kravets. 2002. The design of a transport protocol for on-demand graphical rendering. In Proceedings of the 12th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV'02). ACM, 43--49.
[17]
H. Hoppe. 1998. Efficient implementation of progressive meshes. Comput. Graphics 22, 1, 27--36.
[18]
T. Kamada and S. Kawai. 1988. A simple method for computing general position in displaying three-dimensional objects. Comput. Vision, Graph. Image Proces. 41, 1, 43--56.
[19]
A. Khan, B. Komalo, J. Stam, G. Fitzmaurice, and G. Kurtenbach. 2005. HoverCam: Interactive 3D navigation for proximal object inspection. In Proceedings of the Symposium on Interactive 3D Graphics and Games (I3D'05). ACM, 73--80.
[20]
H. Li, M. Li, and B. Prabhakaran. 2006. Middleware for streaming 3D progressive meshes over lossy networks. ACM Trans. Multimedia Comput. Commun. Appl. 2, 4, 282--317.
[21]
C. Lino, M. Christie, F. Lamarche, G. Schofield, and P. Olivier. 2010. A real-time cinematography system for interactive 3D environments. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA'10). Eurographics Association, 139--148.
[22]
S.-B. Park, C.-S. Kim, and S.-U. Lee. 2003. Error resilient coding of 3D meshes. In Proceedings of the IEEE International Conference on Image Processing (ICIP'03). 773--6.
[23]
S.-B. Park, C.-S. Kim, and S.-U. Lee. 2006. Error resilient 3-D mesh compression. IEEE Trans. Multimedia 8, 5, 885--895.
[24]
A. Picardi, P. Burelli, and G. N. Yannakakis. 2011. Modelling virtual camera behaviour through player gaze. In Proceeding of the International Conference on the Foundations of Digital Games (FDG'11). ACM, 107--114.
[25]
D. Plemenos and M. Benayada. 1996. Intelligent display in scene modeling: New techniques to automatically compute good views. In Proceedings of the International Conference on Computer Graphics and Vision.
[26]
R. Ranon, M. Christie, and T. Urli. 2010. Accurately measuring the satisfaction of visual properties in virtual camera control. In Proceedings of the 10th International Symposium on Smart Graphics (SG'10). Lecture Notes in Computer Science, vol. 6133, Springer-Verlag, Berlin Heidelberg, 91--102.
[27]
D. Sokolov and D. Plemenos. 2007. Virtual world explorations by using topological and semantic knowledge. Visual Comput. 24, 3, 173--185.
[28]
Z. Tang, X. Guo, and B. Prabhakaran. 2011. Receiver-based loss tolerance method for 3D progressive streaming. Multimedia Tools Appl. 51, 2, 779--799.
[29]
D. Tian and G. Al-Regib. 2006. On-demand transmission of 3D models over lossy networks. Signal Proces. Image Commun. 21, 5, 396--415.
[30]
P.-P. Vázquez. 2009. Automatic view selection through depth-based view stability analysis. Visual Comput. 25, 5--7, 441--449.
[31]
P.-P. Vázquez, M. Feixas, M. Sbert, and W. Heidrich. 2001. Viewpoint selection using viewpoint entropy. In Proceedings of the Vision, Modeling, and Visualization Conference. Aka GmbH, 273--280.
[32]
Z. Yan, S. Kumar, and C.-C. Kuo. 2001. Error-resilient coding of 3-D graphic models via adaptive mesh segmentation. IEEE Trans. Circuits Syst. Video Technol. 11, 7, 860--873.
[33]
G. N. Yannakakis, H. P. Martínez, and A. Jhala. 2010. Towards affective camera control in games. User Model. User-Adapt. Interact. 20, 4, 313--340.
[34]
S. Zhao, W. T. Ooi, A. Carlier, G. Morin, and V. Charvillat. 2013. 3D mesh preview streaming. In Proceedings of the 4th ACM Multimedia Systems Conference (MMSys'13). ACM, New York, NY, 178--189.

Cited By

View all
  • (2024)Camera Path Generation for Triangular Mesh Using Toroidal PatchesApplied Sciences10.3390/app1402049014:2(490)Online publication date: 5-Jan-2024
  • (2023)Survey of lightweighting methods of huge 3D models for online Web3D visualizationVirtual Reality & Intelligent Hardware10.1016/j.vrih.2020.02.0025:5(395-406)Online publication date: Oct-2023
  • (2017)Automatic Mesh Animation Preview With User Voting-Based RefinementIEEE Transactions on Multimedia10.1109/TMM.2016.261212419:2(327-339)Online publication date: 1-Feb-2017
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications
ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 10, Issue 1s
Special issue of best papers of ACM MMSys 2013 and ACM NOSSDAV 2013
January 2014
137 pages
ISSN:1551-6857
EISSN:1551-6865
DOI:10.1145/2576908
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 January 2014
Accepted: 01 October 2013
Revised: 01 August 2013
Received: 01 May 2013
Published in TOMM Volume 10, Issue 1s

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 3D preview
  2. Progressive mesh streaming
  3. camera path

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)10
  • Downloads (Last 6 weeks)1
Reflects downloads up to 19 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Camera Path Generation for Triangular Mesh Using Toroidal PatchesApplied Sciences10.3390/app1402049014:2(490)Online publication date: 5-Jan-2024
  • (2023)Survey of lightweighting methods of huge 3D models for online Web3D visualizationVirtual Reality & Intelligent Hardware10.1016/j.vrih.2020.02.0025:5(395-406)Online publication date: Oct-2023
  • (2017)Automatic Mesh Animation Preview With User Voting-Based RefinementIEEE Transactions on Multimedia10.1109/TMM.2016.261212419:2(327-339)Online publication date: 1-Feb-2017
  • (2017)A progressive transmission scheme for 3D models in VR/AR based on UEP-LT code2017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC)10.1109/PIMRC.2017.8292263(1-6)Online publication date: Oct-2017
  • (2016)Scalable and Adaptive Streaming of 3D Mesh to Heterogeneous Devices3D Research10.1007/s13319-016-0108-57:4(1-16)Online publication date: 1-Dec-2016
  • (2016)A hierarchical framework for large 3D mesh streaming on mobile systemsMultimedia Tools and Applications10.1007/s11042-014-2383-675:4(1983-2004)Online publication date: 1-Feb-2016
  • (2016)Modeling 3D synthetic view dissimilarityThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-015-1069-z32:4(429-443)Online publication date: 1-Apr-2016
  • (2015)Learning best views of 3D shapes from sketch contourThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-015-1091-131:6-8(765-774)Online publication date: 1-Jun-2015

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media