More Web Proxy on the site http://driver.im/

research-article

3D mesh preview streaming

Authors:

Shanghong Zhao,

Geraldine Morin,

Vincent CharvillatAuthors Info & Claims

MMSys '13: Proceedings of the 4th ACM Multimedia Systems Conference

Pages 178 - 189

https://doi.org/10.1145/2483977.2484001

Published: 28 February 2013 Publication History

Abstract

Publishers of 3D models online typically provide two ways to preview a model before the model is downloaded and viewed by the user: (i) by showing a set of thumbnail images of the 3D model taken from representative views (or keyviews); (ii) by showing a video of the 3D model as viewed from a moving virtual camera along a path determined by the content provider. We propose a third approach called preview streaming for mesh-based 3D object: by streaming and showing parts of the mesh surfaces visible along the virtual camera path. This paper focuses on the preview streaming architecture and framework, and presents our investigation into how such a system would best handle network congestion effectively. We study three basic methods: (a) stop-and-wait, where the camera pauses until sufficient data is buffered; (b) reduce-speed, where the camera slows down in accordance to reduce network bandwidth; and (c) reduce-quality, where the camera continues to move at the same speed but fewer vertices are sent and displayed, leading to lower mesh quality. We further propose a keyview-aware method that trades off mesh quality and camera speed appropriately depending on how close the current view is to the keyviews. A user study reveals that our keyview-aware method is preferred over the basic methods.

References

[1]

G. Al-Regib and Y. Altunbasak. 3TP: An application-layer protocol for streaming 3D models. IEEE Transactions on Multimedia, 7(6):1149--1156, December 2005.

Digital Library

[2]

G. Al-Regib, Y. Altunbasak, and J. Rossignac. Error-resilient transmission of 3D models. ACM Transactions on Graphics, 24(2):182--208, 2005.

Digital Library

[3]

C. Andújar, P. Vázquez, and M. Fairén. Way-Finder: guided tours through complex walkthrough models. Computer Graphics Forum, 23(3):499--508, 2004.

[4]

P. Burelli and G. N. Yannakakis. Towards adaptive virtual camera control in computer games. In Proceedings of the 11th International Symposium on Smart Graphics, pages 25--36, Bremen, Germany, 2011.

Digital Library

[5]

N. Burtnyk, A. Khan, G. Fitzmaurice, and G. Kurtenbach. ShowMotion - camera motion based 3D design review. In Proceedings of the 2006 Symposium on Interactive 3D Graphics and Games, pages 167--174, 2006.

Digital Library

[6]

J. K. C. Yuksel, S. Schaefer. Parameterization and applications of Catmull-Rom curves. Computer Aided Design, 43:747--755, 2011.

Digital Library

[7]

Z. Chen, J. F. Barnes, and B. Bodenheimer. Hybrid and forward error correction transmission techniques for unreliable transport of 3D geometry. Multimedia Systems, 10(3):230--244, March 2005.

Digital Library

[8]

W. Cheng, D. Liu, and W. T. Ooi. Peer-assisted view-dependent progressive mesh streaming. In Proceedings of the 17th ACM International Conference on Multimedia, MM '09, pages 441--450, Beijing, China, 2009.

Digital Library

[9]

W. Cheng and W. T. Ooi. Receiver-driven view-dependent streaming of progressive mesh. In Proceedings of the 18th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV '08, Brauschweig, Germany, May 2008.

Digital Library

[10]

W. Cheng, W. T. Ooi, S. Mondet, R. Grigoras, and G. Morin. An analytical model for progressive mesh streaming. In Proceedings of the 15th ACM International Conference on Multimedia, MM '07, pages 737--746, Augsberg, Germany, September 2007.

Digital Library

[11]

R. N. De Silva, W. Cheng, D. Liu, W. T. Ooi, and S. Zhao. Towards characterizing user interaction with progressively transmitted 3D meshes. In Proceedings of the 17th ACM International Conference on Multimedia, MM '09, pages 881--884, Beijing, China, 2009.

Digital Library

[12]

R. N. De Silva, W. Cheng, W. T. Ooi, and S. Zhao. Towards understanding user tolerance to network latency and data rate in remote viewing of progressive meshes. In Proceedings of the 20th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV '10, pages 123--128, Amsterdam, The Netherlands, 2010.

Digital Library

[13]

H. Dutagaci, C. P. Cheung, and A. Godil. A benchmark for best view selection of 3D objects. In Proceedings of the ACM Workshop on 3D Object Retrieval, 3DOR '10, 2010.

Digital Library

[14]

M. Feixas, M. Sbert, and F. Gonzalez. A unified information-theoretic framework for viewpoint selection and mesh saliency. ACM Transactions on Applied Perception (TAP), 6(1), Feb. 2009.

Digital Library

[15]

S.-R. Han, T. Yamasaki, and K. Aizawa. Automatic preview video generation for mesh sequences. In Proceedings of the 17th IEEE International Conference on Image Processing, ICIP '10, pages 2945--2948, Sept. 2010.

[16]

A. F. Harris (III) and R. Kravets. The design of a transport protocol for on-demand graphical rendering. In Proceedings of the 12th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV '02, pages 43--49, Miami, FL, May 2002.

Digital Library

[17]

H. Hoppe. Efficient implementation of progressive meshes. Computers Graphics, 22(1):27--36, January-February 1998.

[18]

T. Kamada and S. Kawai. A simple method for computing general position in displaying three-dimensional objects. Computer Vision, Graphics and Image Processing, 41(1), Jan. 1988.

Digital Library

[19]

A. Khan, B. Komalo, J. Stam, G. Fitzmaurice, and G. Kurtenbach. HoverCam: Interactive 3D navigation for proximal object inspection. In Proceedings of the 2005 Symposium on Interactive 3D Graphics and Games, volume 1, pages 73--80, Washington, DC, 2005.

Digital Library

[20]

H. Li, M. Li, and B. Prabhakaran. Middleware for streaming 3D progressive meshes over lossy networks. ACM Transactions on Multimedia Computing, Communications, and Applications, 2(4):282--317, 2006.

Digital Library

[21]

C. Lino, M. Christie, F. Lamarche, G. Schofield, and P. Olivier. A real-time cinematography system for interactive 3D environments. In Proceedings of the 2010 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pages 139--148, 2010.

Digital Library

[22]

S.-B. Park, C.-S. Kim, and S.-U. Lee. Error resilient coding of 3D meshes. In Proceedings of IEEE International Conference on Image Processing, volume 1 of ICIP '03, pages I-773--6, 2003.

[23]

S.-B. Park, C.-S. Kim, and S.-U. Lee. Error resilient 3-D mesh compression. IEEE Transactions on Multimedia, 8(5):885--895, October 2006.

Digital Library

[24]

A. Picardi, P. Burelli, and G. N. Yannakakis. Modelling virtual camera behaviour through player gaze. In International Conference On The Foundations Of Digital Games, Bordeux, France, June 2011.

Digital Library

[25]

D. Plemenos and M. Benayada. Intelligent display in scene modeling. new techniques to automatically compute good views. In Proceedings of the International Conference on Computer Graphics & Vision, 1996.

[26]

R. Ranon, M. Christie, and T. Urli. Accurately measuring the satisfaction of visual properties in virtual camera control. In Proceedings of the 10th International Symposium on Smart Graphics, pages 91--102, Banff, Canada, June 2010.

Digital Library

[27]

D. J. Rosenkrantz, R. E. Stearns, and P. M. Lewis II. An analysis of several heuristics for the traveling salesman problem. SIAM journal on Computing, 6(3):564--581, 1977.

[28]

D. Sokolov and D. Plemenos. Virtual world explorations by using topological and semantic knowledge. The Visual Computer, 24(3):173--185, Nov. 2007.

Digital Library

[29]

Z. Tang, X. Guo, and B. Prabhakaran. Receiver-based loss tolerance method for 3D progressive streaming. Multimedia Tools and Applications, 51:779--799, 2011.

Digital Library

[30]

D. Tian and G. AlRegib. On-demand transmission of 3D models over lossy networks. EURASIP Journal on Signal Processing: Image Communication, 21(5), June 2006.

[31]

P.-P. Vázquez. Automatic view selection through depth-based view stability analysis. The Visual Computer, 25(5-7):441--449, Mar. 2009.

Digital Library

[32]

P.-P. Vázquez, M. Feixas, M. Sbert, and W. Heidrich. Viewpoint selection using viewpoint entropy. In Proceedings of the Vision, Modeling, and Visualization Conference, pages 273--280, Stuttgart, Germany, 2001.

Digital Library

[33]

I. Viola, M. Feixas, M. Sbert, and M. E. Gröller. Importance-driven focus of attention. IEEE Transactions on Visualization and Computer Graphics, 12(5):933--40, 2006.

Digital Library

[34]

Z. Yan, S. Kumar, and C.-C. Kuo. Error-resilient coding of 3-D graphic models via adaptive mesh segmentation. IEEE Transactions on Circuits and Systems for Video Technology, 11(7):860--873, July 2001.

Digital Library

[35]

G. N. Yannakakis, H. P. Martínez, and A. Jhala. Towards affective camera control in games. User Modeling and User-Adapted Interaction, 20(4):313--340, 2010.

Digital Library

Cited By

Zhou WJia JSu X(2018)A Novel Compression-Driven Lightweight Framework for Medical Skeleton Model VisualizationIEEE Access10.1109/ACCESS.2018.28665086(47627-47635)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2866508
Huang CZhou WLan YChen FHao YCheng YPeng Y(2018)A Novel WebVR-Based Lightweight Framework for Virtual Visualization of Blood VasculumIEEE Access10.1109/ACCESS.2018.28404946(27726-27735)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2840494
Zhao SOoi W(2018)Modeling 3D synthetic view dissimilarityThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-015-1069-z32:4(429-443)Online publication date: 28-Dec-2018
https://dl.acm.org/doi/10.1007/s00371-015-1069-z
Show More Cited By

Index Terms

3D mesh preview streaming
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Bandwidth adaptation for 3D mesh preview streaming
Special issue of best papers of ACM MMSys 2013 and ACM NOSSDAV 2013

Online galleries of 3D models typically provide two ways to preview a model before the model is downloaded and viewed by the user: (i) by showing a set of thumbnail images of the 3D model taken from representative views (or keyviews); (ii) by showing a ...
Streaming tetrahedral mesh optimization
SPM '08: Proceedings of the 2008 ACM symposium on Solid and physical modeling

Improving the quality of tetrahedral meshes is an important operation in many scientific computing applications. Meshes with badly shaped elements impact both the accuracy and convergence of scientific applications. State-of-the-art mesh improvement ...
The Virtual Camera Path in 3D Animation
Intelligent Computing Theories and Application
Abstract
Unlike real-world filmmaking, the camera track in 3D animated films is more complicated. The location and shooting angle of the virtual camera need to be more accurately computed to achieve the correct delivery of information to the audience. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MMSys '13: Proceedings of the 4th ACM Multimedia Systems Conference

February 2013

304 pages

ISBN:9781450318945

DOI:10.1145/2483977

General Chair:
Carsten Griwodz
Simula Research Laboratory & University of Oslo, Norway

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 February 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MMSys '13

Sponsor:

MMSys '13: Multimedia Systems Conference 2013

February 28 - March 1, 2013

Oslo, Norway

Acceptance Rates

MMSys '13 Paper Acceptance Rate 15 of 63 submissions, 24%;

Overall Acceptance Rate 176 of 530 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
210
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhou WJia JSu X(2018)A Novel Compression-Driven Lightweight Framework for Medical Skeleton Model VisualizationIEEE Access10.1109/ACCESS.2018.28665086(47627-47635)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2866508
Huang CZhou WLan YChen FHao YCheng YPeng Y(2018)A Novel WebVR-Based Lightweight Framework for Virtual Visualization of Blood VasculumIEEE Access10.1109/ACCESS.2018.28404946(27726-27735)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2840494
Zhao SOoi W(2018)Modeling 3D synthetic view dissimilarityThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-015-1069-z32:4(429-443)Online publication date: 28-Dec-2018
https://dl.acm.org/doi/10.1007/s00371-015-1069-z
Zhou ZJiang NChen KZhang J(2017)Automatic Mesh Animation Preview With User Voting-Based RefinementIEEE Transactions on Multimedia10.1109/TMM.2016.261212419:2(327-339)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1109/TMM.2016.2612124
Zhu MMorin GCharvillat VOoi W(2017)Sprite treeThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-016-1286-033:11(1385-1402)Online publication date: 1-Nov-2017
https://dl.acm.org/doi/10.1007/s00371-016-1286-0
Zhao SOoi WCarlier AMorin GCharvillat V(2014)Bandwidth adaptation for 3D mesh preview streamingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/253785410:1s(1-20)Online publication date: 5-Jan-2014
https://dl.acm.org/doi/10.1145/2537854
Li YCui QDou FZhang LZhou Z(2014)Automatic mesh animation preview2014 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME.2014.6890271(1-6)Online publication date: Jul-2014
https://doi.org/10.1109/ICME.2014.6890271

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents