[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3611314.3615907acmconferencesArticle/Chapter ViewAbstractPublication Pagesweb3dConference Proceedingsconference-collections
research-article

Progressive Network Streaming of Textured Meshes in the Binary glTF 2.0 Format

Published: 09 October 2023 Publication History

Abstract

The glTF 2.0 graphics format allows for the API-neutral representation of 3D scenes consisting of one or multiple textured meshes. It is currently adopted as one of two file formats for 3D asset interoperability by the Metaverse Standards Forum. glTF 2.0 has however not been designed to be streamable over the network; instead, glTF 2.0 files typically first need to be downloaded fully before their contents can be rendered locally. This can lead to high start-up delays which in turn can lead to user frustration. This paper therefore contributes a methodology and associated Web-based client, implemented in JavaScript on top of the three.js rendering engine, that allows to stream glTF 2.0 files from a content server to the consuming client up to the level of individual glTF bufferviews. This in turn facilitates the progressive client-side rendering of 3D scenes, meaning that scene rendering can already commence while the glTF file is still being downloaded. The proposed methodology is conceptually compliant with the HTTP Adaptive Streaming (HAS) paradigm that dominates the contemporary market of over-the-top video streaming. Experimental results show that our methodology is most beneficial when network throughput is limited (e.g., 20Mbps). In all, our work represents an important step towards making 3D content faster accessible to consuming (Web) clients, akin to the way platforms like YouTube have brought universal accessibility for video content.

References

[1]
Wei Cheng and Wei Tsang Ooi. 2008. Receiver-Driven View-Dependent Streaming of Progressive Mesh. In Proceedings of the 18th International Workshop on Network and Operating Systems Support for Digital Audio and Video (Braunschweig, Germany) (NOSSDAV ’08). Association for Computing Machinery, New York, NY, USA, 9–14. https://doi.org/10.1145/1496046.1496049
[2]
Wei Cheng, Wei Tsang Ooi, Sebastien Mondet, Romulus Grigoras, and Géraldine Morin. 2007. An Analytical Model for Progressive Mesh Streaming. In Proceedings of the 15th ACM International Conference on Multimedia (Augsburg, Germany) (MM ’07). Association for Computing Machinery, New York, NY, USA, 737–746. https://doi.org/10.1145/1291233.1291399
[3]
Jaspreet Singh Dhanjan and Anthony Steed. 2021. Revisiting the Scene-Graph-as-Bus Concept: Inter-networking Heterogeneous Applications Using glTF Fragments. In Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops(VRW ’21). 342–346. https://doi.org/10.1109/VRW52623.2021.00068
[4]
Jean-Philippe Farrugia, Luc Billaud, and Guillaume Lavoué. 2023. Adaptive streaming of 3D content for web-based virtual reality: an open-source prototype including several metrics and strategies. In Proceedings of ACM Multimedia Systems Conference(MMSys ’23).
[5]
Thomas Forgione, Axel Carlier, Géraldine Morin, Wei Tsang Ooi, Vincent Charvillat, and Praveen Kumar Yadav. 2018. DASH for 3D Networked Virtual Environment. In Proceedings of the 26th ACM International Conference on Multimedia (Seoul, Republic of Korea) (MM ’18). Association for Computing Machinery, New York, NY, USA, 1910–1918. https://doi.org/10.1145/3240508.3240701
[6]
Metaverse Standards Forum. 2023. 3D Asset Interoperability using USD and glTF Domain Working Group Charter. Retrieved May 25, 2023 from https://portal.metaverse-standards.org/document/dl/5326
[7]
Hugues Hoppe. 1996. Progressive Meshes. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’96). Association for Computing Machinery, New York, NY, USA, 99–108. https://doi.org/10.1145/237170.237216
[8]
ISO/IEC 23009-1. 2019. Information technology – Dynamic adaptive streaming over HTTP (DASH) – Part 1: Media presentation description and segment formats.
[9]
Khronos Group 3D Formats Working Group. 2021. glTF 2.0 Specification. https://registry.khronos.org/glTF/specs/2.0/glTF-2.0.html. Version 2.0.1, 2021-10-11 23:01:57Z.
[10]
Guillaume Lavoué, Laurent Chevalier, and Florent Dupont. 2013. Streaming Compressed 3D Data on the Web Using JavaScript and WebGL. In Proceedings of the 18th International Conference on 3D Web Technology (San Sebastian, Spain) (Web3D ’13). Association for Computing Machinery, New York, NY, USA, 19–27. https://doi.org/10.1145/2466533.2466539
[11]
Hendrik Lievens, Maarten Wijnants, Mike Vandersanden, Peter Quax, and Wim Lamotte. 2021. Adaptive Web-Based VR Streaming of Multi-LoD 3D Scenes via Author-Provided Relevance Scores. In Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces(VR ’21). 488–489. https://doi.org/10.1109/VRW52623.2021.00126
[12]
Max Limper, Maik Thöner, Johannes Behr, and Dieter W. Fellner. 2014. SRC - a Streamable Format for Generalized Web-Based 3D Data Transmission. In Proceedings of the 19th International ACM Conference on 3D Web Technologies (Vancouver, British Columbia, Canada) (Web3D ’14). Association for Computing Machinery, 35–43. https://doi.org/10.1145/2628588.2628589
[13]
Yitong Liu, Jingfeng Guo, Ken Deng, and Yishi Liu. 2019. A Three-Stage Progressive Transmission Scheme for Virtual Environments Over Lossy Networks. IEEE Access 7 (2019), 184411–184422.
[14]
Haifa Raja Maamar, Azzedine Boukerche, and Emil Petriu. 2013. Streaming 3D meshes over thin mobile devices. IEEE Wireless Communications 20, 3 (2013), 136–142.
[15]
Arne Schilling, Jannes Bolling, and Claus Nagel. 2016. Using GlTF for Streaming CityGML 3D City Models. In Proceedings of the 21st International Conference on Web3D Technology (Anaheim, California) (Web3D ’16). Association for Computing Machinery, 109–116. https://doi.org/10.1145/2945292.2945312
[16]
Timothy Scully, Sebastian Friston, Carmen Fan, Jozef Doboš, and Anthony Steed. 2016. GlTF Streaming from 3D Repo to X3DOM. In Proceedings of the 21st International Conference on Web3D Technology (Anaheim, California) (Web3D ’16). Association for Computing Machinery, 7–15. https://doi.org/10.1145/2945292.2945297
[17]
Carter Slocum, Jingwen Huang, and Jiasi Chen. 2021. VIA: Visibility-Aware Web-Based Virtual Reality. In Proceedings of the 26th International Conference on 3D Web Technology (Pisa, Italy) (Web3D ’21). Association for Computing Machinery, Article 7, 9 pages. https://doi.org/10.1145/3485444.3487641
[18]
Iraj Sodagar. 2011. The MPEG-DASH Standard for Multimedia Streaming Over the Internet. IEEE MultiMedia 18, 4 (April 2011), 62–67. https://doi.org/10.1109/MMUL.2011.71
[19]
Dihong Tian and Ghassan AlRegib. 2004. FQM: A Fast Quality Measure for Efficient Transmission of Textured 3D Models. In Proceedings of the 12th Annual ACM International Conference on Multimedia (New York, NY, USA) (MM ’04). Association for Computing Machinery, New York, NY, USA, 684–691. https://doi.org/10.1145/1027527.1027684
[20]
Zhou Wang, A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing 13, 4 (2004), 600–612. https://doi.org/10.1109/TIP.2003.819861
[21]
Markos Zampoglou, Kostas Kapetanakis, Andreas Stamoulias, Athanasios G. Malamos, and Spyros Panagiotakis. 2018. Adaptive Streaming of Complex Web 3D Scenes based on the MPEG-DASH Standard. Multimedia Tools and Applications 77, 1 (01 Jan 2018), 125–148. https://doi.org/10.1007/s11042-016-4255-8
[22]
Fan Zhang, Ondrej Stava, Frank Galligan, Kai Ninomiya, and Patrick Cozzi. 2021. KHR draco mesh compression. https://github.com/KhronosGroup/glTF/blob/main/extensions/2.0/Khronos/KHR_draco_mesh_compression/README.md.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
Web3D '23: Proceedings of the 28th International ACM Conference on 3D Web Technology
October 2023
244 pages
ISBN:9798400703249
DOI:10.1145/3611314
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 October 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. HTTP Adaptive Streaming (HAS)
  2. MPEG-DASH
  3. Metaverse
  4. Sponza
  5. Web browser
  6. WebGL
  7. glTF
  8. resource scheduling
  9. three.js

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

Web3D '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 27 of 71 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 137
    Total Downloads
  • Downloads (Last 12 months)75
  • Downloads (Last 6 weeks)3
Reflects downloads up to 04 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media