More Web Proxy on the site http://driver.im/

research-article

WebGL-based streaming and presentation of objects with bidirectional texture functions

Authors:

Christopher Schwartz,

Roland Ruiters,

Michael Weinmann,

Reinhard KleinAuthors Info & Claims

Journal on Computing and Cultural Heritage (JOCCH), Volume 6, Issue 3

Article No.: 11, Pages 1 - 21

https://doi.org/10.1145/2499931.2499932

Published: 05 August 2013 Publication History

Abstract

Museums and Cultural Heritage institutions have a growing interest in presenting their collections to a broader community via the Internet. The photo-realistic presentation of interactively inspectable virtual surrogates is one of the most challenging problems in this field. For this purpose, we seek to employ not only a 3D geometry but also a powerful material representation capable of reproducing the full visual appeal of an object. In this article, we propose a WebGL-based presentation framework in which reflectance information is represented via Bidirectional Texture Functions (BTF). Our approach works out-of-the-box in modern Web browsers and allows for the progressive transmission and interactive rendering of digitized artifacts consisting of 3D geometry and reflectance information. We handle the huge amount of data needed for this representation by employing a novel progressive streaming approach for BTFs, which allows for the smooth interactive inspection of a steadily improving version during the download. We demonstrate an interesting use-case of this technique at a cross section of Cultural Heritage, medical education, and research and provide an evaluation of the capabilities of our framework in the scope of BTF compression and transmission.

References

[1]

Behr, J., Eschler, P., Jung, Y., and Zöllner, M. 2009. X3DOM: a DOM-based html5/x3d integration model. In Proceedings of Web3D. 127--135.

Digital Library

[2]

Bottou, L., Haffner, P., Howard, P. G., Simard, P., Bengio, Y., and Lecun, Y. 1998. High quality document image compression with DJVU. J. Electronic Imag. 7, 410--425.

[3]

Cohen, A., Daubechies, I., and Feauveau, J. C. 1992. Biorthogonal bases of compactly supported wavelets. Inform. Tech. 45, 5, 485--560.

[4]

Dana, K. J., Nayar, S. K., Van Ginneken, B., and Koenderink, J. J. 1997. Reflectance and texture of real-world surfaces authors. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 151--157.

Digital Library

[5]

Davis, G. M. and Nosratinia, A. 1998. Wavelet-based image coding: An overview. Appl. Comput. Contr. Sig. Circ. 1, 205--269.

[6]

Di Benedetto, M., Ponchio, F., Ganovelli, F., and Scopigno, R. 2010. SpiderGL: A JavaScript 3D graphics library for next-generation WWW. In Proceedings of Web3D. 165--174.

Digital Library

[7]

Eckart, C. and Young, G. 1936. The approximation of one matrix by another of lower rank. Psychometrika 1, 211--218.

[8]

Furukawa, R., Kawasaki, H., Ikeuchi, K., and Sakauchi, M. 2002. Appearance based object modeling using texture database: Acquisition, compression and rendering. In Proceedings of the Eurographics Workshop on Rendering. 257--266.

Digital Library

[9]

Geiges, M. L. 2009. Traces of Marion B. Sulzberger in the museum of wax moulages in Zurich and their importance for the history of dermatology. J. Amer. Acad. Dermatology 60, 6, 980--984.

[10]

Geiges, M. L. 2012. Hundert blicke auf ein püggeli - museale wachsmoulagen in der modernen lehre. In Exhibition Catalogue. Moulagenmuseum der Universität und des Universittsspitals Zürich.

[11]

Gunawardane, P., Wang, O., Scher, S., Rickards, I., Davis, J., and Malzbender, T. 2009. Optimized image sampling for view and light interpolation. In Proceedings the of International Conference on Virtual Reality, Archaeology and Cultural Heritage. 93--100.

Digital Library

[12]

Guthe, M., Müller, G., Schneider, M., and Klein, R. 2009. BTF-CIElab: A perceptual difference measure for quality assessment and compression of BTFs. Comput. Graph. Forum 28, 1, 101--113.

[13]

Haindl, M. and Filip, J. 2011. Advanced textural representation of materials appearance. In Proceedings of SIGGRAPH Asia, Courses. 1--84.

Digital Library

[14]

Havran, V., Filip, J., and Myszkowski, K. 2010. Bidirectional texture function compression based on multi-level vector quantization. Comput. Graph. Forum 29, 1, 175--190.

[15]

Holroyd, M., Lawrence, J., and Zickler, T. 2010. A coaxial optical scanner for synchronous acquisition of 3D geometry and surface reflectance. In Proceedings of SIGGRAPH. 1--12.

Digital Library

[16]

Jung, Y., Behr, J., and Graf, H. 2011. X3DOM as carrier of the virtual heritage. In Proceedings of ISPRS International Workshop 3D-ARCH.

[17]

Khronos Group. 2010. WebGL Specification 1.0. http://www.khronos.org/webgl/.

[18]

Köhler, J., Nöll, T., Reis, G., and Stricker, D. 2013. A full-spherical device for simultaneous geometry and reflectance acquisition. In Proceedings of the IEEE Workshop on the Applications of Computer Vision (WACV).

Digital Library

[19]

Levoy, M. and Hanrahan, P. 1996. Light field rendering. In Proceedings of SIGGRAPH. 31--42.

Digital Library

[20]

Mudge, M., Schroer, C., Earl, G., Martinez, K., Pagi, H., Toler- Franklin, C., Rusinkiewicz, S., Palma, G., Wachowiak, M., Ashley, M., Matthews, N., Noble, T., and Dellepiane, M. 2010. Principles and practices of robust, photography-based digital imaging techniques for museums. In International Symposium on Virtual Reality, Archaeology and Cultural Heritage - Short and Project Paper Proceedings. 111--137.

[21]

Müller, G. 2009. Data-driven methods for compression and editing of spatially varying appearance. Ph.D. thesis, Rheinische Friedrich-Wilhelms-Universität, Bonn.

[22]

Müller, G., Bendels, G. H., and Klein, R. 2005. Rapid synchronous acquisition of geometry and BTF for cultural heritage artefacts. In Proceedings of the International Symposium on Virtual Reality, Archaeology and Cultural Heritage. 13--20.

Digital Library

[23]

Müller, G., Meseth, J., and Klein, R. 2003. Compression and real-time rendering of measured BTFs using local PCA. In Proceedings of the International Fall Workshop on Vision, Modeling and Visualisation. 271--280.

[24]

Müller, G., Meseth, J., Sattler, M., Sarlette, R., and Klein, R. 2004. Acquisition, synthesis and rendering of bidirectional texture functions. In Proceedings of the Eurographics, State of the Art Reports. 69--94.

[25]

Penner, E. and Borshukov, G. 2011. Pre-integrated skin shading. In GPU Pro 2, Vol. 2, A K Peters/CRC Press, Boca Raton, FL, 41--55.

[26]

Rao, K. R. and Yip, P. 2000. The Transform and Data Compression Handbook. CRC Press, Inc., Boca Raton, FL.

Digital Library

[27]

Ruiters, R. and Klein, R. 2009. BTF compression via sparse tensor decomposition. Comput. Graph. Forum 28, 4, 1181--1188.

Digital Library

[28]

Said, A. and Pearlman, W. 1996. A new, fast, and efficient image codec based on set partitioning in hierarchical trees. IEEE Trans. Circuits Syst. Video Technol. 6, 3, 243--250.

Digital Library

[29]

Schwartz, C. and Klein, R. 2012. Acquisition and presentation of virtual surrogates for cultural heritage artefacts. In Proceedings of the EVA. 50--57.

[30]

Schwartz, C., Weinmann, M., Ruiters, R., and Klein, R. 2011. Integrated high-quality acquisition of geometry and appearance for cultural heritage. In Proceedings of the International Symposium on Virtual Reality, Archeology and Cultural Heritage. 25--32.

Digital Library

[31]

Shoham, Y. and Gersho, A. 1988. Efficient bit allocation for an arbitrary set of quantizers. In IEEE Trans. Acoustics, Speech, Signal Process 36, 9. 1445--1453.

[32]

Van Deursen, D., Van Lancker, W., and Van De Walle, R. 2010. On media delivery protocols in the web. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME). 1028--1033.

[33]

Wang, Z., Bovik, A., Sheikh, H., and Simoncelli, E. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13, 4, 600--612.

Digital Library

[34]

Weinmann, M., Ruiters, R., Osep, A., Schwartz, C., and Klein, R. 2012. Fusing structured light consistency and Helmholtz normals for 3D reconstruction. In Proceedings of the British Machine Vision Conference.

[35]

Wood, D. N., Azuma, D. I., Aldinger, K., Curless, B., Duchamp, T., Salesin, D. H., and Stuetzle, W. 2000. Surface light fields for 3D photography. In Proceedings of ACM SIGGRAPH. 287--296.

Digital Library

[36]

Wu, H., Dorsey, J., and Rushmeier, H. 2011. A sparse parametric mixture model for BTF compression, editing and rendering. Comput. Graph. Forum 30, 2, 465--473.

[37]

Wu, Q., Xia, T., Chen, C., Lin, H.-Y. S., Wang, H., and Yu, Y. 2008. Hierarchical tensor approximation of multi-dimensional visual data. IEEE Trans. Vis. Comput. Graphics 14, 1, 186--199.

Digital Library

Cited By

Campiani AMcAvoy SLercari NLiendo Stuardo RJiménez Delgado GLópez Mejía JRissolo DKuester F(2023)Developing an interoperable cloud-based visualization workflow for 3D archaeological heritage data: The Palenque 3D Archaeological AtlasDigital Applications in Archaeology and Cultural Heritage10.1016/j.daach.2023.e0029331(e00293)Online publication date: Dec-2023
https://doi.org/10.1016/j.daach.2023.e00293
Ponchio FCorsini MScopigno R(2019)RELIGHTGraphical Models10.1016/j.gmod.2019.101040105:COnline publication date: 1-Sep-2019
https://dl.acm.org/doi/10.1016/j.gmod.2019.101040
Ponchio FCorsini MScopigno RWalczak KZachmann GFlotyński JKiyokawa KThalmann D(2018)A compact representation of relightable images for the webProceedings of the 23rd International ACM Conference on 3D Web Technology10.1145/3208806.3208820(1-10)Online publication date: 20-Jun-2018
https://dl.acm.org/doi/10.1145/3208806.3208820
Show More Cited By

Index Terms

WebGL-based streaming and presentation of objects with bidirectional texture functions

Recommendations

WebGL-based streaming and presentation framework for bidirectional texture functions
VAST'11: Proceedings of the 12th International conference on Virtual Reality, Archaeology and Cultural Heritage

Museums and Cultural Heritage institutions have a growing interest in presenting their collections to a broader community via the Internet. The photo-realistic presentation of interactively inspectable digital 3D replicas of artifacts is one of the most ...
Physically-based Environment and Area Lighting using Progressive Rendering in WebGL
Web3D '20: Proceedings of the 25th International Conference on 3D Web Technology

This paper presents a progressive rendering approach that enables rendering of static 3D scenes, lit by physically-based environment and area lights. Multi-frame sampling strategies are used to approximate elaborate lighting that is refined while ...
Synthesis and Rendering of Bidirectional Texture Functions on Arbitrary Surfaces

Abstract--The bidirectional texture function (BTF) is a 6D function that describes the appearance of a real-world surface as a function of lighting and viewing directions. The BTF can model the fine-scale shadows, occlusions, and specularities caused by ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Journal on Computing and Cultural Heritage

Journal on Computing and Cultural Heritage Volume 6, Issue 3

July 2013

75 pages

ISSN:1556-4673

EISSN:1556-4711

DOI:10.1145/2499931

Issue’s Table of Contents

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 August 2013

Accepted: 01 March 2013

Revised: 01 March 2013

Received: 01 December 2012

Published in JOCCH Volume 6, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
512
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)2

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Campiani AMcAvoy SLercari NLiendo Stuardo RJiménez Delgado GLópez Mejía JRissolo DKuester F(2023)Developing an interoperable cloud-based visualization workflow for 3D archaeological heritage data: The Palenque 3D Archaeological AtlasDigital Applications in Archaeology and Cultural Heritage10.1016/j.daach.2023.e0029331(e00293)Online publication date: Dec-2023
https://doi.org/10.1016/j.daach.2023.e00293
Ponchio FCorsini MScopigno R(2019)RELIGHTGraphical Models10.1016/j.gmod.2019.101040105:COnline publication date: 1-Sep-2019
https://dl.acm.org/doi/10.1016/j.gmod.2019.101040
Ponchio FCorsini MScopigno RWalczak KZachmann GFlotyński JKiyokawa KThalmann D(2018)A compact representation of relightable images for the webProceedings of the 23rd International ACM Conference on 3D Web Technology10.1145/3208806.3208820(1-10)Online publication date: 20-Jun-2018
https://dl.acm.org/doi/10.1145/3208806.3208820
Havran VEgert P(2018)Extensions to bidirectional texture function compression with multi-level vector quantization in OpenCLComputers and Graphics10.1016/j.cag.2015.01.00548:C(1-10)Online publication date: 23-Dec-2018
https://dl.acm.org/doi/10.1016/j.cag.2015.01.005
Krumpen SWeinmann MKlein R(2017)OctreeBTFs A compact, seamless and distortion-free reflectance representationComputers and Graphics10.1016/j.cag.2017.08.00168:C(21-31)Online publication date: 1-Nov-2017
https://dl.acm.org/doi/10.1016/j.cag.2017.08.001
Vilas Boas JMatsunaga FRomeiro NBrancher J(2015)Client-server architecture for pre and post-processing of real problems involving two-dimensional generalized coordinatesInternational Journal of Web Information Systems10.1108/IJWIS-12-2014-004411:2(226-245)Online publication date: 15-Jun-2015
https://doi.org/10.1108/IJWIS-12-2014-0044

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents