More Web Proxy on the site http://driver.im/

Article

Rendering for an interactive 360° light field display

Authors:

Hideshi Yamada,

Paul DebevecAuthors Info & Claims

SIGGRAPH '07: ACM SIGGRAPH 2007 papers

Pages 40 - es

https://doi.org/10.1145/1275808.1276427

Published: 29 July 2007 Publication History

Abstract

We describe a set of rendering techniques for an autostereoscopic light field display able to present interactive 3D graphics to multiple simultaneous viewers 360 degrees around the display. The display consists of a high-speed video projector, a spinning mirror covered by a holographic diffuser, and FPGA circuitry to decode specially rendered DVI video signals. The display uses a standard programmable graphics card to render over 5,000 images per second of interactive 3D graphics, projecting 360-degree views with 1.25 degree separation up to 20 updates per second. We describe the system's projection geometry and its calibration process, and we present a multiple-center-of-projection rendering technique for creating perspective-correct images from arbitrary viewpoints around the display. Our projection technique allows correct vertical perspective and parallax to be rendered for any height and distance when these parameters are known, and we demonstrate this effect with interactive raster graphics using a tracking system to measure the viewer's height and distance. We further apply our projection technique to the display of photographed light fields with accurate horizontal and vertical parallax. We conclude with a discussion of the display's visual accommodation performance and discuss techniques for displaying color imagery.

Supplementary Material

JPG File (pps040.jpg)

Download
15.11 KB

MP4 File (pps040.mp4)

Download
56.49 MB

References

[1]

Agocs, T., Balogh, T., Forgacs, T., Bettio, F., Gobbetti, E., Zanetti, G., and Bouvier, E. 2006. A large scale interactive holographic display. In VR '06: Proceedings of the IEEE Virtual Reality Conference (VR 2006), IEEE Computer Society, Washington, DC, USA, 57.

Digital Library

[2]

Akeley, K., Watt, S. J., Girshick, A. R., and Banks, M. S. 2004. A stereo display prototype with multiple focal distances. ACM Transactions on Graphics 23, 3 (Aug.), 804--813.

Digital Library

[3]

Balogh, T., Dobranyi, Z., Forgacs, T., Molnar, A., Szloboda, L., Gobbetti, E., Marton, F., Bettio, F., Pintore, G., Zanetti, G., Bouvier, E., and Klein, R. 2006. An interactive multi-user holographic environment. In SIGGRAPH '06: ACM SIGGRAPH 2006 Emerging technologies, ACM Press, New York, NY, USA, 18.

Digital Library

[4]

Batchko, R. G. 1994. Three-hundred-sixty degree electro-holographic stereogram and volumetric display system. In Proc. SPIE, vol. 2176, 30--41.

[5]

Chai, J.-X., Tong, X., Chan, S.-C., and Shum, H.-Y. 2000. Plenoptic sampling. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 307--318.

Digital Library

[6]

Cossairt, O. S., and Napoli, J., 2005. Radial multi-view 3-dimensional displays. United States Patent Application 2005/0180007, Aug.

[7]

Cossairt, O., Travis, A. R., Moller, C., and Benton, S. A. 2004. Novel view sequential display based on dmd technology. In Proc. SPIE, Stereoscopic Displays and Virtual Reality Systems XI, A. J. Woods, J. O. Merritt, S. A. Benton, and M. T. Bolas, Eds., vol. 5291, 273--278.

[8]

Cossairt, O. S., Napoli, J., Hill, S. L., Dorval, R. K., and Favalora, G. E. 2007. Occlusion-capable multiview volumetric three-dimensional display. Applied Optics 46, 8 (Mar), 1244--1250.

[9]

Dodgson, N. A. 2005. Autostereoscopic 3D displays. Computer 38, 8, 31--36.

Digital Library

[10]

Dorsey, J. O., Sillion, F. X., and Greenberg, D. P. 1991. Design and simulation of opera lighting and projection effects. In SIGGRAPH '91: Proceedings of the 18th annual conference on Computer graphics and interactive techniques, ACM Press, New York, NY, USA, 41--50.

Digital Library

[11]

Einarsson, P., Chabert, C.-F., Jones, A., Ma, W.-C., Lamond, B., Hawkins, T., Bolas, M., Sylwan, S., and Debevec, P. 2006. Relighting human locomotion with flowed reflectance fields. In Rendering Techniques 2006: 17th Eurographics Symposium on Rendering, 183--194.

Digital Library

[12]

Endo, T., Kajiki, Y., Honda, T., and Sato, M. 2000. Cylindrical 3D video display observable from all directions. In 8th Pacific Conference on Computer Graphics and Applications, 300--306.

Digital Library

[13]

Favalora, G. E. 2005. Volumetric 3D displays and application infrastructure. Computer 38, 8, 37--44.

Digital Library

[14]

Forsyth, D. A., and Ponce, J. 2002. Computer Vision: A Modern Approach. Prentice Hall, ch. 3, 45.

Digital Library

[15]

Freundenberg, B., Masuch, M., and Strothotte, T. 2004. Game Programming Gems 4. Thomson/Delmar Learning, ch. Real-Time Halftoning: Fast and Simple Stylized Shading, 443--449.

[16]

Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. 1996. The lumigraph. In Proceedings of SIGGRAPH 96, Computer Graphics Proceedings, Annual Conference Series, 43--54.

Digital Library

[17]

Halle, M. W., Benton, S. A., Klug, M. A., and Underkoffler, J. S. 1991. The ultragram: A generalized holographic stereogram. In Proceedings of the SPIE Practical Holography V.

[18]

Han, J. Y., and Perlin, K. 2003. Measuring bidirectional texture reflectance with a kaleidoscope. ACM Transactions on Graphics 22, 3 (July), 741--748.

Digital Library

[19]

Hou, X., Wei, L.-Y., Shum, H.-Y., and Guo, B. 2006. Realtime multi-perspective rendering on graphics hardware. In Rendering Techniques 2006: 17th Eurographics Workshop on Rendering, 93--102.

Digital Library

[20]

Isaksen, A., McMillan, L., and Gortler, S. J. 2000. Dynamically reparameterized light fields. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 297--306.

Digital Library

[21]

Jones, A., Debevec, P., Bolas, M., and McDowall, I. 2006. Concave surround optics for rapid multiview imaging. In Proceedings of the 25th Army Science Conference.

Digital Library

[22]

Jones, A., Gardner, A., Bolas, M., McDowall, I., and Debevec, P. 2006. Performance geometry capture for spatially varying relighting. In 3rd European Conference on Visual Media Production (CVMP 2006), 127--133.

[23]

Kajiya, J. T., and Kay, T. L. 1989. Rendering fur with three dimensional textures. In SIGGRAPH '89: Proceedings of the 16th annual conference on Computer graphics and interactive techniques, ACM Press, New York, NY, USA, 271--280.

Digital Library

[24]

Levoy, M., and Hanrahan, P. M. 1996. Light field rendering. In Proceedings of ACM SIGGRAPH 96, Computer Graphics Proceedings, Annual Conference Series, 31--42.

Digital Library

[25]

Lippman, G. 1908. Epreuves reversibles donnant la sensation du relief. Journal of Physics 7, 4 (Nov), 821--835.

[26]

Maeda, H., Hirose, K., Yamashita, J., Hirota, K., and Hirose, M. 2003. All-around display for video avatar in real world. In ISMAR '03: Proceedings of the The 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, IEEE Computer Society, Washington, DC, USA, 288.

Digital Library

[27]

Matusik, W., and Pfister, H. 2004. 3D tv: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes. ACM Transactions on Graphics 23, 3 (Aug.), 814--824.

Digital Library

[28]

McDowall, I., and Bolas, M. 2005. Display, sensing, and control applications for digital micromirror displays. In IEEE VR 2005 - Emerging Display Technologies, 35--36.

[29]

Miller, J. R. 1987. Geometric approaches to nonplanar quadric surface intersection curves. ACM Transactions on Graphics 6, 4 (Oct.), 274--307.

Digital Library

[30]

Ostromoukhov, V. 2001. A simple and efficient error-diffusion algorithm. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 567--572.

Digital Library

[31]

Otsuka, R., Hoshino, T., and Horry, Y. 2006. Transpost: A novel approach to the display and transmission of 360 degrees-viewable 3D solid images. IEEE Transactions on Visualization and Computer Graphics 12, 2, 178--185.

Digital Library

[32]

Poulin, P., and Fournier, A. 1990. A model for anisotropic reflection. 273--282.

[33]

Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., and Fuchs, H. 1998. The office of the future: A unified approach to image-based modeling and spatially immersive displays. In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 179--188.

Digital Library

[34]

Sullivan, A. 2003. A solid-state multi-planar volumetric display. SID Symposium Digest of. Technical Papers 32, 1 (May), 1531--1533.

[35]

Tanaka, K., and Aoki, S. 2006. A method for the real-time construction of a full parallax light field. In Stereoscopic Displays and Virtual Reality Systems XIII. Proceedings of the SPIE, Volume 6055, pp. 397--407 (2006)., A. J. Woods, N. A. Dodgson, J. O. Merritt, M. T. Bolas, and I. E. McDowall, Eds., 397--407.

[36]

Travis, A. R. L. 1997. The display of three-dimensional video images. Proceedings of the IEEE 85, 11 (Nov), 1817--1832.

[37]

Wilburn, B., Joshi, N., Vaish, V., Talvala, E.-V., Antunez, E., Barth, A., Adams, A., Horowitz, M., and Levoy, M. 2005. High performance imaging using large camera arrays. ACM Transactions on Graphics 24, 3 (Aug), 765--776.

Digital Library

[38]

Yang, J. C., Everett, M., Buehler, C., and McMILLAN, L. 2002. A real-time distributed light field camera. In Rendering Techniques 2002: 13th Eurographics Workshop on Rendering, 77--86.

Digital Library

[39]

Yendo, T., Kawakami, N., and Tachi, S. 2005. Seelinder: the cylindrical lightfield display. In SIGGRAPH '05: ACM SIGGRAPH 2005 Emerging technologies, ACM Press, New York, NY, USA, 16.

Digital Library

[40]

Zwicker, M., Matusik, W., Durand, F., and Pfister, H. 2006. Antialiasing for automultiscopic 3D displays. In Rendering Techniques 2006: 17th Eurographics Workshop on Rendering, 73--82.

Digital Library

Cited By

ZHANG Runnan 张ZHOU Ning 周ZHOU Zihao 周DU Heheng 杜CHEN Qian 陈ZUO Chao 左(2024)光场表征及其分辨率提升技术：文献综述及最新进展(特邀)Infrared and Laser Engineering10.3788/IRLA2024034753:9(20240347)Online publication date: 2024
https://doi.org/10.3788/IRLA20240347
Li YCheng DHou QWang Y(2024)Dual-Focal Plane Augmented Reality Near-Eye Display Adopting Liquid Crystal Variable RetarderIEEE Journal of Selected Topics in Quantum Electronics10.1109/JSTQE.2024.337058730:2: Integrated Optoelectronics(1-8)Online publication date: Mar-2024
https://doi.org/10.1109/JSTQE.2024.3370587
Yano YKoizumi N(2023)AiRound: a touchable mid-air image viewable from 360 degreesSIGGRAPH Asia 2023 Emerging Technologies10.1145/3610541.3614568(1-2)Online publication date: 28-Nov-2023
https://dl.acm.org/doi/10.1145/3610541.3614568
Show More Cited By

Index Terms

Rendering for an interactive 360° light field display

Recommendations

Rendering for an interactive 360° light field display

We describe a set of rendering techniques for an autostereoscopic light field display able to present interactive 3D graphics to multiple simultaneous viewers 360 degrees around the display. The display consists of a high-speed video projector, a ...
Lighting sensitive display

Although display devices have been used for decades, they have functioned without taking into account the illumination of their environment. We present the concept of a lighting sensitive display (LSD)---a display that measures the incident illumination ...
Real-time high-quality View-Dependent Texture Mapping using per-pixel visibility
GRAPHITE '05: Proceedings of the 3rd international conference on Computer graphics and interactive techniques in Australasia and South East Asia

We present an extension of View-Dependent Texture Mapping (VDTM) allowing rendering of complex geometric meshes at high frame rates without usual blurring or skinning artifacts. We combine a hybrid geometric and image-based representation of a given 3D ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '07: ACM SIGGRAPH 2007 papers

August 2007

1019 pages

ISBN:9781450378369

DOI:10.1145/1275808

Conference Chair:
Marc Levoy

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH07

Sponsor:

SIGGRAPH

SIGGRAPH07: Special Interest Group on Computer Graphics and Interactive Techniques Conference

August 5 - 9, 2007

California, San Diego

Acceptance Rates

SIGGRAPH '07 Paper Acceptance Rate 108 of 455 submissions, 24%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

91
Total Citations
View Citations
4,860
Total Downloads

Downloads (Last 12 months)117
Downloads (Last 6 weeks)11

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

ZHANG Runnan 张ZHOU Ning 周ZHOU Zihao 周DU Heheng 杜CHEN Qian 陈ZUO Chao 左(2024)光场表征及其分辨率提升技术：文献综述及最新进展(特邀)Infrared and Laser Engineering10.3788/IRLA2024034753:9(20240347)Online publication date: 2024
https://doi.org/10.3788/IRLA20240347
Li YCheng DHou QWang Y(2024)Dual-Focal Plane Augmented Reality Near-Eye Display Adopting Liquid Crystal Variable RetarderIEEE Journal of Selected Topics in Quantum Electronics10.1109/JSTQE.2024.337058730:2: Integrated Optoelectronics(1-8)Online publication date: Mar-2024
https://doi.org/10.1109/JSTQE.2024.3370587
Yano YKoizumi N(2023)AiRound: a touchable mid-air image viewable from 360 degreesSIGGRAPH Asia 2023 Emerging Technologies10.1145/3610541.3614568(1-2)Online publication date: 28-Nov-2023
https://dl.acm.org/doi/10.1145/3610541.3614568
Idrees FAdnan A(2023)Using pivot image for the development of composite visual space based on image normalizationSoft Computing10.1007/s00500-023-08075-2Online publication date: 5-May-2023
https://doi.org/10.1007/s00500-023-08075-2
Hua HBalram N(2023)Light Field DisplaysHandbook of Visual Display Technology10.1007/978-3-642-35947-7_218-1(1-22)Online publication date: 26-Aug-2023
https://doi.org/10.1007/978-3-642-35947-7_218-1
Nakamura TImai YYoshimizu YKuramoto KKato NSuzuki HNakahata YNomoto K(2023)36‐1: 360‐degree Transparent Light Field Display with Highly‐Directional Holographic Screens for Fully Volumetric 3D Video ExperienceSID Symposium Digest of Technical Papers10.1002/sdtp.1660654:1(514-517)Online publication date: 30-Aug-2023
https://doi.org/10.1002/sdtp.16606
Jankauskis EElizondo SMontano Murillo RMarzo AMartinez Plasencia D(2022)TipTrap: A Co-located Direct Manipulation Technique for Acoustically Levitated Content.Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545675(1-11)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545675
Pan XZheng MXu XXu ZCampbell A(2022)How can the Additional Motion Parallax along the y and z-axis Affect Viewer’s 3D Perception?: A Generic Approach and Evaluation2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00040(252-259)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00040
Battulga KFujimoto T(2021)View-dependent Projection Mapping Enhanced by Real BackgroundThe Journal of the Society for Art and Science10.3756/artsci.20.5520:1(55-71)Online publication date: 30-Mar-2021
https://doi.org/10.3756/artsci.20.55
Kiyokawa MHashimoto N(2021)Projection Mapping with 3D Images Using Swept-volume Display and Retro-transmissive Optics体積走査型ディスプレイによる立体像と再帰透過光学系を用いたプロジェクションマッピングの提案The Journal of The Institute of Image Information and Television Engineers10.3169/itej.75.83175:6(831-837)Online publication date: 2021
https://doi.org/10.3169/itej.75.831
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents