More Web Proxy on the site http://driver.im/

research-article

DiCE: dichoptic contrast enhancement for VR and stereo displays

Authors:

Fangcheng Zhong,

George Alex Koulieris,

George Drettakis,

Martin S. Banks,

Mathieu Chambe,

Rafał K. MantiukAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 38, Issue 6

Article No.: 211, Pages 1 - 13

https://doi.org/10.1145/3355089.3356552

Published: 08 November 2019 Publication History

Abstract

In stereoscopic displays, such as those used in VR/AR headsets, our eyes are presented with two different views. The disparity between the views is typically used to convey depth cues, but it could be also used to enhance image appearance. We devise a novel technique that takes advantage of binocular fusion to boost perceived local contrast and visual quality of images. Since the technique is based on fixed tone curves, it has negligible computational cost and it is well suited for real-time applications, such as VR rendering. To control the trade-off between contrast gain and binocular rivalry, we conduct a series of experiments to explain the factors that dominate rivalry perception in a dichoptic presentation where two images of different contrasts are displayed. With this new finding, we can effectively enhance contrast and control rivalry in mono- and stereoscopic images, and in VR rendering, as confirmed in validation experiments.

Supplementary Material

ZIP File (a211-zhong.zip)

Supplemental files.

Download
52.36 MB

MP4 File (a211-zhong.mp4)

Download
27.11 MB

References

[1]

Randolph Blake. 1989. A neural theory of binocular rivalry. Psychological review 96, 1 (1989), 145.

[2]

M. W. Cannon. 1985. Perceived contrast in the fovea and periphery. Journal of the Optical Society of America. A, Optics and image science 2, 10 (oct 1985), 1760--8. http://www.ncbi.nlm.nih.gov/ /4056950

[3]

Felice A Dunn and Fred Rieke. 2008. Single-photon absorptions evoke synaptic depression in the retina to extend the operational range of rod vision. Neuron 57, 6 (mar 2008), 894--904.

[4]

Frédo Durand and Julie Dorsey. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics 21, 3 (jul 2002), 257--266.

Digital Library

[5]

Gabriel Eilertsen, Rafał K. Mantiuk, and Jonas Unger. 2015. Real-time noise-aware tone mapping. ACM Transactions on Graphics 34, 6 (oct 2015), 1--15.

Digital Library

[6]

G. Eilertsen, R. K. Mantiuk, and J. Unger. 2017. A comparative review of tone-mapping algorithms for high dynamic range video. Computer Graphics Forum 36, 2 (may 2017), 565--592.

Digital Library

[7]

Gabriel Eilertsen, Robert Wanat, Rafał K Mantiuk, and Jonas Unger. 2013. Evaluation of Tone Mapping Operators for HDR-Video. Computer Graphics Forum 32, 7 (oct 2013), 275--284.

[8]

Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. In ACM SIGGRAPH 2008. ACM, 1--10. http://portal.acm.org/citation.cfm?id=1399504.1360666

[9]

Philippe Fuchs. 2017. Virtual reality headsets-a theoretical and pragmatic approach. CRC Press.

[10]

M A Georgeson and G D Sullivan. 1975. Contrast constancy: deblurring in human vision by spatial frequency channels. J. Physiol. 252, 3 (nov 1975), 627--656.

[11]

Shigeru Ichihara, Norimichi Kitagawa, and Hiromi Akutsu. 2007. Contrast and Depth Perception: Effects of Texture Contrast and Area Contrast. Perception 36, 5 (2007), 686--695. arXiv:https://doi.org/10.1068/p5696 17624115.

[12]

Fred Kingdom and Bernard Moulden. 1988. Border effects on brightness: A review of findings, models and issues. Spatial Vision 3, 4 (jan 1988), 225--262.

[13]

Frederick A. A. Kingdom and Lauren Libenson. 2015. Dichoptic color saturation mixture: Binocular luminance contrast promotes perceptual averaging. Journal of Vision 15, 5 (apr 2015), 2.

[14]

Victor Klymenko, Robert W Verona, Howard H Beasley, and John S Martin. 1994. Convergent and divergent viewing affect luning, visual thresholds, and field-of-view fragmentation in partial binocular overlap helmet-mounted displays. In Helmet-and Head-Mounted Displays and Symbology Design Requirements, Vol. 2218. International Society for Optics and Photonics, 82--97.

[15]

J.J. Kulikowski. 1976. Effective contrast constancy and linearity of contrast sensation. Vision Research 16, 12 (jan 1976), 1419--1431.

[16]

G E Legge and J M Foley. 1980. Contrast masking in human vision. Journal of the Optical Society of America 70, 12 (dec 1980), 1458--71.

[17]

Gordon E Legge and Gary S Rubin. 1981. Binocular interactions in suprathreshold contrast perception. Attention, Perception, & Psychophysics 30, 1 (1981), 49--61.

[18]

Willem JM Levelt. 1965. Binocular brightness averaging and contour information. British journal of psychology 56, 1 (1965), 1--13.

[19]

R. Mantiuk, S. Daly, and L. Kerofsky. 2008. Display adaptive tone mapping. ACM Transactions on Graphics 27, 3 (2008), 68.

Digital Library

[20]

Rafał K. Mantiuk, Karol Myszkowski, and Hans-peter Seidel. 2015. High Dynamic Range Imaging. In Wiley Encyclopedia of Electrical and Electronics Engineering. John Wiley & Sons, Inc., Hoboken, NJ, USA, 1--42.

[21]

Stephen E Palmer. 1999. Vision science: Photons to phenomenology. MIT press.

[22]

Sylvain Paris, Samuel W. Hasinoff, and Jan Kautz. 2011. Local Laplacian filters. ACM Transactions on Graphics 30, 4 (jul 2011), 1.

Digital Library

[23]

Robert Patterson, Marc Winterbottom, Byron Pierce, and Robert Fox. 2007. Binocular rivalry and head-worn displays. Human factors 49, 6 (2007), 1083--1096.

[24]

Maria Perez-Ortiz and Rafal K. Mantiuk. 2017. A practical guide and software for analysing pairwise comparison experiments. arXiv preprint (dec 2017). arXiv:1712.03686 http://arxiv.org/abs/1712.03686

[25]

Erik Reinhard, Michael Stark, Peter Shirley, and James Ferwerda. 2002. Photographic tone reproduction for digital images. ACM Transactions on Graphics 21, 3 (jul 2002), 267.

Digital Library

[26]

Peter Vangorp, Rafat K Mantiuk, Bartosz Bazyluk, Karol Myszkowski, Radosław Mantiuk, Simon J Watt, and Hans-Peter Seidel. 2014. Depth from HDR: depth induction or increased realism?. In ACM Symposium on Applied Perception - SAP '14. ACM Press, New York, New York, USA, 71--78.

Digital Library

[27]

Gregory Ward-Larson, Holly Rushmeier, and Christine Piatko. 1997. A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes. IEEE Transactions on Visualization and Computer Graphics 3, 4 (1997), 291--306.

Digital Library

[28]

Jeremy M Wolfe. 1986. Stereopsis and binocular rivalry. Psychological review 93, 3 (1986), 269.

[29]

Jeremy M. Wolfe and Susan L. Franzel. 1988. Binocularity and visual search. Perception & Psychophysics 44, 1 (01 Jan 1988), 81--93.

[30]

Xuan Yang, Linling Zhang, Tien-Tsin Wong, and Pheng-Ann Heng. 2012. Binocular tone mapping. ACM Transactions on Graphics (TOG) 31, 4 (2012), 93.

Digital Library

[31]

Zhuming Zhang, Chu Han, Shengfeng He, Xueting Liu, Haichao Zhu, Xinghong Hu, and Tien-Tsin Wong. 2019. Deep binocular tone mapping. The Visual Computer 35, 6 (01 Jun 2019), 997--1011.

Digital Library

[32]

Zhuming Zhang, Xinghong Hu, Xueting Liu, and Tien-Tsin Wong. 2018. Binocular Tone Mapping with Improved Overall Contrast and Local Details. Comput. Graph. Forum 37, 7 (2018), 433--442.

Cited By

Chen KWan TMatsuda NNinan AChapiro ASun Q(2024)PEA-PODs: Perceptual Evaluation of Algorithms for Power Optimization in XR DisplaysACM Transactions on Graphics10.1145/365812643:4(1-17)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3658126
Cooper E(2023)The Perceptual Science of Augmented RealityAnnual Review of Vision Science10.1146/annurev-vision-111022-1237589:1(455-478)Online publication date: 15-Sep-2023
https://doi.org/10.1146/annurev-vision-111022-123758
Liu JZhong FMantel CForchhammer SMantiuk R(2023)Computational 3D displaysImmersive Video Technologies10.1016/B978-0-32-391755-1.00023-7(469-500)Online publication date: 2023
https://doi.org/10.1016/B978-0-32-391755-1.00023-7
Show More Cited By

Index Terms

DiCE: dichoptic contrast enhancement for VR and stereo displays
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Perception
      2. Virtual reality
    2. Rendering

Recommendations

DiCE: dichoptic contrast enhancement for binocular displays
SIGGRAPH '19: ACM SIGGRAPH 2019 Posters

In stereoscopic displays, such as those used in VR/AR headsets, our two eyes are presented with different views. The disparity between the views is typically used to convey depth cues, but it could be used for other purposes. We devise a novel technique ...
Binocular tone mapping

By extending from monocular displays to binocular displays, one additional image domain is introduced. Existing binocular display systems only utilize this additional image domain for stereopsis. Our human vision is not only able to fuse two displaced ...
Perception of blending in stereo motion panoramas

Most methods for synthesizing panoramas assume that the scene is static. A few methods have been proposed for synthesizing stereo or motion panoramas, but there has been little attempt to synthesize panoramas that have both stereo and motion. One faces ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 38, Issue 6

December 2019

1292 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/3355089

Issue’s Table of Contents

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 November 2019

Published in TOG Volume 38, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

European Research Council (ERC)
European Union

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
368
Total Downloads

Downloads (Last 12 months)51
Downloads (Last 6 weeks)7

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen KWan TMatsuda NNinan AChapiro ASun Q(2024)PEA-PODs: Perceptual Evaluation of Algorithms for Power Optimization in XR DisplaysACM Transactions on Graphics10.1145/365812643:4(1-17)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3658126
Cooper E(2023)The Perceptual Science of Augmented RealityAnnual Review of Vision Science10.1146/annurev-vision-111022-1237589:1(455-478)Online publication date: 15-Sep-2023
https://doi.org/10.1146/annurev-vision-111022-123758
Liu JZhong FMantel CForchhammer SMantiuk R(2023)Computational 3D displaysImmersive Video Technologies10.1016/B978-0-32-391755-1.00023-7(469-500)Online publication date: 2023
https://doi.org/10.1016/B978-0-32-391755-1.00023-7
Wang MDing JLevi DCooper E(2022)The effect of spatial structure on binocular contrast perceptionJournal of Vision10.1167/jov.22.12.722:12(7)Online publication date: 3-Nov-2022
https://doi.org/10.1167/jov.22.12.7
Huang WZhu ZChen LGo KChen XMao X(2022)Image recoloring for Red-Green dichromats with compensation range-based naturalness preservation and refined dichromacy gamutThe Visual Computer10.1007/s00371-022-02549-438:9-10(3405-3418)Online publication date: 22-Jun-2022
https://doi.org/10.1007/s00371-022-02549-4
Garro VSundstedt VNavarro D(2020)A review of current trends on visual perception studies in virtual and augmented realitySIGGRAPH Asia 2020 Courses10.1145/3415263.3419144(1-97)Online publication date: 17-Nov-2020
https://dl.acm.org/doi/10.1145/3415263.3419144
Chen KChen ZZhou DTai YShi J(2020)Visual comfort evaluated by hue asymmetries in stereoscopic imagesJournal of the Society for Information Display10.1002/jsid.89728:11(843-853)Online publication date: 3-Apr-2020
https://doi.org/10.1002/jsid.897

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents