More Web Proxy on the site http://driver.im/

research-article

Using blur to affect perceived distance and size

Authors:

Robert T. Held,

Emily A. Cooper,

James F. O'Brien,

Martin S. BanksAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 29, Issue 2

Article No.: 19, Pages 1 - 16

https://doi.org/10.1145/1731047.1731057

Published: 21 April 2010 Publication History

Abstract

We present a probabilistic model of how viewers may use defocus blur in conjunction with other pictorial cues to estimate the absolute distances to objects in a scene. Our model explains how the pattern of blur in an image together with relative depth cues indicates the apparent scale of the image's contents. From the model, we develop a semiautomated algorithm that applies blur to a sharply rendered image and thereby changes the apparent distance and scale of the scene's contents. To examine the correspondence between the model/algorithm and actual viewer experience, we conducted an experiment with human viewers and compared their estimates of absolute distance to the model's predictions. We did this for images with geometrically correct blur due to defocus and for images with commonly used approximations to the correct blur. The agreement between the experimental data and model predictions was excellent. The model predicts that some approximations should work well and that others should not. Human viewers responded to the various types of blur in much the way the model predicts. The model and algorithm allow one to manipulate blur precisely and to achieve the desired perceived scale efficiently.

Supplementary Material

JPG File (held.jpg)

Download
22.11 KB

held (held.png)

4th supplemental movie file for Using blur to affect perceived distance and size

Download
1.67 MB

held (held.html)

1st supplemental movie file for Using blur to affect perceived distance and size

Download
3.52 KB

held (held.pdf)

3rd supplemental movie file for Using blur to affect perceived distance and size

Download
501.71 KB

held (held.mp4)

2nd supplemental movie file for Using blur to affect perceived distance and size

Download
3.58 MB

References

[1]

Akeley, K., Watt, S. J., Girshick, A. R., and Banks, M. S. 2004. A stereo display prototype with multiple focal distances. ACM Trans. Graph. 23, 3, 804--813.

Digital Library

[2]

Barsky, B. A. 2004. Vision-Realistic rendering: Simulation of the scanned foveal image from wavefront data of human subjects. In Proceedings of the 1st Symposium on Applied Perception in Graphics and Visualization (APGV'04). 73--81.

Digital Library

[3]

Barsky, B. A., Horn, D. R., Klein, S. A., Pang, J. A., and Yu, M. 2003a. Camera models and optical systems used in computer graphics: Part I, Object-Based techniques. In Proceedings of the International Conference on Computational Science and its Applications (ICCSA'03), Montreal, 2nd International Workshop on Computer Graphics and Geometric Modeling (CGGM'03). 246--255.

Digital Library

[4]

Barsky, B. A., Horn, D. R., Klein, S. A., Pang, J. A., and Yu, M. 2003b. Camera models and optical systems used in computer graphics: Part II, Image-Based techniques. In Proceedings of the International Conference on Computational Science and its Applications (ICCSA'03), 2nd International Workshop on Computer Graphics and Geometric Modeling (CGGM'03). 256--265.

Digital Library

[5]

Bell, J. A. 1924. Theory of mechanical miniatures in cinematography. Trans. SMPTE 18, 119.

[6]

Brillault-O'Mahony, B. 1991. New method for vanishing-point detection. CVGIP: Image Underst. 54, 2, 289--300.

Digital Library

[7]

Burge, J. D., Fowlkes, C. C., and Banks, M. 2010. Natural-scene statistics predict how the figure-ground cue of convexity affects human depth perception. J. Neuroscience. To appear.

[8]

Canny, J. 1986. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8, 6, 679--698.

Digital Library

[9]

Chinnock, C. 2009. Personal communication.

[10]

Cole, F., DeCarlo, D., Finkelstein, A., Kin, K., Morley, K., and Santella, A. 2006. Directing gaze in 3d models with stylized focus. In Proceedings of the Eurographics Symposium on Rendering. 377--387.

Digital Library

[11]

Cook, R. L., Carpenter, L., and Catmull, E. 1987. The REYES image rendering architecture. SIGGRAPH Comput. Graph. 21, 4, 95--102.

Digital Library

[12]

Cook, R. L., Porter, T., and Carpenter, L. 1984. Distributed ray tracing. SIGGRAPH Comput. Graph. 18, 3, 137--145.

Digital Library

[13]

Coughlan, J. M. and Yuille, A. L. 2003. Manhattan world: Orientation and outlier detection by bayesian inference. Neur. Comput. 15, 5, 1063--1088.

Digital Library

[14]

DiPaola, S., Riebe, C., and Enns, J. 2009. Rembrandt's textural agency: A shared perspective in visual art and science. In Leonardo. To appear.

[15]

Egusa, H. 1983. Effects of brightness, hue, and saturation on perceived depth between adjacent regions in the visual field. Perception 12, 167--175.

[16]

Fearing, P. 1995. Importance ordering for real-time depth of field. In Proceedings of the 3rd International Computer Science Conference on Image Analysis Applications and Computer Graphics. 372--380.

Digital Library

[17]

Fielding, R. 1985. Special Effects Cinematography, 4th Ed. Focal Press, Oxford.

[18]

Fisher, S. K. and Ciuffreda, K. J. 1988. Accommodation and apparent distance. Perception 17, 609--621.

[19]

Flickr. 2009. Flickr group: Tilt shift miniaturization fakes. www.flickr.com/photos/.

[20]

Fry, G. A., Bridgeman, C. S., and Ellerbrock, V. J. 1949. The effects of atmospheric scattering on binocular depth perception. Amer. J. Optom. Arch. Amer. Acad. Optom. 26, 9--15.

[21]

Green, P., Sun, W., Matusik, W., and Durand, F. 2007. Multi-Aperture photography. ACM Trans. Graph. 26, 3, 68.

Digital Library

[22]

Haeberli, P. and Akeley, K. 1990. The accumulation buffer: Hardware support for high-quality rendering. SIGGRAPH Comput. Graph. 24, 4, 309--318.

Digital Library

[23]

Hecht, H., Kaiser, M. K., and Banks, M. S. 1996. Gravitational acceleration as a cue for absolute size and distance&quest; Perception Psychophys. 58, 1066--1075.

[24]

Hillaire, S., Lécuyer, A., Cozot, R., and Casiez, G. 2007. Depth-of-field blur effects for first-person navigation in virtual environments. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (VRST'07). 203--206.

Digital Library

[25]

Hillaire, S., Lecuyer, A., Cozot, R., and Casiez, G. 2008. Using an eye-tracking system to improve camera motions and depth-of-field blur effects in virtual environments. In Proceedings of the IEEE Virtual Reality Conference. 47--50.

[26]

Ichihara, S., Kitagawa, N., and Akutsu, H. 2007. Contrast and depth perception: Effects of texture contrast and area contrast. Perception 36, 686--695.

[27]

Kingslake, R. 1992. Optics in Photography. SPIE Optical Engineering Press, Bellingham, WA.

[28]

Kolb, C., Mitchell, D., and Hanrahan, P. 1995. A realistic camera model for computer graphics. In Proceedings of ACM SIGGRAPH. 317--324.

Digital Library

[29]

Kosara, R., Miksch, S., Hauser, F., Schrammel, J., Giller, V., and Tscheligi, M. 2002. Useful properties of semantic depth of field for better f+c visualization. In Proceedings of the Joint Eurographics - IEEE TCVG Symposium on Visualization. 205--210.

Digital Library

[30]

Kosara, R., Miksch, S., and Hauser, H. 2001. Semantic depth of field. In Proceedings of the IEEE Symposium on Information Visualization. 97--104.

Digital Library

[31]

Laforet, V. 2007. A really big show. New York Times. (5/31/07).

[32]

Larsen, J. S. 1971. Sagittal growth of the eye. Acta Opthalmologica 49, 6, 873--886.

[33]

Levin, A., Fergus, R., Durand, F., and Freeman, W. T. 2007. Image and depth from a conventional camera with a coded aperture. ACM Trans. Graph. 26, 3, 70--1--70--8.

Digital Library

[34]

Marshall, J., Burbeck, C., Ariely, D., Rolland, J., and Martin, K. 1996. Occlusion edge blur: A cue to relative visual depth. J. Optical Soc. Amer. A 13, 681--688.

[35]

Masaoka, K., Hanazato, A., Emoto, M., Yamanoue, H., Nojiri, Y., and Okano, F. 2006. Spatial distortion prediction system for stereoscopic images. J. Electron. Imaging 15, 1, 013002--1 -- 013002--12.

[36]

Mather, G. 1996. Image blur as a pictorial depth cue. Proc. Royal Soc. Biol. Sci. 263, 1367, 169--172.

[37]

Mather, G. and Smith, D. R. R. 2000. Depth cue integration: Stereopsis and image blur. Vision Res. 40, 25, 3501--3506.

[38]

Mather, G. and Smith, D. R. R. 2002. Blur discrimination and it's relationship to blur-mediated depth perception. Perception 31, 10, 1211--1219.

[39]

McCloskey, M. and Langer, M. 2009. Planar orientation from blur gradients in a single image. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2318--2325.

[40]

Meesters, L., IJsselsteijn, W., and Seuntiens, P. 2004. A survey of perceptual evaluations and requirements of three-dimensional tv. IEEE Trans. Circ. Syst. Video Technol. 14, 3, 381--391.

Digital Library

[41]

Mon-Williams, M. and Tresilian, J. R. 2000. Ordinal depth information from accommodation. Ergonomics 43, 3, 391--404.

[42]

Moreno-Noguer, F., Belhumeur, P. N., and Nayar, S. K. 2007. Active refocusing of images and videos. ACM Trans. Graph. 26, 3, 67--1--67--9.

Digital Library

[43]

Mulder, J. D. and van Liere, R. 2000. Fast perception-based depth of field rendering. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology. 129--133.

Digital Library

[44]

Okatani, T. and Deguchi, K. 2007. Estimating scale of a scene from a single image based on defocus blur and scene geometry. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1--8.

[45]

Palmer, S. E. and Brooks, J. L. 2008. Edge-Region grouping in figure-ground organization and depth perception. J. Exper. Psychol. Hum. Perception Perform. 24, 6 (12), 1353--1371.

[46]

Pentland, A. P. 1987. A new sense for depth of field. IEEE Trans. Pattern Anal. Mach. 9, 4, 523--531.

Digital Library

[47]

Potmesil, M. and Chakravarty, I. 1981. A lens and aperture camera model for synthetic image generation. SIGGRAPH Comput. Graph. 15, 3, 297--305.

Digital Library

[48]

Rohaly, A. and Wilson, H. 1999. The effects of contrast on perceived depth and depth discriminations. Vision Res. 39, 9--18.

[49]

Rokita, P. 1996. Generating depth of-field effects in virtual reality applications. IEEE Comput. Graph. Appl. 16, 2, 18--21.

Digital Library

[50]

Saxberg, B. V. H. 1987. Projected free fall trajectories: 1. Theory and simulation. Biol. Cybernet. 56, 159--175.

Digital Library

[51]

Schechner, Y. Y. and Kiryati, N. 2000. Depth from defocus vs. stereo: How different really are they&quest; Int. J. Comput. Vision 29, 2, 141--162.

Digital Library

[52]

Schiffman, B. 2008. Movie industry doubles down on 3D. Wired Mag.

[53]

Sedgwick, H. A. 1986. Space Perception. Wiley.

[54]

Spring, K. and Stiles, W. S. 1948. Variation of pupil size with change in the angle at which the light stimulus strikes the retina. British J. Ophthalmol. 32, 6, 340--346.

[55]

Vishwanath, D. 2008. The focal blur gradient affects perceived absolute distance {ECVP abstract supplement}. Perception 27, 130.

[56]

Wallach, H. and Norris, C. M. 1963. Accommodation as a distance cue. Amer. J. Psychol. 76, 659--664.

[57]

Watson, J., Banks, M., Hofsten, C., and Royden, C. S. 1992. Gravity as a monocular cue for perception of absolute distance and/or absolute size. Perception 21, 1, 69--76.

[58]

Watt, S. J., Akeley, K., Ernst, M. O., and Banks, M. S. 2005. Focus cues affect perceived depth. J. Vis. 5, 10, 12, 834--862.

[59]

Wilson, B. J., Decker, K. E., and Roorda, A. 2002. Monochromatic aberrations provide an odd-error cue to focus direction. J. Optical Soc. Amer. A 19, 833--839.

[60]

Yamanoue, H. 1997. The relation between size distortion and shooting conditions for stereoscopic images. J. SMPTE 106, 4, 225--232.

[61]

Yamanoue, H., Okui, M., and Yuyama, I. 2000. A study on the relationship between shooting conditions and cardboard effect of stereoscopic images. IEEE Trans. Circ. Syst. Video Technol. 10, 3, 411--416.

Digital Library

Cited By

Hertzmann A(2024)Toward a theory of perspective perception in picturesJournal of Vision10.1167/jov.24.4.2324:4(23)Online publication date: 25-Apr-2024
https://doi.org/10.1167/jov.24.4.23
March JKrishnan AMantiuk RWatt S(2024)Impact of focus cue presentation on perceived realism of 3-D scene structure: Implications for scene perception and for display technologyJournal of Vision10.1167/jov.24.2.1324:2(13)Online publication date: 27-Feb-2024
https://doi.org/10.1167/jov.24.2.13
Hussain RChessa MSolari F(2024)Improving Depth Perception in Immersive Media Devices by Addressing Vergence-Accommodation ConflictIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.333190230:9(6334-6346)Online publication date: Sep-2024
https://doi.org/10.1109/TVCG.2023.3331902
Show More Cited By

Index Terms

Using blur to affect perceived distance and size
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Reconstruction
      2. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation

Recommendations

Defocus Blur Correcting Projector-Camera System
ACIVS '08: Proceedings of the 10th International Conference on Advanced Concepts for Intelligent Vision Systems

To use a projector anytime anywhere, a lot of projector-camera based approaches have been proposed. In this paper, we focus on a focal correction technique, one of projector-camera based approaches, reduces an effect of defocus blur which occurs when a ...
Depth-of-field effect in subjective and objective evaluation of image quality
RACS '18: Proceedings of the 2018 Conference on Research in Adaptive and Convergent Systems

Depth of field, as an important image feature, is always ignored when assessing the quality of photographs. The current study compared the subjective image quality evaluation with three NR image quality algorithms: BIQI, BRISQUE, and NIQE on the ...
Blind Image Restoration with Defocus Blur by Estimating Point Spread Function in Frequency Domain
ICAIP '21: Proceedings of the 5th International Conference on Advances in Image Processing

A blind image restoration method is proposed to enhance the quality of defocus blurred image. Firstly, The defocused blurred image is converted to the frequency domain in order to analyze its spectral characteristics. Secondly, the defocus radius of the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 29, Issue 2

March 2010

145 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1731047

Issue’s Table of Contents

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 April 2010

Accepted: 01 February 2010

Revised: 01 December 2009

Received: 01 April 2009

Published in TOG Volume 29, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

104
Total Citations
View Citations
2,615
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)10

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hertzmann A(2024)Toward a theory of perspective perception in picturesJournal of Vision10.1167/jov.24.4.2324:4(23)Online publication date: 25-Apr-2024
https://doi.org/10.1167/jov.24.4.23
March JKrishnan AMantiuk RWatt S(2024)Impact of focus cue presentation on perceived realism of 3-D scene structure: Implications for scene perception and for display technologyJournal of Vision10.1167/jov.24.2.1324:2(13)Online publication date: 27-Feb-2024
https://doi.org/10.1167/jov.24.2.13
Hussain RChessa MSolari F(2024)Improving Depth Perception in Immersive Media Devices by Addressing Vergence-Accommodation ConflictIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.333190230:9(6334-6346)Online publication date: Sep-2024
https://doi.org/10.1109/TVCG.2023.3331902
Pu YAn D(2024)How Depth of Field in Screen Images Affects Egocentric Distance PerceptionInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2313279(1-14)Online publication date: 22-Feb-2024
https://doi.org/10.1080/10447318.2024.2313279
Chivers TMarshall J(2024)Visualizing particle velocity from dual-camera mixed reality video images using 3D particle tracking velocimetryJournal of Visualization10.1007/s12650-024-01028-3Online publication date: 16-Sep-2024
https://doi.org/10.1007/s12650-024-01028-3
Wang JZou PYu B(2024)How online exposure to nature affects customer engagement: Evidence from Sina WeiboElectronic Markets10.1007/s12525-024-00728-w34:1Online publication date: 7-Sep-2024
https://doi.org/10.1007/s12525-024-00728-w
Ducrocq JCaron G(2024)A Survey on Adaptive CamerasInternational Journal of Computer Vision10.1007/s11263-024-02025-7Online publication date: 28-Feb-2024
https://doi.org/10.1007/s11263-024-02025-7
Roorda ACholewiak SBhargava SIvzan NLaRocca FNankivil DBanks M(2023)The visual benefits of correcting longitudinal and transverse chromatic aberrationJournal of Vision10.1167/jov.23.2.323:2(3)Online publication date: 2-Feb-2023
https://doi.org/10.1167/jov.23.2.3
Rosenberg AThompson LDoudlah RChang T(2023)Neuronal Representations Supporting Three-Dimensional Vision in Nonhuman PrimatesAnnual Review of Vision Science10.1146/annurev-vision-111022-1238579:1(337-359)Online publication date: 15-Sep-2023
https://doi.org/10.1146/annurev-vision-111022-123857
Liu JZhong FMantel CForchhammer SMantiuk R(2023)Computational 3D displaysImmersive Video Technologies10.1016/B978-0-32-391755-1.00023-7(469-500)Online publication date: 2023
https://doi.org/10.1016/B978-0-32-391755-1.00023-7
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents