More Web Proxy on the site http://driver.im/

article

Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments

Editor: Jessica Hodgins Authors:

Sumanita Pattanaik,

Donald P. GreenbergAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 20, Issue 1

Pages 39 - 65

https://doi.org/10.1145/383745.383748

Published: 01 January 2001 Publication History

Abstract

We present a method to accelerate global illumination computation in prerendered animations by taking advantage of limitations of the human visual system. A spatiotemporal error tolerance map, constructed from psychophysical data based on velocity dependent contrast sensitivity, is used to accelerate rendering. The error map is augmented by a model of visual attention in order to account for the tracking behavior of the eye. Perceptual acceleration combined with good sampling protocols provide a global illumination solution feasible for use in animation. Results indicate an order of magnitude improvement in computational speed.

References

[1]

AGRAWALA, M., BEERS,A.C.,AND CHADDHA, N. 1995. Model-based motion estimation for synthetic animations. In Proceedings of the 3rd ACM International Conference on Multimedia '95. ACM, New York, pp. 477-488.

[2]

BOLIN,M.R.AND MEYER, G. W. 1995. A frequency based ray tracer. In SIGGRAPH 95 Conference Proceedings (Los Angeles, Calif., Aug.). ACM, New York, pp. 409-418.

[3]

BOLIN,M.R.AND MEYER, G. W. 1998. A perceptually based adaptive sampling algorithm. In SIGGRAPH 98 Conference Proceedings (Orlando, Fla., July). ACM, New York, pp. 299- 309.

[4]

BURT,P.J.AND ADELSON, E. H. 1983. The Laplacian pyramid as a compact image code. In IEEE Trans. Commun. Com-31, 4 (Apr.), pp. 532-540.

[5]

CAMPBELL,F.W.AND ROBSON, J. G. 1968. Application of Fourier analysis to the visibility of gratings. In J. Phys. (London) 197, pp. 551-566.

[6]

DALY, S. 1993. The visible differences predictor: An algorithm for the assessment of image fidelity. In Digital Images and Human Vision, A. B. Watson, Ed, MIT Press, Cambridge, Mass., pp. 179- 206.

[7]

DALY, S. 1998. Engineering observations from spatiovelocity and spatiotemporal visual Models. In IS&T/SPIE Conference on Human Vision and Electronic Imaging III. SPIE, Vol. 3299, (Jan.), pp. 180-191.

[8]

DALY, S., MATTHEWS, K., AND RIBAS-CORBERA, J. 1999. Visual eccentricity models in face-based video compression. In IS&T/SPIE Conference on Human Vision and Electronic Imaging IV. SPIE, Vol. 3644, (Jan.), pp. 152-166.

[9]

FERWERDA, J. A., PATTANAIK, S., SHIRLEY,P.,AND GREENBERG, D. P. 1997. A model of visual masking for computer graphics. In Proceedings of the SIGGRAPH 1997 Conference. ACM, New York, pp. 143-152.

[10]

GIBSON,S.AND HUBBOLD, R. 1997. Perceptually-driven radiosity. Compute. Graph. Forum 16, 2 (June), pp. 192-140.

[11]

GREENSPAN, H., BELONGIE, S., GOODMAN, R., PERONA, P., RAKSHIT, S., ANDERSON, C. H. 1994. Overcomplete steerable pyramid filters and rotation invariance. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Seattle, Wash. June). IEEE Computer Society Press, Los Alamitos, Calif., pp. 222-228.

[12]

HORVITZ,E.AND LENGYEL, J. 1997. Perception, attention, and resources: A decision-theoretic approach to graphics rendering. In Proceedings of the 13th Conference on Uncertainty in Artificial Intelligence (Providence, R.I., Aug.), Don Gelger and Prakash Stenoy, Eds, Morgan Kaufmann Publishers, Inc., San Francisco, Calif., pp. 238-249.

[13]

ITTI,L.AND KOCH, C. 1999a. A comparison of feature combination strategies for saliency-based visual attention systems. In IS&T/SPIE Conference on Human Vision and Electronic Imaging IV. SPIE, Vol. 3644, (Jan.), pp. 373-382.

[14]

ITTI,L.AND KOCH, C. 1999b. Learning to detect salient objects in natural scenes using visual attention. In Image Understanding Workshop. (In press. A preprint version of this article is available from http://www.klab.caltech.edul/citti/attention).

[15]

ITTI,L.AND KOCH, C. 2000. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Res. 40, 10-12, pp. 1489-1506.

[16]

ITTI, L., KOCH,C.,AND NIEBUR, E. 1998. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Machi. Intell. (PAMI) 20, 11, pp. 1254- 1259.

[17]

KELLY, D. H. 1979. Motion and vision II. Stabilized Spatio-temporal Threshold Surface. Opti. Soci. Ameri. 69, 10 (Oct.), pp. 1340-1349.

[18]

KOCH,C.AND ULLMAN, S. 1985. Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology 4, pp. 219-227.

[19]

LEVENTHAL, A. G. 1991. The neural basis of visual function. In Vision and Visual Dysfunction, vol. 4. CRC Press, Boca Raton, Fla.

[20]

LUBIN, J. 1995. A visual discrimination model for imaging system design and evaluation. In Vision Models for Target Detection and Recognition, E. Peli, Ed. World Scientific, New Jersey, pp. 245-283.

[21]

MCMILLAN, L. 1997. An image-based approach to 3D computer graphics. Ph.D. dissertation. University of North Carolina, Chapel Hill, N.C.

[22]

MEYER,G.W.AND LIU, A. 1992 Color spatial acuity control of a screen subdivision image synthesis algorithm. In Human Vision, Visual Processing and Digital Display III, B. E. Rogowitz, Ed. SPIE, vol. 1666, pp. 387-399.

[23]

MYSZKOWSKI, K. 1998. The visible differences predictor: Applications to global illumination problems. In Proceedings of the 9th Eurographics Workshop on Rendering (Vienna, Austria, June). Springer-Verlag, New York, pp. 223-236.

[24]

MYSZKOWSKI, K., ROKITA,P.,AND TAWARA, T. 1999. Perceptually-informed accelerated rendering of high quality walkthrough sequences. In Proceedings of the 10th Eurographics Workshop on Rendering (Grenada, Spain. June). Springer-Verlag, New York, pp. 5-18.

[25]

NIEBUR,E.AND KOCH, C. 1998. Computational architectures for attention. In The Attentive Brain, R. Parasuraman, Ed. MIT Press, Cambridge, Mass., pp. 164-186.

[26]

RAMASUBRAMANIAN, M., PATTANAIK,S.N.,AND GREENBERG, D. P. 1999. A perceptually based physical error metric for realistic image synthesis. In SIGGRAPH 99 Proceedings (Los Angeles, Calif.). ACM, New York, pp. 73-82.

[27]

TEKALP, A. M. 1995. Digital Video Processing. Prentice-Hall, Englewood Cliffs, N.J.

[28]

TSOTSOS, J. K., CULHANE, S. M., WAI,W.Y.K.,LAI, Y., DAVIS,N.,AND NUFLO, F. 1995. Modeling visual attention via selective tuning. In Artifi. Intell. 78, pp. 507-545.

[29]

WALLACH, D., KUNAPALLI,S.,AND COHEN, M. 1994. Accelerated MPEG compression of polygonal dynamic scenes. In SIGGRAPH 1994 Proceedings. ACM, New York, pp. 193-196.

[30]

WANDELL, B. 1995. Foundations of Vision. Sinauer Associates, Inc., Sunderland, MA.

[31]

WARD, G. 1988. Aray tracing solution for diffuse interreflection. In SIGGRAPH1988 Proceedings. ACM, New York, pp. 85-92.

[32]

WARD,G.AND HECKBERT, P. S. 1992. Irradiance gradients. In Proceedings of the 3rd Annual Eurographics Workshop on Rendering. Springer-Verlag, New York, pp. 85-98.

[33]

WARD-LARSON,G.AND SHAKESPEARE, R. 1998. Rendering with Radiance. Morgan-Kaufmann. San Francisco, Calif.

[34]

WARD-LARSON, G., RUSHMEIER, H., AND PIATKO, C. 1997. A visibility matching tone reproduction operator for high dynamic range scenes. IEE Trans. Vis. Comput. Graph. 3, 4, (Oct.), pp. 291-306.

[35]

YANTIS, S. 1996. Attentional capture in vision. In Converging Operations in the Study of Selective Visual Attention, A. Kramer, M. Coles, and G. Logan, Eds, American Psychological Association, Washington, D.C., pp. 45-76.

[36]

YARBUS, A. L. 1967. Eye Movements and Vision. Plenum Press, New York.

[37]

ZABIH,R.AND WOODFILL, J. 1994. Non-parametric local transforms for computing visual correspondence. In Proceedings of the 3rd European Conference on Computer Vision (Stockholm, Sweden, May), Vol. 2, Springer-Verlag, New York, pp. 151-158.

Cited By

Henriques HOliveira EClua ETrevisan D(2024)Analysing Hybrid Neural and Ray Tracing Perception for Foveated RenderingProceedings of the 26th Symposium on Virtual and Augmented Reality10.1145/3691573.3691580(21-30)Online publication date: 30-Sep-2024
https://dl.acm.org/doi/10.1145/3691573.3691580
Pflanzer YRitz MSantos PFellner D(2024)Progressively Streamed Real-time Preview of Captured Optical Surface Materials on the WebProceedings of the 29th International ACM Conference on 3D Web Technology10.1145/3665318.3677157(1-10)Online publication date: 25-Sep-2024
https://dl.acm.org/doi/10.1145/3665318.3677157
Korać MSalaün CGeorgiev IGrittmann PSlusallek PMyszkowski KSingh G(2023)Perceptual error optimization for Monte Carlo animation renderingSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618146(1-10)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.1145/3610548.3618146
Show More Cited By

Index Terms

Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics

Recommendations

Efficient Visibility Encoding for Dynamic Illumination in Direct Volume Rendering

We present an algorithm that enables real-time dynamic shading in direct volume rendering using general lighting, including directional lights, point lights, and environment maps. Real-time performance is achieved by encoding local and global volumetric ...
Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments

We present a new, real-time method for rendering diffuse and glossy objects in low-frequency lighting environments that captures soft shadows, interreflections, and caustics. As a preprocess, a novel global transport simulator creates functions over the ...
Efficient rendering of dynamic clouds
VRCAI '04: Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industry

In this paper, an efficient rendering framework for cloud is proposed. With a simplified lighting model, features such as self-shadowing and light scattering are stored in the Shadow Relation Table (SRT) and Metaball Lighting Texture Database (MLTDB) in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 20, Issue 1

Jan. 2001

65 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/383745

Editor:
Jessica Hodgins
Carnegie Mellon Univ., Pittsburgh, PA

Issue’s Table of Contents

Copyright © 2001 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 January 2001

Published in TOG Volume 20, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

234
Total Citations
View Citations
1,779
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)10

Reflects downloads up to 20 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Henriques HOliveira EClua ETrevisan D(2024)Analysing Hybrid Neural and Ray Tracing Perception for Foveated RenderingProceedings of the 26th Symposium on Virtual and Augmented Reality10.1145/3691573.3691580(21-30)Online publication date: 30-Sep-2024
https://dl.acm.org/doi/10.1145/3691573.3691580
Pflanzer YRitz MSantos PFellner D(2024)Progressively Streamed Real-time Preview of Captured Optical Surface Materials on the WebProceedings of the 29th International ACM Conference on 3D Web Technology10.1145/3665318.3677157(1-10)Online publication date: 25-Sep-2024
https://dl.acm.org/doi/10.1145/3665318.3677157
Korać MSalaün CGeorgiev IGrittmann PSlusallek PMyszkowski KSingh G(2023)Perceptual error optimization for Monte Carlo animation renderingSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618146(1-10)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.1145/3610548.3618146
Shi XWang LWu JKe WLam C(2023)Locomotion-aware Foveated Rendering2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00062(471-481)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00062
Yandrapally RMesbah A(2023)Fragment-Based Test Generation for Web AppsIEEE Transactions on Software Engineering10.1109/TSE.2022.317129549:3(1086-1101)Online publication date: 1-Mar-2023
https://dl.acm.org/doi/10.1109/TSE.2022.3171295
Gonçalves GMelo MMonteiro PCoelho HBessa M(2023)The role of different light settings on the perception of realism in virtual replicas in immersive Virtual RealityComputers and Graphics10.1016/j.cag.2023.10.021117:C(172-182)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1016/j.cag.2023.10.021
Wang LShi XLiu Y(2023)Foveated rendering: A state-of-the-art surveyComputational Visual Media10.1007/s41095-022-0306-49:2(195-228)Online publication date: 3-Jan-2023
https://doi.org/10.1007/s41095-022-0306-4
Shu ZYi SYang SLiu YLong WJin HXin SWu S(2022)Detecting Points of Interest on 3D Model via Alternating Optimization StrategyJournal of Computer-Aided Design & Computer Graphics10.3724/SP.J.1089.2022.1908234:07(1095-1107)Online publication date: 2-Dec-2022
https://doi.org/10.3724/SP.J.1089.2022.19082
Alahmadi M(2022)VID2META: Complementing Android Programming Screencasts with Code Elements and GUIsMathematics10.3390/math1017317510:17(3175)Online publication date: 3-Sep-2022
https://doi.org/10.3390/math10173175
Tursun CDidyk P(2022)Perceptual Visibility Model for Temporal Contrast Changes in PeripheryACM Transactions on Graphics10.1145/356424142:2(1-16)Online publication date: 22-Nov-2022
https://dl.acm.org/doi/10.1145/3564241
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents