More Web Proxy on the site http://driver.im/

research-article

Vision enhancement: defocus correction via optical see-through head-mounted displays

Authors:

Gudrun KlinkerAuthors Info & Claims

AH '15: Proceedings of the 6th Augmented Human International Conference

Pages 1 - 8

https://doi.org/10.1145/2735711.2735787

Published: 09 March 2015 Publication History

Abstract

Vision is our primary, essential sense to perceive the real world. Human beings have been keen to enhance the limit of the eye function by inventing various vision devices such as corrective glasses, sunglasses, telescopes, and night vision goggles. Recently, Optical See-Through Head-Mounted Displays (OST-HMD) have penetrated in the commercial market. While the traditional devices have improved our vision by altering or replacing it, OST-HMDs can augment and mediate it. We believe that future OST-HMDs will dramatically improve our vision capability, combined with wearable sensing systems including image sensors.

For taking a step toward this future, this paper investigates Vision Enhancement (VE) techniques via OST-HMDs. We aim at correcting optical defects of human eyes, especially defocus, by overlaying a compensation image on the user's actual view so that the filter cancels the aberration. Our contributions are threefold. Firstly, we formulate our method by taking the optical relationships between OST-HMD and human eye into consideration. Secondly, we demonstrate the method in proof-of-concept experiments. Lastly and most importantly, we provide a thorough analysis of the results including limitations of the current system, potential research issues necessary for realizing practical VE systems, and possible solutions for the issues for future research.

References

[1]

Amano, T., and Kato, H. Appearance control by projector camera feedback for visually impaired. In CVPRW, IEEE (2010), 57--63.

[2]

Asai, N., Matsuda, R., Watanabe, M., Takayama, H., Yamada, S., Mase, A., Shikida, M., Sato, K., Lebedev, M., and Akedo, J. Novel high resolution optical scanner actuated by aerosol deposited pzt films. In Micro Electro Mechanical Systems (MEMS), IEEE (2003), 247--250.

[3]

Avery, B., Sandor, C., and Thomas, B. H. Improving spatial perception for augmented reality x-ray vision. In VR (2009), 79--82.

[4]

Baričević, D., Lee, C., Turk, M., Höllerer, T., and Bowman, D. A. A hand-held ar magic lens with user-perspective rendering. In ISMAR (2012), 197--206.

Digital Library

[5]

Bennett, M., and Quigley, A. Creating personalized digital human models of perception for visual analytics. In User Modeling, Adaption and Personalization. Springer, 2011, 25--37.

Digital Library

[6]

Bimber, O., and Iwai, D. Superimposing dynamic range. In TOG, vol. 27 (2008), 150.

Digital Library

[7]

Bimber, O., Iwai, D., Wetzstein, G., and Grundhöfer, A. The visual computing of projector-camera systems. In Computer Graphics Forum, vol. 27, Wiley Online Library (2008), 2219--2245.

Digital Library

[8]

Broecker, M., Smith, R. T., and Thomas, B. H. Adaptive substrate for enhanced spatial augmented reality contrast and resolution. In ISMAR (2011), 251--252.

Digital Library

[9]

David Hincapie-Ramos, J., Ivanchuk, L., Sridharan, S. K., and Irani, P. Smartcolor: Real-time color correction and contrast for optical see-through head-mounted displays. In ISMAR (2014), 187--194.

[10]

Fujimori, N., and Ando, S. Super-resolution reconstruction algorithm using vibro-imaging and correlation image sensor. In Society of Instrument and Control Engineers (SICE), Annual Conference on, IEEE (2012), 2028--2033.

[11]

Giusti, A., Taddei, P., Corani, G., Gambardella, L., Magli, C., and Gianaroli, L. Artificial defocus for displaying markers in microscopy z-stacks. In TVCG, vol. 17 (2011), 1757--1764.

Digital Library

[12]

Grimm, B., Goelz, S., Bille, J. F., et al. Objective measurement of wave aberrations of the human eye with the use of a hartmann-shack wave-front sensor. The Journal of the Optical Society of America A (JOSA A) 11, 7 (1994), 1949--1957.

[13]

Huang, F.-C., Wetzstein, G., Barsky, B. A., and Raskar, R. Computational light field display for correcting visual aberrations. In SIGGRAPH Posters (2013), 40.

Digital Library

[14]

Hwang, A. D., and Peli, E. An augmented-reality edge enhancement application for google glass. Optometry & Vision Science 91, 8 (2014), 1021--1030.

[15]

Itoh, Y., and Klinker, G. Interaction-free calibration for optical see-through head-mounted displays based on 3d eye localization. In 3DUI (2014), 75--82.

[16]

Koizumi, N., Sugimoto, M., Nagaya, N., Inami, M., and Furukawa, M. Stop motion goggle: augmented visual perception by subtraction method using high speed liquid crystal. In AH (2012), 14.

Digital Library

[17]

Lombardo, M., and Lombardo, G. Wave aberration of human eyes and new descriptors of image optical quality and visual performance. Journal of Cataract & Refractive Surgery (JCRS) 36, 2 (2010), 313--331.

[18]

Nitschke, C., Nakazawa, A., and Takemura, H. Corneal imaging revisited: An overview of corneal reflection analysis and applications. Information and Media Technologies 8, 2 (2013), 389--406.

[19]

Oskiper, T., Sizintsev, M., Branzoi, V., Samarasekera, S., and Kumar, R. Augmented reality binoculars. In ISMAR (Oct 2013), 219--228.

[20]

Oyamada, Y., and Saito, H. Defocus blur correcting projector-camera system. In Advanced Concepts for Intelligent Vision Systems, Springer (2008), 453--464.

Digital Library

[21]

Pamplona, V. F., Mohan, A., Oliveira, M. M., and Raskar, R. Netra: interactive display for estimating refractive errors and focal range. In TOG, vol. 29 (2010), 77.

Digital Library

[22]

Pamplona, V. F., Oliveira, M. M., Aliaga, D. G., and Raskar, R. Tailored displays to compensate for visual aberrations. In TOG, vol. 31 (2012), 81.

Digital Library

[23]

Peli, E. Vision multiplexing: an engineering approach to vision rehabilitation device development. Optometry & Vision Science 78, 5 (2001), 304--315.

[24]

Peli, E. Treating with spectacle lenses: a novel idea!? Optometry & Vision Science 79, 9 (2002), 569--580.

[25]

Platt, B. C., et al. History and principles of shack-hartmann wavefront sensing. Journal of Refractive Surgery 17, 5 (2001), S573--S577.

[26]

Sajadi, B., Gopi, M., and Majumder, A. Edge-guided resolution enhancement in projectors via optical pixel sharing. In TOG, vol. 31 (2012), 79.

Digital Library

[27]

Shimizu, S., and Fujiyoshi, H. Acquisition of 3d gaze information from eyeball movements using inside-out camera. In AH (2011), 6.

Digital Library

[28]

Sridharan, S. K., Hincapié-Ramos, J. D., Flatla, D. R., and Irani, P. Color correction for optical see-through displays using display color profiles. In VRST (2013), 231--240.

Digital Library

[29]

Suryakumar, R., Meyers, J. P., Irving, E. L., and Bobier, W. R. Application of video-based technology for the simultaneous measurement of accommodation and vergence. Vision research 47, 2 (2007), 260--268.

[30]

Tomioka, M., Ikeda, S., and Sato, K. Approximated user-perspective rendering in tablet-based augmented reality. In ISMAR (2013), 21--28.

[31]

Westheimer, G. The maxwellian view. Vision research 6, 11 (1966), 669--682.

Cited By

Luo YWang JPan YLuo SIrani PLiang H(2024)Visual augmentation of live-streaming images in virtual reality to enhance teleoperation of unmanned ground vehiclesFrontiers in Virtual Reality10.3389/frvir.2024.12308855Online publication date: 7-Oct-2024
https://doi.org/10.3389/frvir.2024.1230885
Langlotz TSutton JRegenbrecht H(2024)A Design Space for Vision Augmentations and Augmented Human Perception using Digital EyewearProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642380(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642380
Csoba IKunkli R(2023)Rendering algorithms for aberrated human vision simulationVisual Computing for Industry, Biomedicine, and Art10.1186/s42492-023-00132-96:1Online publication date: 17-Mar-2023
https://doi.org/10.1186/s42492-023-00132-9
Show More Cited By

Index Terms

Vision enhancement: defocus correction via optical see-through head-mounted displays
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
  2. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

AdaptiVisor: assisting eye adaptation via occlusive optical see-through head-mounted displays
AH '17: Proceedings of the 8th Augmented Human International Conference

Brightness adaptation is a fundamental ability in human visual system, and adjusts various levels of darkness and light. While this ability is continuously used, and it can mostly handle sudden lighting changes in the environment, the adaptation could ...
Experiencing Social Augmented Reality in Public Spaces
UbiComp/ISWC '21 Adjunct: Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers

We present various views on the future use of augmented reality in public spaces. The views address enhanced walking, social activity, appropriation of public spaces, and futuristic social aspects of future outdoor augmented reality. Although we often ...
Eye-Perspective View Management for Optical See-Through Head-Mounted Displays
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Optical see-through (OST) head-mounted displays (HMDs) enable users to experience Augmented Reality (AR) support in the form of helpful real-world annotations. Unfortunately, the blend of the environment with virtual augmentations due to semitransparent ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

AH '15: Proceedings of the 6th Augmented Human International Conference

March 2015

241 pages

ISBN:9781450333498

DOI:10.1145/2735711

General Chairs:
Suranga Nanayakkara
Singapore University of Technology and Design (Singapore)
,
Ellen Yi-Luen Do
Georgia Institute of Technology & National University of Singapore (Singapore)
,
Program Chairs:
Jun Rekimoto
The University of Tokyo (Japan)
,
Jochen Huber
MIT Media Lab & Singapore University of Technology and Design (Singapore)
,
Bing-Yu Chen
National Taiwan University (Taiwan)

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 March 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Seventh Framework Programme

Conference

AH '15

AH '15: The 6th Augmented Human International Conference

March 9 - 11, 2015

Singapore, Singapore

Acceptance Rates

Overall Acceptance Rate 121 of 306 submissions, 40%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
693
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)5

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Luo YWang JPan YLuo SIrani PLiang H(2024)Visual augmentation of live-streaming images in virtual reality to enhance teleoperation of unmanned ground vehiclesFrontiers in Virtual Reality10.3389/frvir.2024.12308855Online publication date: 7-Oct-2024
https://doi.org/10.3389/frvir.2024.1230885
Langlotz TSutton JRegenbrecht H(2024)A Design Space for Vision Augmentations and Augmented Human Perception using Digital EyewearProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642380(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642380
Csoba IKunkli R(2023)Rendering algorithms for aberrated human vision simulationVisual Computing for Industry, Biomedicine, and Art10.1186/s42492-023-00132-96:1Online publication date: 17-Mar-2023
https://doi.org/10.1186/s42492-023-00132-9
Stöhr MDekowski DBechrakis NOeverhaus MEckstein A(2023)Evaluation of a retinal projection laser eyewear in subjects with visual impairment caused by corneal diseases in a randomized trialOphthalmology10.1016/j.ophtha.2023.11.011Online publication date: Nov-2023
https://doi.org/10.1016/j.ophtha.2023.11.011
Csoba IKunkli R(2023)Fast rendering of central and peripheral human visual aberrations across the entire visual field with interactive personalizationThe Visual Computer10.1007/s00371-023-03060-040:5(3709-3731)Online publication date: 29-Sep-2023
https://doi.org/10.1007/s00371-023-03060-0
Yamamoto KSuzuki INamikawa KSato KOchiai Y(2021)Interactive Eye Aberration Correction for Holographic Near-Eye DisplayProceedings of the Augmented Humans International Conference 202110.1145/3458709.3458955(204-214)Online publication date: 22-Feb-2021
https://dl.acm.org/doi/10.1145/3458709.3458955
Itoh YLanglotz TZollmann SIwai DKiyoshi KAmano T(2021)Computational Phase-Modulated EyeglassesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2019.294703827:3(1916-1928)Online publication date: 1-Mar-2021
https://doi.org/10.1109/TVCG.2019.2947038
Vatavu RRusu PSchipor OSchipor M(2021)Preferences of people with visual impairments for augmented and mediated vision: A vignette experimentMultimedia Tools and Applications10.1007/s11042-021-11498-483:15(46531-46556)Online publication date: 15-Sep-2021
https://doi.org/10.1007/s11042-021-11498-4
Pamparău CVatavu R(2021)FlexiSee: flexible configuration, customization, and control of mediated and augmented vision for users of smart eyewear devicesMultimedia Tools and Applications10.1007/s11042-020-10164-5Online publication date: 2-Jan-2021
https://doi.org/10.1007/s11042-020-10164-5
Koulieris GAkşit KStengel MMantiuk RMania KRichardt C(2019)Near‐Eye Display and Tracking Technologies for Virtual and Augmented RealityComputer Graphics Forum10.1111/cgf.1365438:2(493-519)Online publication date: 7-Jun-2019
https://doi.org/10.1111/cgf.13654
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents