[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

eyeSelfie: self directed eye alignment using reciprocal eye box imaging

Published: 27 July 2015 Publication History

Abstract

Eye alignment to the optical system is very critical in many modern devices, such as for biometrics, gaze tracking, head mounted displays, and health. We show alignment in the context of the most difficult challenge: retinal imaging. Alignment in retinal imaging, even conducted by a physician, is very challenging due to precise alignment requirements and lack of direct user eye gaze control. Self-imaging of the retina is nearly impossible.
We frame this problem as a user-interface (UI) challenge. We can create a better UI by controlling the eye box of a projected cue. Our key concept is to exploit the reciprocity, "If you see me, I see you", to develop near eye alignment displays. Two technical aspects are critical: a) tightness of the eye box and (b) the eye box discovery comfort. We demonstrate that previous pupil forming display architectures are not adequate to address alignment in depth. We then analyze two ray-based designs to determine efficacious fixation patterns. These ray based displays and a sequence of user steps allow lateral (x, y) and depth (z) wise alignment to deal with image centering and focus. We show a highly portable prototype and demonstrate the effectiveness through a user study.

Supplementary Material

ZIP File (a58-swedish.zip)
Supplemental files
MP4 File (a58.mp4)

References

[1]
Cui, J., Wang, Y., Huang, J., Tan, T., and Sun, Z. 2004. An iris image synthesis method based on pca and super-resolution. In Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on, vol. 4, IEEE, 471--474.
[2]
Deering, M. F. 2005. A photon accurate model of the human eye. ACM Trans. Graph. 24, 3, 649--658.
[3]
Dodgson, N. A. 2002. Analysis of the viewing zone of multiview autostereoscopic displays. In Electronic Imaging 2002, vol. 4660, International Society for Optics and Photonics, 254--265.
[4]
Filar, P., et al., 2011. Apparatus for photographing the anterior segment and retina of the eye through the use of a camera attachment. US Patent 7,883,210.
[5]
Giardini, M., Livingstone, I., Jordan, S., Bolster, N., Peto, T., Burton, M., and Bastawrous, A. 2014. A smartphone based ophthalmoscope. In Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE, 2177--2180.
[6]
Goldfain, E., Lagerway, W., Roberts, C., Slawson, S., and Krauter, A., 2005. Eye viewing device for large field viewing. US Patent 6,939,006.
[7]
Huang, F., Wetzstein, G., Barsky, B., and Raskar, R. 2014. Eyeglasses-free Display: Towards Correcting Visual Aberrations with Computational Light Field Displays. ACM Trans. Graph. 33, 4, 1--12.
[8]
2010. iExaminer for Panoptic. http://www.iexam.com/.
[9]
Ishihara, M., and Kogawa, T., 2008. Fundus camera. US Patent 7,377,642.
[10]
Itoh, Y., and Klinker, G. 2015. Light-field correction for spatial calibration of optical see-through head-mounted displays. Visualization and Computer Graphics, IEEE Transactions on 21, 4, 471--480.
[11]
Kadambi, A., Whyte, R., Bhandari, A., Streeter, L., Barsi, C., Dorrington, A., and Raskar, R. 2013. Coded time of flight cameras: sparse deconvolution to address multipath interference and recover time profiles. ACM Trans. Graph. 32, 6, 167.
[12]
Keeler, C. 1997. 150 years since babbage's ophthalmoscope. Archives of ophthalmology 115, 11, 1456.
[13]
Kress, B., and Starner, T. 2013. A review of head-mounted displays (hmd) technologies and applications for consumer electronics. vol. 8720, SPIE, 87200A--87200A--13.
[14]
Lanman, D., and Luebke, D. 2013. Near-eye light field displays. ACM Trans. Graph. 32, 6.
[15]
Lawson, E. M., and Raskar, R. 2014. Smart phone administered fundus imaging without additional imaging optics. Investigative Ophtalmology and Visual Science 55, 5, 1609.
[16]
Lee, I.-H., and Choi, T.-S. 2013. Accurate registration using adaptive block processing for multispectral images. Circuits and Systems for Video Technology, IEEE Transactions on 23, 9, 1491--1501.
[17]
Lee, I.-H., Shim, S.-O., and Choi, T.-S. 2013. Improving focus measurement via variable window shape on surface radiance distribution for 3d shape reconstruction. Optics and Lasers in Engineering 51, 5, 520--526.
[18]
Lee, I., Tariq Mahmood, M., and Choi, T.-S. 2013. Adaptive window selection for 3d shape recovery from image focus. Optics & Laser Technology 45, 21--31.
[19]
Lefohn, A., Budge, B., Shirley, P., Caruso, R., and Reinhard, E. 2003. An ocularist's approach to human iris synthesis. Computer Graphics and Applications, IEEE 23, 6, 70--75.
[20]
Maimone, A., Lanman, D., Rathinavel, K., Keller, K., Luebke, D., and Fuchs, H. 2014. Pinlight displays: Wide field of view augmented reality eyeglasses using defocused point light sources. ACM Trans. Graph. 33, 4, 89:1--89:11.
[21]
Makthal, S., and Ross, A. 2005. Synthesis of iris images using markov random fields. In Proc. 13th European Signal Processing Conf, Citeseer.
[22]
Pamplona, V., Oliveira, M., and Baranoski, G. 2009. Photorealistic models for pupil light reflex and iridal pattern deformation. ACM Trans. Graph. 28, 4, 106.
[23]
Pamplona, V., Mohan, A., Oliveira, M., and Raskar, R. 2010. Netra: interactive display for estimating refractive errors and focal range. ACM Trans. Graph. 29, 4, 77.
[24]
Pamplona, V., Passos, E., Zizka, J., Oliveira, M., Lawson, E., Clua, E., and Raskar, R. 2011. Catra: interactive measuring and modeling of cataracts. ACM Trans. Graph. 30, 4, 47.
[25]
Pamplona, V. F., Oliveira, M. M., Aliaga, D. G., and Raskar, R. 2012. Tailored displays to compensate for visual aberrations. ACM Trans. Graph. 31, 4 (July), 81:1--81:12.
[26]
Pertuz, S., Puig, D., and Garcia, M. A. 2013. Analysis of focus measure operators for shape-from-focus. Pattern Recognition 46, 5, 1415--1432.
[27]
2014. Volk Pictor Plus Portable Retinal Camera. http://www.volk.com/.
[28]
Plopski, A., Itoh, Y., Nitschke, C., Kiyokawa, K., Klinker, G., and Takemura, H. 2015. Corneal-imaging calibration for optical see-through head-mounted displays. Visualization and Computer Graphics, IEEE Transactions on 21, 4, 481--490.
[29]
Ritschel, T., Ihrke, M., Frisvad, J., Coppens, J., Myszkowski, K., and Seidel, H. 2009. Temporal glare: Real-time dynamic simulation of the scattering in the human eye. In Computer Graphics Forum, vol. 28, 183--192.
[30]
Sagar, M., Bullivant, D., Mallinson, G., and Hunter, P. 1994. A virtual environment and model of the eye for surgical simulation. In Proceedings of the 21st annual conference on Computer graphics and interactive techniques, ACM, 205--212.
[31]
Samaniego, A., Boominathan, V., Sabharwal, A., and Veeraraghavan, A. 2014. mobilevision: A face-mounted, voice-activated, non-mydriatic lucky ophthalmoscope. In Proceedings of the Wireless Health 2014 on National Institutes of Health, ACM, 1--8.
[32]
Tran, K., Mendel, T. A., Holbrook, K. L., and Yates, P. A. 2012. Construction of an inexpensive, hand-held fundus camera through modification of a consumer "point-and-shoot" camerapoint-and-shoot hand-held fundus camera. IOVS 53, 12, 7600.
[33]
Unar, J. A., Seng, W. C., and Abbasi, A. 2014. A review of biometric technology along with trends and prospects. Pattern Recognition 47, 8 (8), 2673--2688.
[34]
Upatnieks, J., and Tai, A. M. 1997. Development of the holographic sight. vol. 2968, SPIE, 272--281.
[35]
Wecker, L., Samavati, F., and Gavrilova, M. 2005. Iris synthesis: a reverse subdivision application. In Proceedings of the 3rd international conference on Computer graphics and interactive techniques in Australasia and South East Asia, ACM, 121--125.
[36]
Woittennek, F., Knobbe, J., Pugner, T., Dallmann, H.-G., Schelinski, U., and Gruger, H. 2015. Mems scanner mirror based system for retina scanning and in eye projection. In Proceedings of the SPIE, vol. 9375, 937506.
[37]
W. Y. Lam, M., and V. G. Baranoski, G. 2006. A predictive light transport model for the human iris. Computer Graphics Forum 25, 3, 359--368.

Cited By

View all

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 34, Issue 4
August 2015
1307 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/2809654
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2015
Published in TOG Volume 34, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. fundus photography
  2. head mounted display
  3. human computer interaction
  4. retina

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)19
  • Downloads (Last 6 weeks)6
Reflects downloads up to 01 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Eye-Based Vascular PatternsEncyclopedia of Cryptography, Security and Privacy10.1007/978-3-030-71522-9_1738(857-860)Online publication date: 8-Jan-2025
  • (2021)Telemedicine in diabetic retinopathy screening in IndiaIndian Journal of Ophthalmology10.4103/ijo.IJO_1442_2169:11(2977)Online publication date: 2021
  • (2021)EyelashNetACM Transactions on Graphics10.1145/3478513.348054040:6(1-17)Online publication date: 10-Dec-2021
  • (2021)Eye-based Vascular PatternsEncyclopedia of Cryptography, Security and Privacy10.1007/978-3-642-27739-9_1738-1(1-4)Online publication date: 7-Feb-2021
  • (2020)Could telehealth help eye care practitioners adapt contact lens services during the COVID-19 pandemic?Contact Lens and Anterior Eye10.1016/j.clae.2020.04.002Online publication date: Apr-2020
  • (2019)Venen BiometrieDatenschutz und Datensicherheit - DuD10.1007/s11623-019-1215-244:1(16-22)Online publication date: 13-Dec-2019
  • (2019)A New Compact Optical System Proposal and Image Quality Comparison Against Other Affordable Non-mydriatic Fundus CamerasBiomedical Engineering Systems and Technologies10.1007/978-3-030-29196-9_2(26-48)Online publication date: 13-Aug-2019
  • (2019)State of the Art in Vascular BiometricsHandbook of Vascular Biometrics10.1007/978-3-030-27731-4_1(3-61)Online publication date: 14-Nov-2019
  • (2018)Technology-enabled examinations of cardiac rhythm, optic nerve, oral health, tympanic membrane, gait and coordination evaluated jointly with routine health screenings: an observational study at the 2015 Kumbh Mela in IndiaBMJ Open10.1136/bmjopen-2017-0187748:4(e018774)Online publication date: 20-Apr-2018
  • (2016)Current and Next Generation Portable Screening Devices for Diabetic RetinopathyJournal of Diabetes Science and Technology10.1177/193229681662915810:2(295-300)Online publication date: 16-Feb-2016
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media