[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
article

Survey Representing information - Classifying the Augmented Reality presentation space

Published: 01 December 2013 Publication History

Abstract

Augmented Reality has a wide-ranging presentation space. In addition to presenting virtual information in a 3D space, such information can also be placed in relation to physical objects, locations or events. Decomposing this presentation space - or more exactly, the principles of how information is represented in Augmented Reality - into unique and independent dimensions provides a fundamental spectrum of options. First, this decomposition facilitates a fine-grained analysis of effects on human understanding. Second, multiple factors, given by multiple differences between different presentation systems with respect to more than one such principle, can be determined and properly addressed. Third, this decomposition facilitates a determination of new fields of research by identifying not-yet-used concepts. Since the beginning of Augmented Reality research, a growing number of applications have emerged that exploit various ways to represent information. This paper resumes this development and presents a set of independent dimensions covering representation principles of virtual information related to a physical environment: the temporality of virtual information, dimensionality, the frame of reference, mounting/registration and the type of reference. The suitability of the devised dimensions is tested by categorizing a wide variety of AR applications. The categorized data is analyzed for the most-often and less-frequently used combinations of classes. In particular, the classes that have not yet been used exhibit the potential to allow future work that investigates new options for information presentation.

References

[1]
Azuma, R., A survey of augmented reality. Presence Teleoper Virtual Environ. v6 i4. 355-385.
[2]
Kalawsky R, Stedmon A, Hill K, Cook C. A taxonomy of technology: defining augmented reality. In: Proceedings of the human factors and ergonomics society annual meeting, vol. 44, SAGE Publications, 2000. p. 507-10.
[3]
Milgram, P. and Kishino, F., A taxonomy of mixed reality visual displays. IEICE Trans Inf Syst E Ser D. v77. 1321
[4]
Milgram P, Colquhoun H. A taxonomy of real and virtual world display integration. In: Mixed reality - merging real and virtual worlds, 1999. p. 1-16.
[5]
Dubois E, Nigay L, Augmented reality: which augmentation for which reality? In: Designing augmented reality environments, 2000. p. 165-6.
[6]
Dubois E, Nigay L, Troccaz J, Chavanon O, Carrat L. Classification space for augmented surgery, an augmented reality case study. In: Proceedings of the 13 international conference on human-computer interaction (INTERACT), vol. 1, IOS Press Inc, 1999. p. 353-9.
[7]
Weiser, M., The computer for the 21st century. Sci Am. 94-104.
[8]
Newman J, Bornik A, Pustka D, Echtler F, Huber M, Schmalstieg D, Klinker G. Tracking for distributed mixed reality environments. In: Workshop on trends and issues in tracking for virtual environments at the IEEE virtual reality conference (VR), 2007.
[9]
Zhou F, Duh H, Billinghurst M. Trends in augmented reality tracking, interaction and display: a review of ten years of ISMAR. In: Proceedings of ISMAR, IEEE Computer Society, 2008. p. 193-02.
[10]
Kruijff E, Swan JE, Feiner S. Perceptual issues in augmented reality revisited. In: Proceedings of ISMAR, IEEE, 2010. p. 3-12.
[11]
Wither, J., DiVerdi, S. and Höllerer, T., Annotation in outdoor augmented reality. Comput Graph. v33 i6. 679-689.
[12]
F. Hansen. Ubiquitous annotation systems: technologies and challenges. In: Proceedings of the 17th conference on hypertext and hypermedia, ACM, 2006. p. 121-32.
[13]
Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S. and MacIntyre, B., Recent advances in augmented reality. Comput Graph Appl. v21 i6. 34-47.
[14]
Biocca F. The space of cognitive technology: the design medium and cognitive properties of virtual space. In: Cognitive technology, 2001. p. 55-6.
[15]
Spence, R., Information visualization: design for interaction. . 2006. Prentice Hall.
[16]
Bertin J. Semiology of graphics: diagrams, networks, maps.
[17]
Ishii H. Tangible bits: beyond pixels. In: Proceedings of the international conference on tangible and embedded interaction, ACM, 2008. p. xv-xxv.
[18]
Card, S., Mackinlay, J. and Robertson, G., A morphological analysis of the design space of input devices. ACM Trans Inf Syst (TOIS). v9 i2. 99-122.
[19]
Billinghurst, M., Kato, H. and Poupyrev, I., The MagicBook - moving seamlessly between reality and virtuality. Comput Graph Appl. v21 i3. 6-8.
[20]
Milgram P, Zhai S, Drascic D, Grodski J. Applications of augmented reality for human-robot communication. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems, vol. 3, IEEE, 1993. p. 1467-72.
[21]
Sheridan T. Human and computer roles in supervisory control and telerobotics: musings about function, language and hierarchy. In: Tasks, errors and mental models, Taylor & Francis, 1988.
[22]
Bowman, D., Kruijff, E., LaViola, J.J. and Poupyrev, I., 3D user interfaces: theory and practice. . 2004. Addison Wesley.
[23]
Looser J, Billinghurst M, Cockburn A. Through the looking glass: the use of lenses as an interface tool for augmented reality interfaces. In: Proceedings of the 2nd international conference on computer graphics and interactive techniques in Australia and South East Asia, ACM, 2004. p. 204-11.
[24]
Bier EA, Stone MC, Pier KA, Buxton W, DeRose T. Toolglass and magic lenses: the see-through interface. In: SIGGRAPH, 1993. p. 73-80.
[25]
Henderson S, Feiner S. Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret. In: Proceedings of ISMAR, IEEE, 2009. p. 135-44.
[26]
Horrey, W. and Wickens, C., Driving and side task performance: the effects of display clutter, separation, and modality, human factors. . J Hum Factors Ergon Soc. v46 i4. 611-624.
[27]
Lerner N, Dekker D, Steinberg G, Huey R. Inappropriate alarm rates and driver annoyance, DTNH22-91-C-07004, 1996.
[28]
Cameron B, Sandor C, Mickan P. Social semiotic analysis of the design space of augmented reality. In: International symposium on mixed and augmented reality - arts, media, and humanities, IEEE, 2011. p. 105-6.
[29]
Bell B, Feiner S, Höllerer T. View management for virtual and augmented reality. In: Proceedings of UIST, ACM, 2001. p. 101-10.
[30]
Wither J, Coffin C, Ventura J, Höllerer T. Fast annotation and modeling with a single-point laser range finder. In: Proceedings of ISMAR, IEEE, 2008. p. 65-8.
[31]
Feiner S, MacIntyre B, Haupt M, Solomon E. Windows on the world: 2D windows for 3D augmented reality. In: Proceedings of UIST, ACM, 1993. p. 145-55.
[32]
Wickens CD. Situation awareness: impact of automation and display technology. In: AGARD conference proceedings 575: situation awareness: limitations and enhancement in the aviation environment, 1996. p. K2-1-13.
[33]
Barfield, W., Rosenberg, C. and Furness, TA., Situation awareness as a function of frame of reference, computer-graphics eyepoint elevation, and geometric field of view. Int J Aviat Psychol. v5 i3. 233-256.
[34]
Bell B, Höllerer T, Feiner S. An annotated situation-awareness aid for augmented reality. In: Proceedings of UIST, ACM, 2002. p. 213-6.
[35]
Milgram P, Colquhoun H. A taxonomy of real and virtual world display integration. In: Mixed reality-merging real and virtual worlds, Chiyodaku, Tokyo & New York: Ohmsha, Ltd. & Springer-Verlag; 1999. p. 5-30.
[36]
Lamb M, Hollands JG. Viewpoint tethering in complex terrain navigation and awareness. In: 9th annual meeting of the human factors and ergonomics society, 2005.
[37]
Colquhoun H, Jr., Milgram P. Dynamic tethering for enhanced remote control and navigation. In: Proceedings of HFES, vol. 44, SAGE Publications, 2000. p. 146-9.
[38]
Baricevic D, Lee C, Turk M, Hollerer T, Bowman DA. A hand-held AR magic lens with user-perspective rendering. In: International symposium on mixed and augmented reality, IEEE, 2012. p. 197-206.
[39]
Shepard, R. and Metzler, J., Mental rotation of three-dimensional objects. Science. v171 i3972. 701-703.
[40]
Hill A, Schiefer J, Wilson J, Davidson B, Gandy M, MacIntyre B. Virtual transparency: introducing parallax view into video see-through AR. In: International symposium on mixed and augmented reality (ISMAR), IEEE, 2011. p. 239-40.
[41]
MacWilliams A, Sandor C, Wagner M, Bauer M, Klinker G, Brügge B, Herding sheep: live system development for distributed augmented reality. In: Proceedings of ISMAR, 2003. p. 123-32.
[42]
Schwerdtfeger B, Klinker G. Supporting order picking with augmented reality. In: Proceedings of ISMAR, 2008.
[43]
Curtis D, Mizell D, Gruenbaum P, Janin A. Several devils in the details: making an AR application work in the airplane factory. In: Proceedings of IWAR, AK Peters, Ltd., 1999. p. 47-60.
[44]
Kalkofen, D., Mendez, E. and Schmalstieg, D., Comprehensible visualization for augmented reality. IEEE Trans Vis Comput Graph. v15 i2. 193-204.
[45]
Platonov J, Heibel H, Meier P, Grollmann B, A mobile Markerless AR system for maintenance and repair. In: Proceedings of ISMAR, IEEE Computer Society, 2006. p. 105-8.
[46]
Reiners D, Stricker D, Klinker G, Müller S. Augmented reality for construction tasks: doorlock assembly. In: Proceedings of IWAR, 1998. p. 31-46.
[47]
Closed-form solution of absolute orientation using unit quaternions. J Opt Soc Am. v4 i4. 629-642.
[48]
Phillips JM. Survey of absolute orientation techniques, 2004.
[49]
Miyashita T, Meier P, Tachikawa T, Orlic S, Eble T, Scholz V, et al. An augmented reality museum guide. In: Proceedings of ISMAR, IEEE Computer Society, 2008. p. 103-6.
[50]
Cunningham A, Thomas B. Target motion analysis visualisation. In: Proceedings of the Asia-Pacific symposium on information visualisation, Australian Computer Society, Inc., 2005. p. 81-90.
[51]
Pedersen I. Radiating centers: augmented reality and human-centric design. In: Proceedings of ISMAR, IEEE, 2009. p. 11-6.
[52]
Biocca F, Lamas DR, Gai P, Brady R. Mapping the semantic asymmetries of virtual and augmented reality space. In: Cognitive technology, 2001. p. 117-22.
[53]
Magerko, B., Measuring dramatic believability. Intell Narrative Technol. 79-82.
[54]
A novel approach to automatic layout for user interface elements in augmented reality. 2005. ISMAR.
[55]
Benford S. A spatial model of interaction in large virtual environments. In: Proceedings of the third European conference on computer-supported cooperative work, Springer, 1993.
[56]
Livingston, M.A., Ai, Z., Karsch, K. and Gibson, G.O., User interface design for military AR applications. Virtual Reality. v15 i2-3. 175-184.
[57]
An evaluation of graphical context as a means for ameliorating the effects of registration error. IEEE Trans Vis Comput Graph. v15 i2. 179-192.
[58]
Livingston M, Ai Z. The effect of registration error on tracking distant augmented objects. In: Proceedings of ISMAR, IEEE Computer Society, 2008. p. 77-86.
[59]
Coelho E, Maclntyre B, Julier S. OSGAR: a scene graph with uncertain transformations. In: International symposium on mixed and augmented reality (ISMAR), IEEE, 2004. p. 6-15.
[60]
Bauer M, Schlegel M, Pustka D, Navab N, Klinker G. Predicting and estimating the accuracy of vision-based optical tracking systems. In: Proceedings of IEEE international symposium on mixed and augmented reality (ISMAR), Santa Barbara (CA), USA, 2006.
[61]
Grabowski C, Zamojdo T. En-route navigation display method and apparatus using head-up display. World Intellectual Property Organization, Patent WO 2005/121707 A2; 2005.
[62]
Bergmeier U. Augmented reality in vehicles - technical realisation of a contact analogue head-up display under automotive capable aspects; usefulness exemplified through night vision systems. In: Proceedings of 32nd World Automotive Congress (FISITA), 2008.
[63]
Tönnis M. Towards automotive augmented reality (Dissertation), Technische Universität München; Nov 2008.
[64]
Tönnis M, Lange C, Klinker G. Visual longitudinal and lateral driving assistance in the head-up display of cars. In: Proceedings of ISMAR, 2007.
[65]
Liu S, Cheng D, Hua H. An optical see-through head mounted display with addressable focal planes. In: Proceedings of ISMAR, IEEE, 2008. p. 33-42.
[66]
Hallaway, D., Feiner, S. and Höllerer, T., Bridging the gaps: hybrid tracking for adaptive mobile augmented reality. . Appl Artif Intell. v18 i6. 477-500.
[67]
Henderson, S. and Feiner, S., Exploring the benefits of augmented reality documentation for maintenance and Repair. IEEE Trans Vis Comput Graph. v17 i1. 1355-1368.
[68]
Höllerer, T., Feiner, S., Terauchi, T., Rashid, G. and Hallaway, D., Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system. . Comput Graph Pergamon. v23 i6. 779-785.
[69]
Mansoux B, Nigay L, Troccaz J. Abstract and concrete interaction with Mixed Reality systems. The case of the mini-screen, a new interaction device in computer assisted surgery. Proceedings of the IUI-CADUI Workshop on Exploring the Design and Engineering of Mixed Reality Systems (MIXER), 2004;12-8
[70]
Engelke T, Webel S, Gavish N. Generating vision based lego augmented reality training and evaluation systems. In: Proceedings of ISMAR, IEEE, 2010. p. 223-4.
[71]
Robertson C, MacIntyre B, Walker B. An evaluation of graphical context when the graphics are outside of the task area. In: Proceedings of ISMAR, IEEE, 2008. p. 73-6.
[72]
AIST Japan. "Three dimensional images in the air - visualization of real 3D Images" using laser plasma, {http://www.aist.go.jp/aist_e/latest_research/2006/20060210/20060210.html};2012 {accessed Oct 15, 2012}.
[73]
Schall G, Mendez E, Junghanns S, Schmalstieg D. Urban 3D models: what's underneath? handheld augmented reality for subsurface infrastructure visualization. In: Proceedings of Ubicomp, 2007.
[74]
Julier S, Lanzagorta M, Baillot Y, Rosenblum L, Feiner S, Höllerer T, et al. Information filtering for mobile augmented reality. In: Proceedings of ISAR, IEEE, 2000. p. 3-11.
[75]
Livingston M, Swan J, II, Gabbard J, Höllerer T, Hix D, Julier S, et al. Resolving multiple occluded layers in augmented reality. In: Proceedings of ISMAR, IEEE Computer Society, 2003. p. 56.
[76]
Barnum P, Sheikh Y, Datta A, Kanade T. Dynamic seethroughs: synthesizing hidden views of moving objects. In: Proceedings of ISMAR, IEEE, 2009. p. 111-4.
[77]
Elmqvist, N. and Tsigas, P., A taxonomy of 3D occlusion management for visualization. IEEE Trans Vis Comput Graph. v14 i5. 1095-1109.
[78]
Fuchs H, Livingston M, Raskar R, Colucci D, Keller K, State A, et al. Augmented reality visualization for laparoscopic surgery. In: Medical image computing and computer-assisted interventation (MICCAI), 1998. p. 934-43.
[79]
Feiner, S. and Seligmann, D., Cutaways and ghosting: satisfying visibility constraints in dynamic 3d illustrations. . Visual Comput. v8 i5. 292-302.
[80]
Sandor C, Cunningham A, Dey A, Mattila V. An augmented reality X-ray system based on visual saliency. In: Proceedings of ISMAR, IEEE, 2010. p. 27-36.
[81]
Bichlmeier C, Wimmer F, Heining S, Navab N. Contextual anatomic mimesis: hybrid in-situ visualization method for improving multi-sensory depth perception in medical augmented reality. In: Proceedings of ISMAR, 2007. p. 129-38.
[82]
Zollmann S, Kalkofen D, Mendez E, Reitmayr G. Image-based ghostings for single layer occlusions in augmented reality. In: Proceedings of ISMAR, IEEE, 2010. p. 19-26.
[83]
Avery B, Sandor C, Thomas BH. Improving spatial perception for augmented reality X-ray vision. In: Proceedings of VR, Lafayette, Louisiana, USA, 2009. p. 79-82.
[84]
Bell B, Feiner S. Dynamic space management for user interfaces. In: Proceedings of UIST, ACM, 2000. p. 239-48.
[85]
Tönnis M, Klinker G. Effective control of a car driver's attention for visual and acoustic guidance towards the direction of imminent dangers. In: Proceedings of ISMAR, 2006.
[86]
Echtler F, Sturm F, Kindermann K, Klinker G, Stilla J, Trilk J, et al. The intelligent welding: gun augmented reality for experimental vehicle construction. In: Virtual and Augmented Reality Applications in Manufacturing, 2003. p. 333-60.
[87]
Baudisch P, Rosenholtz R. Halo: a technique for visualizing off-screen objects. In: Proceedings of the SIGCHI conference on human factors in computing systems, ACM, 2003. p. 481-8.
[88]
Gustafson S, Baudisch P, Gutwin C, Irani P. Wedge: clutter-free visualization of off-screen locations. In: Proceedings of the SIGCHI conference on human factors in computing systems, ACM, 2008. p. 787-96.
[89]
Herling J, Broll W. Advanced self-contained object removal for realizing real-time diminished reality in unconstrained environments. In: Proceedings of ISMAR, IEEE, 2010. p. 207-12.
[90]
Cosco FI, Garre C, Bruno F, Muzzupappa M, Otaduy MA. Augmented touch without visual obstruction. In: Proceedings of ISMAR, IEEE, 2009. p. 99-102.
[91]
Bichlmeier C, Heining SM, Rustaee M, Navab N. Virtually extended surgical drilling device: virtual mirror for navigated spine surgery. In: Proceedings of MICCAI, Brisbane, Australia, 2007. p. 434-41.
[92]
Looser J, Grasset R, Billinghurst M. A 3d flexible and tangible magic lens in augmented reality. In: Proceedings of ISMAR, IEEE, 2007. p. 51-4.

Cited By

View all
  • (2024)Investigating the Design of Augmented Narrative Spaces Through Virtual-Real Connections: A Systematic Literature ReviewProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642819(1-18)Online publication date: 11-May-2024
  • (2023)Analytic Review of Using Augmented Reality for Situational AwarenessIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.314158529:4(2166-2183)Online publication date: 1-Apr-2023
  • (2023)A Mixed Reality Setup for Prototyping Holographic Cockpit InstrumentsVirtual Reality and Mixed Reality10.1007/978-3-031-48495-7_5(79-92)Online publication date: 29-Nov-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Computers and Graphics
Computers and Graphics  Volume 37, Issue 8
December, 2013
109 pages

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 01 December 2013

Author Tags

  1. Augmented Reality
  2. Information Presentation
  3. Taxonomy

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Investigating the Design of Augmented Narrative Spaces Through Virtual-Real Connections: A Systematic Literature ReviewProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642819(1-18)Online publication date: 11-May-2024
  • (2023)Analytic Review of Using Augmented Reality for Situational AwarenessIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.314158529:4(2166-2183)Online publication date: 1-Apr-2023
  • (2023)A Mixed Reality Setup for Prototyping Holographic Cockpit InstrumentsVirtual Reality and Mixed Reality10.1007/978-3-031-48495-7_5(79-92)Online publication date: 29-Nov-2023
  • (2021)Multi-View AR Streams for Interactive 3D Remote TeachingProceedings of the 27th ACM Symposium on Virtual Reality Software and Technology10.1145/3489849.3489950(1-3)Online publication date: 8-Dec-2021
  • (2020)TrackSugARDigital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Posture, Motion and Health10.1007/978-3-030-49904-4_33(442-459)Online publication date: 19-Jul-2020
  • (2018)Experiencing Content: Heuristics for Human-Centered Design for Augmented Reality2018 IEEE International Professional Communication Conference (ProComm)10.1109/ProComm.2018.00057(241-247)Online publication date: 22-Jul-2018
  • (2017)On the precision of third person perspective augmented reality for target designation tasksMultimedia Tools and Applications10.1007/s11042-016-3817-076:14(15279-15296)Online publication date: 1-Jul-2017
  • (2014)Supporting remote guidance through 3D annotationsProceedings of the 2nd ACM symposium on Spatial user interaction10.1145/2659766.2661206(141-141)Online publication date: 4-Oct-2014
  • (2014)Boundary conditions for information visualization with respect to the user's gazeProceedings of the 5th Augmented Human International Conference10.1145/2582051.2582095(1-8)Online publication date: 7-Mar-2014
  • (2014)Principles of Dynamic Display Aiding Presence in Mixed Reality Space DesignProceedings, Part I, of the 6th International Conference on Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments - Volume 852510.1007/978-3-319-07458-0_4(35-43)Online publication date: 22-Jun-2014
  • Show More Cited By

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media