More Web Proxy on the site http://driver.im/

article

Free access

Augmented reality for art, design and cultural heritage: system design and evaluation

Authors:

Yolande Kolstee,

Joachim Rotteveel,

Wim van EckAuthors Info & Claims

Journal on Image and Video Processing, Volume 2009

Article No.: 5, Page 2

https://doi.org/10.1155/2009/716160

Published: 01 February 2009 Publication History

Abstract

This paper describes the design of an optical see-through head-mounted display (HMD) system for Augmented Reality (AR). Our goals were to make virtual objects "perfectly" indistinguishable from real objects, wherever the user roams, and to find out to which extent imperfections are hindering applications in art and design. For AR, fast and accurate measuring of head motions is crucial. We made a head-pose tracker for the HMD that uses error-state Kalman filters to fuse data from an inertia tracker with data from a camera that tracks visual markers. This makes on-line head-pose based rendering of dynamic virtual content possible.We measured our system, and found that with an A4-sized marker viewed from > 20° at 5 m distance with an SXGA camera (FOV 108°), the RMS error in the tracker angle was < 0.5° when moving the head slowly. Our Kalman filters suppressed the pose error due to camera delay, which is proportional to the angular and linear velocities, and the dynamic misalignment was comparable to the static misalignment. Applications of artists and designers lead to observations on the profitable use of our AR system. Their exhibitions at world-class museums showed that AR is a powerful tool for disclosing cultural heritage.

References

[1]

P. Milgram, H. Takemura, A. Utsumi, and F. Kishino, "Augmented reality: a class of displays on the reality-virtuality continuum," in Conference on Telemanipulator and Telepresence Technologies, vol. 2351 of Proceedings of SPIE, pp. 282-292, Boston, Mass, USA, 1994.

[2]

R. Pausch, T. Crea, and M. Conway, "A literature survey for virtual environments: military flight simulator visual systems and simulator sickness," Presence: Teleoperators and Virtual Environments, vol. 1, no. 3, pp. 344-363, 1992.

Digital Library

[3]

L. J. Hettinger, K. S. Berbaum, R. S. Kennedy, W. P. Dunlap, and M. D. Nolan, "Vection and simulator sickness," Military Psychology, vol. 2, no. 3, pp. 171-181, 1990.

[4]

K. M. Stanney, R. R. Mourant, and R. S. Kennedy, "Human factors issues in virtual environments: a review of the literature," Presence: Teleoperators and Virtual Environments, vol. 7, no. 4, pp. 327-351, 1998.

Digital Library

[5]

S. Persa and P. Jonker, "On positioning for augmented reality systems," in Handheld and Ubiquitous Computing, H.-W. Gellersen, Ed., vol. 1707 of Lecture Notes in Computer Science, pp. 327-329, Springer, Berlin, Germany, 1999.

Digital Library

[6]

P. Jonker, S. Persa, J. Caarls, F. de Jong, and R. L. Lagendijk, "Philosophies and technologies for ambient aware devices in wearable computing grids," Computer Communications, vol. 26, no. 11, pp. 1145-1158, 2003.

Digital Library

[7]

J. Caarls, P. Jonker, and S. Persa, "Sensor fusion for augmented reality," in Proceedings of the 1st European Symposium on Ambient Intelligence (EUSAI '03), vol. 2875, pp. 160-176, Veldhoven, The Netherlands, November 2003.

[8]

K. Hirokazu and M. Billinghurst, "Augmented reality toolkit," January 2009, http://www.hitl.washington.edu/artoolkit/.

[9]

The Lifeplus (Ist-2001-34545) Project, MIRAlab, Geneva, Switzerland; FORTH, Heraklion, Greece, 2002-2004, http://lifeplus.miralab.unige.ch/HTML/results_visuals.htm.

[10]

W. Piekarski, Interactive 3D modeling in outdoor augmented reality worlds, Ph.D. thesis, Wearable Computer Lab at the University of South Australia, 2004.

[11]

S. J. Yohan, S. Julier, Y. Baillot, et al., "BARS: Battlefield Augmented Reality System," in Proceedings of the NATO Symposium on Information Processing Techniques for Military Systems, pp. 9-11, 2000.

[12]

"Mars project," http://graphics.cs.columbia.edu/projects/mars/mars.html, July 2009.

[13]

http://www.cybermindnl.com/, January 2009.

[14]

http://www.prosilica.com/, January 2009.

[15]

http://www.xsens.com/, January 2009.

[16]

http://www.batteryspace.com/, January 2009.

[17]

www.dell.com, January 2009.

[18]

http://www.ubuntu.com/, January 2009.

[19]

http://www.maxon.net/pages/products/cinema4d/cinema4d_e.html, January 2009.

[20]

http://www.5dt.com/products/pdataglove5u.html, January 2009.

[21]

L. Naimark and E. Foxlin, "Circular data matrix fiducial system and robust image processing for a wearable vision-inertial self-tracker," in Proceedings of the 1st International Symposium on Mixed and Augmented Reality (ISMAR '02), pp. 27-36, Darmstadt, Germany, September-October 2002.

Digital Library

[22]

http://en.wikipedia.org/wiki/Barcode/, July 2009.

[23]

D. G. Lowe, "Object recognition from local scale-invariant features," in Proceedings of the Seventh IEEE International Conference on Computer Vision (ICCV '99), vol. 2, pp. 1150-1157, Kerkyra, Greece, 1999.

Digital Library

[24]

D. G. Lowe, "Distinctive image features from scale-invariant keypoints," International Journal of Computer Vision, vol. 60, no. 2, pp. 91-110, 2004.

Digital Library

[25]

K. Mikolajczyk and C. Schmid, "A performance evaluation of local descriptors," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1615-1630, 2005.

Digital Library

[26]

H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, "Speeded-Up Robust Features (SURF)," Computer Vision and Image Understanding, vol. 110, no. 3, pp. 346-359, 2008.

Digital Library

[27]

G. M. Gauthier, J.-L. Vercher, and J. Blouin, "Integrating reflexes and voluntary behaviours: coordination and adaptation controls in man," in Human and Machine Perception: Information Fusion, V. Cantoni, V. D. Gesu, A. Setti, and D. Tegolo, Eds., pp. 189-206, Plenum Press, New York, NY, USA, 1997.

[28]

J. E. Cutting and P. M. Vishton, "Perceiving layout and knowing distances," in Perception of Space and Motion, W. Epstein and S. Rogers, Eds., Handbook of Perception and Cognition, pp. 70-118, Academic Press, New York, NY, USA, 2nd edition, 1995.

[29]

A. J. Davison, "Real-time simultaneous localisation and mapping with a single camera," in Proceedings of the 9th IEEE International Conference on Computer Vision (ICCV '03), vol. 2, pp. 1403-1410, Nice, France, 2003.

Digital Library

[30]

M. Montemerlo and S. Thrun, FastSLAM: A Scalable Method for the Simultaneous Localisation and Mapping Problem in Robotics, vol. 27, Springer, Berlin, Germany, 2007.

Digital Library

[31]

R. M. Haralick and L. G. Shapiro, Computer and Robot Vision, vol. 1, Addison-Wesley, Reading, Mass, USA, 1992.

Digital Library

[32]

R. M. Haralick and L. G. Shapiro, Computer and Robot Vision, vol. 2, Addison-Wesley, Reading, Mass, USA, 1993.

Digital Library

[33]

C. G. Harris and M. J. Stevens, "A combined corner and edge detector," in Proceedings of the 4th Alvey Vision Conference, vol. 15, pp. 147-151, University of Manchester, Manchester, UK, August-September 1988.

[34]

D. Ziou and S. Tabbone, "Edge detection techniques--an overview," International Journal of Pattern Recognition and Image Analysis, vol. 8, pp. 537-559, 1998.

[35]

V. Torre and T. A. Poggio, "On edge detection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 8, no. 2, pp. 147-163, 1986.

Digital Library

[36]

G. Vass and T. Perlaki, "Applying and removing lens distortion in post production," in Proceedings of the 2nd Hungarian Conference on Computer Graphics and Geometry, pp. 9-16, Budapest, Hungary, 2003.

[37]

J. Weng, P. Cohen, and M. Herniou, "Camera calibration with distortion models and accuracy evaluation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, no. 10, pp. 965-980, 1992.

Digital Library

[38]

Z. Zhang, "A flexible new technique for camera calibration," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 11, pp. 1330-1334, 2000.

Digital Library

[39]

M. T. El-Melegy and A. A. Farag, "Nonmetric lens distortion calibration: closed-form solutions, robust estimation and model selection," in Proceedings of the 9th IEEE International Conference on Computer Vision, vol. 1, pp. 554-559, Nice, France, October 2003.

Digital Library

[40]

R. E. Kalman, "A new approach to linear filtering and predicting problems," Journal of Basic Engineering, vol. 82, pp. 35-45, 1960.

[41]

S. J. Julier and J. K. Uhlmann, "New extension of the Kalman filter to nonlinear systems," in The 6th Signal Processing, Sensor Fusion, and Target Recognition Conference, vol. 3068 of Proceedings of SPIE, pp. 182-193, Orlando, Fla, USA, April 1997.

[42]

J. D. Hol, T. B. Schön, H. Luinge, P. J. Slycke, and F. Gustafsson, "Robust real-time tracking by fusing measurements from inertial and vision sensors," Journal of Real-Time Image Processing, vol. 2, no. 2-3, pp. 149-160, 2007.

[43]

G. S. W. Klein and T. W. Drummond, "Tightly integrated sensor fusion for robust visual tracking," Image and Vision Computing, vol. 22, no. 10, pp. 769-776, 2004.

[44]

L. Armesto, J. Tornero, and M. Vincze, "Fast ego-motion estimation with multi-rate fusion of inertial and vision," International Journal of Robotics Research, vol. 26, no. 6, pp. 577-589, 2007.

Digital Library

[45]

B. P. Ickes, "A new method for performing digital control system attitude computations using quaternions," AIAA Journal of Guidance, Control and Dynamics, vol. 8, no. 1, pp. 13-17, 1970.

[46]

J. J. LaViola Jr., "A comparison of unscented and extended Kalman filtering for estimating quaternion motion," in Proceedings of the American Control Conference, vol. 3, pp. 2435-2440, Denver, Colo, USA, June 2003.

[47]

http://www.arlab.nl/, January 2009.

[48]

http://en.wikipedia.org/wiki/The_Iron_Bridge, July 2009.

Cited By

Asmar D(2017)Pose Tracking in Augmented Reality of Cultural HeritageInternational Journal of Computational Methods in Heritage Science10.4018/IJCMHS.20170101081:1(123-131)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.4018/IJCMHS.2017010108
Coulton PSmith RMurphy EPucihar KLochrie MLugmayr A(2014)Designing mobile augmented reality art applicationsProceedings of the 18th International Academic MindTrek Conference: Media Business, Management, Content & Services10.1145/2676467.2676490(177-182)Online publication date: 4-Nov-2014
https://dl.acm.org/doi/10.1145/2676467.2676490
Coulton PMurphy EPucihar KSmith RLochrie MRoto VHäkkilä JVäänänen-Vainio-Mattila KJuhlin OOlsson THvannberg E(2014)User curated augmented reality art exhibitionsProceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational10.1145/2639189.2670190(907-910)Online publication date: 26-Oct-2014
https://dl.acm.org/doi/10.1145/2639189.2670190
Show More Cited By

Index Terms

Augmented reality for art, design and cultural heritage: system design and evaluation

Recommendations

Virtual and augmented reality for cultural computing and heritage: a case study of virtual exploration of underwater archaeological sites (preprint)

The paper presents different issues dealing with both the preservation of cultural heritage using virtual reality (VR) and augmented reality (AR) technologies in a cultural context. While the VR/AR technologies are mentioned, the attention is paid to ...
The Application of Augmented Reality for Reanimating Cultural Heritage
Proceedings of the 6th International Conference on Virtual, Augmented and Mixed Reality. Applications of Virtual and Augmented Reality - Volume 8526

This paper presents the design of a service-oriented architecture to support dynamic cultural content acquisition on a mobile augmented reality system for reanimating cultural heritage. The reanimating cultural heritage system provides several domain ...
A Survey of Augmented Reality Applications in Cultural Heritage

Augmented reality is now a well-known concept, a technology that integrates digital content to the user's physical world. As more and more applications begin to reshape user's daily lives in multiple domains, cultural heritage sites have begun to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Journal on Image and Video Processing

Journal on Image and Video Processing Volume 2009, Issue

Special issue on image and video processing for cultural heritage

February 2009

95 pages

ISSN:1687-5176

EISSN:1687-5281

Issue’s Table of Contents

Publisher

Hindawi Limited

London, United Kingdom

Publication History

Accepted: 16 November 2009

Revised: 24 July 2009

Published: 01 February 2009

Received: 31 January 2009

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
254
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)3

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Asmar D(2017)Pose Tracking in Augmented Reality of Cultural HeritageInternational Journal of Computational Methods in Heritage Science10.4018/IJCMHS.20170101081:1(123-131)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.4018/IJCMHS.2017010108
Coulton PSmith RMurphy EPucihar KLochrie MLugmayr A(2014)Designing mobile augmented reality art applicationsProceedings of the 18th International Academic MindTrek Conference: Media Business, Management, Content & Services10.1145/2676467.2676490(177-182)Online publication date: 4-Nov-2014
https://dl.acm.org/doi/10.1145/2676467.2676490
Coulton PMurphy EPucihar KSmith RLochrie MRoto VHäkkilä JVäänänen-Vainio-Mattila KJuhlin OOlsson THvannberg E(2014)User curated augmented reality art exhibitionsProceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational10.1145/2639189.2670190(907-910)Online publication date: 26-Oct-2014
https://dl.acm.org/doi/10.1145/2639189.2670190
Fernández-Palacios BRizzi ANex F(2012)Augmented reality for archaeological findsProceedings of the 4th international conference on Progress in Cultural Heritage Preservation10.1007/978-3-642-34234-9_18(181-190)Online publication date: 29-Oct-2012
https://dl.acm.org/doi/10.1007/978-3-642-34234-9_18

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents