More Web Proxy on the site http://driver.im/

Article

Cooperative augmentation of smart objects with projector-camera systems

Authors:

David Molyneaux,

Hans Gellersen,

Bernt SchieleAuthors Info & Claims

UbiComp '07: Proceedings of the 9th international conference on Ubiquitous computing

Pages 501 - 518

Published: 16 September 2007 Publication History

Abstract

In this paper we present a new approach for cooperation between mobile smart objects and projector-camera systems to enable augmentation of the surface of objects with interactive projected displays. We investigate how a smart object's capability for self description and sensing can be used in cooperation with the vision capability of projector-camera systems to help locate, track and display information onto object surfaces in an unconstrained environment. Finally, we develop a framework that can be applied to distributed projector-camera systems, cope with varying levels of description knowledge and different sensors embedded in an object.

References

[1]

Bandyopadhyay, D., Raskar, R., Fuchs, H.: Dynamic Shader Lamps: Painting on Movable Objects. In: Proc. IEEE and ACM Int. Symposium on Augmented Reality, New York (2001).

Digital Library

[2]

Ehnes, J., Hirota, K., Hirose, M.: Projected Augmentation - Augmented Reality using Rotatable Video Projectors. In: Third IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'04), September-October 2004, Arlington, VA, USA (2004).

Digital Library

[3]

Kato, H., Billinghurst, M.: Marker Tracking and HMD Calibration for a videobased Augmented Reality Conferencing System. In: Proceedings of the 2nd International Workshop on Augmented Reality (IWAR 99), October 1999, San Francisco, USA (1999).

Digital Library

[4]

Borkowski, S., Riff, O., Crowley, J.: Projecting Rectified Images In an Augmented Environment. In: IEEE International Workshop on Projector-Camera Systems (PROCAMS-2003), October 12, 2003, Nice, France (2003).

[5]

Lee, J.C., Hudson, S.E., Summet, J.W., Dietz, P.H.: Moveable Interactive Projected Displays Using Projector Based Tracking. In: Proceedings of the ACM Symposium on User Interface Software and Technology (UIST), October 23-26, 2005, Seattle, WA, pp. 63-72 (2005).

Digital Library

[6]

Summet, J., Sukthankar, R.: Tracking Locations of Moving Hand-held Displays Using Projected Light. In: Gellersen, H.-W., Want, R., Schmidt, A. (eds.) PERVASIVE 2005. LNCS, vol. 3468, Springer, Heidelberg (2005).

Digital Library

[7]

Raskar, R., Beardsley, P., van Baar, J., Wang, Y., Dietz, P., Lee, J., Leigh, D., Willwatcher, T.: RFIG Lamps: Interacting with a Self-Describing World via Photosensing Wireless Tags and Projectors. In: Proceedings of SIGGRAPH 2004, Los Angeles, USA (2004).

Digital Library

[8]

Levas, A., Pinhanez, C., Pingali, G., Kjeldsen, R., Podlaseck, M., Sukaviriya, N.: An Architecture and Framework for Steerable Interface Systems. In: Dey, A.K., Schmidt, A., McCarthy, J.F. (eds.) UbiComp 2003. LNCS, vol. 2864, Springer, Heidelberg (2003).

[9]

Gellersen, H., Beigl, M., Krull, H.: The MediaCup: Awareness Technology embedded in an Everyday Object. In: Gellersen, H.-W. (ed.) HUC 1999. LNCS, vol. 1707, pp. 308-310. Springer, Heidelberg (1999).

Digital Library

[10]

Strohbach, M., Gellersen, H.-W., Kortuem, G., Kray, C.: Cooperative Artefacts: Assessing Real World Situations with Embedded Technology. In: Davies, N., Mynatt, E.D., Siio, I. (eds.) UbiComp 2004. LNCS, vol. 3205, Springer, Heidelberg (2004).

[11]

Schmidt, A., Strohbach, M., Van Laerhoven, K., Friday, A., Gellersen, H.-W.: Context Acquisition based on Load Sensing. In: Boriello, G., Holmquist, L.E. (eds.) Proceedings of Ubicomp 2002, September 2002. LNCS, vol. 2498, pp. 333-351. Springer, Gothenburg, Sweden (2002).

Digital Library

[12]

Schmidt, A., Strohbach, M., Van Laerhoven, K., Gellersen, H.W.: Ubiquitous Interaction - Using Surfaces in Everyday Environments as Pointing Devices. In: 7th ERCIM Workshop "User Interfaces For All (23-25 October, 2002).

Digital Library

[13]

Strohbach, M., Gellersen, H.-W., Kortuem, G., Kray, C.: Cooperative Artefacts: Assessing Real World Situations with Embedded Technology. In: Davies, N., Mynatt, E.D., Siio, I. (eds.) UbiComp 2004. LNCS, vol. 3205, Springer, Heidelberg (2004).

[14]

Stauffer, C., Grimson, W.E.L.: Adaptive background mixture models for real-time tracking. Computer Vision Pattern Recognition, 246-252 (1999).

[15]

Karitsuka, T., Sato, K.: A Wearable Mixed Reality with On-board Projector. In: Second IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR2003), 7-10 October 2003, Tokyo, Japan (2003).

Digital Library

[16]

Pinhanez, C.: The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces. In: Abowd, G.D., Brumitt, B., Shafer, S. (eds.) Ubicomp 2001: Ubiquitous Computing. LNCS, vol. 2201, Springer, Heidelberg (2001).

Digital Library

[17]

Butz, A., Schneider, M., Spassova, M.: Searchlight: A Lightweight Search Function for Pervasive Environments. In: Ferscha, A., Mattern, F. (eds.) PERVASIVE 2004. LNCS, vol. 3001, pp. 21-23. Springer, Heidelberg (2004).

[18]

Bimber, O., Raskar, R.: Spatial Augmented Reality Merging Real and Virtual Worlds. A K Peters LTD (publisher), ISBN: 1-56881-230-2

Digital Library

[19]

Fujii, K., Grossberg, M.D., Nayar, S.K.: A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 814-821 (2005).

Digital Library

[20]

Decker, C., Beigle, M., Krohn, A., Robinson, P., Kubach, U.: eSeal - a system for enhanced electronic assertion of authenticity and integrity. In: Ferscha, A., Mattern, F. (eds.) PERVASIVE 2004. LNCS, vol. 3001, Springer, Heidelberg (2004).

[21]

Mikolajczyk, K., Schmid, C.: Scale and Affine invariant interest point detectors. International Journal of Computer Vision (IJCV) 60(1), 63-86 (2004).

Digital Library

[22]

Lowe, D.: SIFT: Distinctive image features from scale invariant keypoints. International Journal of Computer Vision (IJCV) 60(2), 91-110 (2004).

Digital Library

[23]

Decker, C., Krohn, A., Beigl, M., Zimmer, T.: The Particle Computer System, IPSN Track on Sensor Platform, Tools and Design Methods for Networked Embedded Systems (SPOTS). In: Proceedings of the ACM/IEEE 4th International Conference on Information Processing in Sensor Networks (IPSN05), April 2005, Los Angeles, pp. 443-448 (2005).

Digital Library

[24]

Brooks Jr., F.P.: What's Real About Virtual Reality? IEEE Computer Graphics and Applications 19(6), 16-27 (1999).

Digital Library

[25]

Isard, M., Blake, A.: CONDENSATION - conditional density propagation for visual tracking. International Journal of Computer Vision (IJCV) 29(1), 5-28 (1998).

Digital Library

[26]

Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fittingwith applications to image analysis and automated cartography. Communications of the ACM 24, 6, 381-395 (1981).

Digital Library

[27]

Swain, M.J., Ballard, D.H.: Color indexing. International Journal of Computer Vision (IJCV) 7(1) (1991).

Digital Library

[28]

Recognition without Correspondence using Multidimensional Receptive Field Histograms. International Journal of Computer Vision (IJCV) 36(1), 31-50 (2000).

Digital Library

[29]

Belongie, S., Malik, J., Puzicha, J.: Matching Shapes. In: Proceedings of International Conference on Computer Vision (ICCV'01) (2001).

[30]

Kjeldsen, R., Pinhanez, C., Pingali, G., Hartman, J., Levas, T., Podlaseck, M.: Interacting with Steerable Projected Displays. In: Proc. of the 5th International Conference on Automatic Face and Gesture Recognition (FG'02), May 20-21 2002, Washington (DC) (2002).

Digital Library

Cited By

Verma PGuimbretière FBernstein MReinecke K(2019)Stick User InterfaceAdjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332167.3357115(60-62)Online publication date: 14-Oct-2019
https://dl.acm.org/doi/10.1145/3332167.3357115
Väänänen-Vainio-Mattila KSuhonen KLaaksonen JKildal JTahiroğlu K(2013)User experience and usage scenarios of audio-tactile interaction with virtual objects in a physical environmentProceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces10.1145/2513506.2513514(67-76)Online publication date: 3-Sep-2013
https://dl.acm.org/doi/10.1145/2513506.2513514
Molyneaux DGellersen HFinney J(2013)Cooperative augmentation of mobile smart objects with projected displaysACM Transactions on Interactive Intelligent Systems10.1145/2499474.24994763:2(1-35)Online publication date: 5-Aug-2013
https://dl.acm.org/doi/10.1145/2499474.2499476
Show More Cited By

Recommendations

Cooperative augmentation of mobile smart objects with projected displays
Special issue on interaction with smart objects, Special section on eye gaze and conversation

Sensors, processors, and radios can be integrated invisibly into objects to make them smart and sensitive to user interaction, but feedback is often limited to beeps, blinks, or buzzes. We propose to redress this input-output imbalance by augmentation ...
Vision-Based Detection of Mobile Smart Objects
EuroSSC '08: Proceedings of the 3rd European Conference on Smart Sensing and Context

We evaluate an approach for mobile smart objects to cooperate with projector-camera systems to achieve interactive projected displays on their surfaces without changing their appearance or function. Smart objects describe their appearance directly to ...
Smart Object, Not Smart Environment: Cooperative Augmentation of Smart Objects Using Projector-camera Systems

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

UbiComp '07: Proceedings of the 9th international conference on Ubiquitous computing

September 2007

520 pages

ISBN:9783540748526

Editors:
John Krumm
Microsoft Research, Redmond, WA
,
Gregory D. Abowd
Georgia Institute of Technology, Atlanta, GA
,
Aruna Seneviratne
National ICT of Australia, Eveleigh, NSW, Australia
,
Thomas Strang
German Aerospace Center, Oberpfaffenhofen, Germany and University of Innsbruck, Innsbruck, Austria

Sponsors

Intel Research
transIT
Siemens
Microsoft Research: Microsoft Research
Saltlux

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 16 September 2007

Check for updates

Author Tags

Qualifiers

Article

Acceptance Rates

UbiComp '07 Paper Acceptance Rate 29 of 152 submissions, 19%;

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
17
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Verma PGuimbretière FBernstein MReinecke K(2019)Stick User InterfaceAdjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332167.3357115(60-62)Online publication date: 14-Oct-2019
https://dl.acm.org/doi/10.1145/3332167.3357115
Väänänen-Vainio-Mattila KSuhonen KLaaksonen JKildal JTahiroğlu K(2013)User experience and usage scenarios of audio-tactile interaction with virtual objects in a physical environmentProceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces10.1145/2513506.2513514(67-76)Online publication date: 3-Sep-2013
https://dl.acm.org/doi/10.1145/2513506.2513514
Molyneaux DGellersen HFinney J(2013)Cooperative augmentation of mobile smart objects with projected displaysACM Transactions on Interactive Intelligent Systems10.1145/2499474.24994763:2(1-35)Online publication date: 5-Aug-2013
https://dl.acm.org/doi/10.1145/2499474.2499476
Vlist BNiezen GRapp SHu JFeijs L(2013)Configuring and controlling ubiquitous computing infrastructure with semantic connectionsPersonal and Ubiquitous Computing10.1007/s00779-012-0627-x17:4(783-799)Online publication date: 1-Apr-2013
https://dl.acm.org/doi/10.1007/s00779-012-0627-x
Wilson ABenko HIzadi SHilliges OMiller RBenko HLatulipe C(2012)Steerable augmented reality with the beamatronProceedings of the 25th annual ACM symposium on User interface software and technology10.1145/2380116.2380169(413-422)Online publication date: 7-Oct-2012
https://dl.acm.org/doi/10.1145/2380116.2380169
Fujinami KSokan A(2012)Nondirective information presentation for on-site safety training in chemistry experimentsProceedings of the International Working Conference on Advanced Visual Interfaces10.1145/2254556.2254615(308-311)Online publication date: 21-May-2012
https://dl.acm.org/doi/10.1145/2254556.2254615
Kawsar FRukzio EKortuem Gde Sá MCarriço LCorreia N(2010)An explorative comparison of magic lens and personal projection for interacting with smart objectsProceedings of the 12th international conference on Human computer interaction with mobile devices and services10.1145/1851600.1851627(157-160)Online publication date: 7-Sep-2010
https://dl.acm.org/doi/10.1145/1851600.1851627
Chatting DSutton J(2009)Visible imaginationProceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology10.5555/1671011.1671063(405-409)Online publication date: 1-Sep-2009
https://dl.acm.org/doi/10.5555/1671011.1671063
Molyneaux DGellersen HVillar NIzadi SFraser MBenford S(2009)Projected interfacesProceedings of the 3rd International Conference on Tangible and Embedded Interaction10.1145/1517664.1517741(385-392)Online publication date: 16-Feb-2009
https://dl.acm.org/doi/10.1145/1517664.1517741

View Options

View options

Media

Figures

Other

Tables

View Table of Contents