More Web Proxy on the site http://driver.im/

research-article

A vision-based system for display interaction

Authors:

Björn Stenger,

Thomas Woodley,

Roberto CipollaAuthors Info & Claims

BCS-HCI '09: Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology

Pages 163 - 168

Published: 01 September 2009 Publication History

Abstract

This paper presents a system for interaction with a display via hand pointing, where a single CCD camera on top of the screen is directed towards the viewers. An attention mechanism based on face and hand detection allows one user to take control of the interface. Face recognition is used for identification and customisation. The system allows the user to control the screen pointer by tracking their fist. On-screen items can be selected using one of four activation mechanisms. Current sample applications include browsing image and video collections as well as viewing a gallery of 3D objects. In experiments we demonstrate the performance of the vision components in challenging conditions.

References

[1]

A. A. Argyros and M. I. A. Lourakis. Real-time tracking of multiple skin-colored objects with a possibly moving camera. In Proc. 8th ECCV, pages 368--379, May 2004.

[2]

F. R. Bach and M. I. Jordan. A probabilistic interpretation of canonical correlation analysis. Technical Report 688, Department of Statistics, University of California, Berkeley, 2005.

[3]

V. Badrinarayanan, P. Pérez, F. Le Clerc, and L. Oisel. Probabilistic color and adaptive multi-feature tracking with dynamically switched priority between cues. In Proc. ICCV, Rio de Janeiro, Brazil, October 2007.

[4]

M. Billinghurst, H. Kato, and I. Poupyrev. The magicbook - moving seamlessly between reality and virtuality. IEEE Computer Graphics & Applications, 21(3):6--8, 2001.

Digital Library

[5]

L. Bretzner, I. Laptev, and T. Lindeberg. Hand gesture recognition using multi-scale colour features, hierarchical models and particle filtering. In Proc. Face and Gesture, pages 423--428, Washington, DC, 2002.

Digital Library

[6]

M. R. Everingham, J. Sivic, and A. Zisserman. Hello! My name is... Buffy -- Automatic naming of characters in TV video. In Proc. BMVC, pages 889--908, 2006.

[7]

W. T. Freeman and C. D. Weissman. Television control by hand gestures. In Intl. Workshop on Automatic Face and Gesture Recognition, Zurich, Switzerland, June 1995.

[8]

P. Hall, D. Marshall, and R. Martin. Merging and splitting eigenspace models. Trans. PAMI, 22(9):1042--1049, 2000.

Digital Library

[9]

H. Hotelling. Relations between two sets of variates. Biometrika, 28(34):321--372, 1936.

[10]

T. Ike, N. Kishikawa, and B. Stenger. A real-time hand gesture interface implemented on a multi-core processor. In Proc. Machine Vision Applications, pages 9--12, Tokyo, Japan, May 2007.

[11]

T.-K. Kim, J. Kittler, and R. Cipolla. Discriminative learning and recognition of image set classes using canonical correlations. Trans. PAMI, 29(6):1005--1018, 2007.

Digital Library

[12]

M. Kölsch and M. Turk. Fast 2D hand tracking with flocks of features and multi-cue integration. In Workshop on Real-Time Vision for HCI, Washington DC, July 2004.

[13]

N. Krahnstoever, E. Schapira, S. Kettebekov, and R. Sharma. Multimodal human-computer interaction for crisis management systems. In Proc. WACV, pages 203--207, Orlando, FL, December 2002.

Digital Library

[14]

I. Leichter, M. Lindenbaum, and E. Rivlin. A generalized framework for combining visual trackers -- the black boxes approach. IJCV, 67(2):91--110, 2006.

Digital Library

[15]

J. P. Lewis. Fast normalized cross-correlation. In Vision Interface, pages 120--123, 1995.

[16]

Y. Li, H. Ai, T. Yamashita, S. Lao, and M. Kawade. Tracking in low frame rate video: A cascade particle filter with discriminative observers of different lifespans. In CVPR, Minneapolis, MN, June 2007.

[17]

J. MacCormick and M. Isard. Partitioned sampling, articulated objects, and interface-quality hand tracking. In Proc. 6th European Conf. on Computer Vision, volume 2, pages 3--19, Dublin, Ireland, June 2000.

Digital Library

[18]

T. Mita, T. Kaneko, B. Stenger, and O. Hori. Discriminative feature co-occurrence selection for object detection. Trans. PAMI, 30(7):1257--1269, July 2008.

Digital Library

[19]

E.-J. Ong and R. Bowden. A boosted classifier tree for hand shape detection. In Intl. Conf. Autom. Face and Gesture Recognition, pages 889--894, Seoul, Korea, May 2004.

Digital Library

[20]

P. Pérez, J. Vermaak, and A. Blake. Data fusion for visual tracking with particles. Proceedings of the IEEE, 92(3):495--513, March 2004.

[21]

P. Robertson, R. Laddaga, and M. Van Kleek. Virtual mouse vision based interface. In Intl. Conf. on Intelligent User Interfaces, pages 177--183, Funchal, Portugal, January 2004.

Digital Library

[22]

G. Shakhnarovich, J. W. Fisher, and T. Darrel. Face recognition from long-term observations. In Proc. ECCV, volume 3, pages 851--868, 2002.

Digital Library

[23]

B. Stenger. Template-based hand pose recognition using multiple cues. In Proc. ACCV, pages 551--560, Hyderabad, India, January 2006.

Digital Library

[24]

L. Wolf and A. Shashua. Kernel principal angles for classification machines with applications to image sequence interpretation. In Proc. CVPR, pages 635--640, 2003.

Digital Library

[25]

S. Zhou, V. Krueger, and R. Chellappa. Probabilistic recognition of human faces from video. Computer Vision and Image Understanding, 91(1--2):214--245, 2003.

Digital Library

Cited By

Bobeth JSchrammel JDeutsch SKlein MDrobics MHochleitner CTscheligi MOlivier PWright PBartindale TObrist MCesar PBasapur S(2014)Tablet, gestures, remote control?Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video10.1145/2602299.2602315(139-146)Online publication date: 25-Jun-2014
https://dl.acm.org/doi/10.1145/2602299.2602315
Bobeth JSchmehl SKruijff EDeutsch STscheligi MArbanowski SSteglich SKnoche HHess J(2012)Evaluating performance and acceptance of older adults using freehand gestures for TV menu controlProceedings of the 10th European Conference on Interactive TV and Video10.1145/2325616.2325625(35-44)Online publication date: 4-Jul-2012
https://dl.acm.org/doi/10.1145/2325616.2325625

Index Terms

A vision-based system for display interaction
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Eliciting Mid-Air Gestures for Wall-Display Interaction
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

Freehand mid-air gestures are a promising input method for interacting with wall displays. However, work on mid-air gestures for wall-display interaction has mainly explored what is technically possible, which might not result in gestures that users ...
Gaze computer interaction on stereo display
ACE '06: Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology

There are several researches on 2D gaze tracking techniques on the 2D screen. However, the researches for the gaze-based interaction to the stereo images or contents are not reported. This paper addresses gaze-based 3D interaction techniques on stereo ...
Two-handed interaction on a tablet display
CHI EA '04: CHI '04 Extended Abstracts on Human Factors in Computing Systems

A touchscreen can be overlaid on a tablet computer to support asymmetric two-handed interaction in which the preferred hand uses a stylus and the non-preferred hand operates the touchscreen. The result is a portable device that allows both hands to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

BCS-HCI '09: Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology

September 2009

532 pages

Sponsors

British Computer Society: BCS

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

BCS Learning & Development Ltd.

Swindon, United Kingdom

Publication History

Published: 01 September 2009

Check for updates

Qualifiers

Research-article

Conference

BCS HCI '09

Sponsor:

British Computer Society

BCS HCI '09: British Computer Society Conference on Human-Computer Interaction

September 1 - 5, 2009

Cambridge, United Kingdom

Acceptance Rates

Overall Acceptance Rate 28 of 62 submissions, 45%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
221
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bobeth JSchrammel JDeutsch SKlein MDrobics MHochleitner CTscheligi MOlivier PWright PBartindale TObrist MCesar PBasapur S(2014)Tablet, gestures, remote control?Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video10.1145/2602299.2602315(139-146)Online publication date: 25-Jun-2014
https://dl.acm.org/doi/10.1145/2602299.2602315
Bobeth JSchmehl SKruijff EDeutsch STscheligi MArbanowski SSteglich SKnoche HHess J(2012)Evaluating performance and acceptance of older adults using freehand gestures for TV menu controlProceedings of the 10th European Conference on Interactive TV and Video10.1145/2325616.2325625(35-44)Online publication date: 4-Jul-2012
https://dl.acm.org/doi/10.1145/2325616.2325625

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents