More Web Proxy on the site http://driver.im/

research-article

Gestures for Controlling a Moveable TV

Authors:

Lars Bo LarsenAuthors Info & Claims

TVX '18: Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video

Pages 5 - 14

https://doi.org/10.1145/3210825.3210831

Published: 25 June 2018 Publication History

Abstract

We investigate the effects of physical context on the preference and production of touchless (3D) gestures, focusing on what users consider to be natural and intuitive. Using an elicitation task, we asked for users' preferred gestures to control a "moving TV" display from a distance of 3-4m. We conducted three user studies (N=16 each) using the same premise but varying the physical conditions encountered, such as number of hands available or distance and orientation to the display. This is important to ensure the robustness of the gesture set. We observed two dominant strategies which we interpret as dependent on the user's mental model: hand-as-display and hand-moving-display. Across the varying conditions, users were found to be consistent with their preferred gesture strategy while varying the production (number of hands, orientation, extension of arms) of their gestures in order to match both their mental models and the physical context of use. From a technology perspective, this natural variation challenges the notion of identifying "the optimal gesture set" and should be taken into account when designing future systems with gesture control.

References

[1]

William T. Freeman, Craig D. Weissman. 1995. Television Control by Hand Gestures. In: Proc. of IEEE Int. Workshop on Automatic Face and Gesture Recognition, Zurich.

[2]

Samsung Smart TV: TV Gesture book -- Waving a Hand. http://www.samsung.com/ph/smarttv/common/guide_book_3p_si/waving.html

[3]

LG USA 2016. How to Use LG Smart TV Magic Remote (2016 - 2017). Youtube video by LG USA Home Appliances and Electronics, 2016. Link visited Jan 29 2018. https://www.youtube.com/watch?v=uoxYO9DslkA

[4]

Piccolo Labs. 2018. Retrieved from https://www.piccololabs.com.

[5]

Kenneth J. W. Craik. 1943. The nature of explanation. Cambridge: Cambridge University Press.

[6]

Don A. Norman. 1983. Some observations on mental models. Mental models, 7(112), pp.7--14.

[7]

Radu-Daniel Vatavu. 2012. User-defined gestures for free-hand TV control. In Proceedings of the 10th European conference on interactive TV and video (EuroITV'12), 45--48.

Digital Library

[8]

Jan Bobeth, Susanne Schmehl, Ernst Kruijff, Stephanie Deutsch, Manfred Tscheligi. 2012. Evaluating performance and acceptance of older adults using freehand gestures for TV menu control. In Proc. of EuroiTV '12, 35--44.

Digital Library

[9]

Oskar Juhlin, Elin Önnevall. 2013. On the relation of ordinary gestures to TV screens: general lessons for the design of collaborative interactive techniques. In Proc. of CHI '13. ACM, New York, NY, USA, 919--930

Digital Library

[10]

Jesper Kjeldskov, Mikael Skov. 2014 Was it Worth the Hassle? Ten Years of Mobile HCI Research Discussions on Lab and Field Evaluations. In Proc. of MobileHCI, 2014, Toronto, ON, Canada.

Digital Library

[11]

Celeste Groenwald et al. Understanding 3D mid-air hand gestures with interactive surfaces and displays: A systematic literature review. Proceedings of British HCI 2016, Bournemouth, UK.

Digital Library

[12]

Cornelia Müller, Alan Cienki, Elen Fricke, Silva Ladewig, David McNeill, Sedinha Teßendorf (Eds.) 2013. Body-Language-Communication. de Gruyter Mouton, Berlin.

[13]

David McNeill. 1992. Hand and mind: What gestures reveal about thought. University of Chicago Press, Chicago.

[14]

Matthias Priesters. 2013. Functional patterns in gesture space. Institut für Sprach- und Kommunikationswissenschaft der RWTH Aachen.

[15]

Asli Özyürek. 2002. Do speakers design their cospeech gestures for their addressees? The effects of addressee location on representational gestures. Journal of Memory & Language, 46: 688--704.

[16]

Wanhong Ling, Lear Du, Carisa Harris-Adamson, Alan Barr, David Rempel. 2017. Design of hand gestures for manipulating objects in virtual reality. In Proceedings of the SIGCHI Conference on Computer-Human- Interaction (CHI'17), 584--592.

[17]

Eve Sweetser, Marisa Sizemore. 2008. Personal and interpersonal gesture spaces: Functional contrasts in language and gesture. Language in the context of use: Discourse and cognitive approaches to language, 25--51.

[18]

Sukeshini A. Grandhi, Gina Joue, Irene Mittelberg. 2011. Understanding naturalness and intuitiveness in gesture production: insights for touchless gestural interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 821--824.

Digital Library

[19]

Julie Rico, Stephen A. Brewster. 2010). Usable gestures for mobile interfaces: evaluating social acceptability. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Atlanta, Georgia, USA, 10--15 Apr 2010.

Digital Library

[20]

Raedy Ping, Susan Goldin-Meadow. 2010. Gesturing saves cognitive resources when talking about nonpresent objects. Cognitive Science, 34: 602--619.

[21]

Pamela Perniss, Asli Özyürek. 2015. Visible cohesion: A comparison of reference tracking in sign, speech, and co-speech gesture. Topics in Cognitive Science, 7: 36--60.

[22]

Pamela Perniss, Gabriella Vigliocco. 2014. The bridge of iconicity: from a world of experience to the experience of language. Phil. Trans. R. Soc. B 369: 20130300.

[23]

Thomas C. Gunter, J.E. Douglas Weinbrenner, Henning Holle. 2015. Inconsistent use of gesture space during abstract pointing impairs language comprehension. Frontiers in Psychology, 6, 80: 1--10.

[24]

Fey Parrill, Kashmiri Stec. 2017. Gestures of the abstract: Do speakers use space consistently and contrastively when gesturing about abstract concepts? Pragmatics & Cognition, 24, 1: 33--61.

[25]

Ionut-Alexandru Zaiti, Ştefan-Gheorghe Pentiuc, Radu-Daniel Vatavu. 2015. On free-hand TV control: experimental results on user-elicited gestures with Leap Motion." Personal and Ubiquitous Computing, 19, 5--6: 821--838.

[26]

Arthur Theil Cabreira, Faustina Hwang. 2015. An analysis of mid-air gestures used across three platforms. Proceedings of the 2015 British HCI Conference, 257--258.

Digital Library

[27]

Sang-Su Lee, Jeonghun Chae, Hyunjeong Kim, Youn-kyung Lim, Kun-pyo Lee. Towards More Natural Digital Content Manipulation via User Freehand Gestural Interaction in a Living Room. In Proceedings of the 2013 ACM joint conference on pervasive and ubiquitous computing (UbiComp'13), 617--626.

Digital Library

[28]

Micha Galor, Jonathan Pokrass, Bat-Yam, Amir Hoffnung. Apple Corp. 2013. Three Dimensional User Interface Session Control. United States Patent No.: US 8,933,876 B2

[29]

Michael Nielsen, Moritz Storring, Thomas B. Moeslund, Erik Granum. 2004. A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In A. Camurri and G. Volpe (eds.). Gesture-Based Communication in Human-Computer Interaction: 5th International Gesture Workshop, GW 2003, LNCS 2915, Springer, Berlin, 409--420.

[30]

Debaleena Chattopadhyay, Davide Bolchini. 2015. Motor-intuitive interactions based on image schemas: Aligning touchless interaction primitives with human sensorimotor abilities. Interacting with Computers 27, 3: 327--343.

[31]

Haiwei Dong, Ali Danesh, Nadia Figueroa, Abdulmotaleb el Saddik. 2015. An elicitation study on gesture preferences and memorability toward a practical hand-gesture vocabulary for smart televisions. IEEE Access 3: 543--555.

[32]

Chris J. Boyatzis, Malcolm W. Watson. 1993. Preschool children's symbolic representation of objects through gestures. Child Development 64: 729--735.

[33]

Jana Bressem. 2012. Repetitions in gesture -- structures, function, and cognitive aspects. PhD Dissertation, Universität Viadrina Frankfurt (Oder).

[34]

R. Breckinridge Church, Susan Goldin-Meadow. 1986. The mismatch between gesture and speech as an index of transitional knowledge. Cognition 23, 2: 43--71.

[35]

Chloe Gonseth, Anne Vilain, Coriandre Vilain. 2012. An experimental study of speech/gesture interactions and distance encoding. Speech communication 55, 4: 553--571.

Digital Library

[36]

Ielka van der Sluis, Emiel Krahmer. 2004. The influence of target size and distance on the production of speech and gesture in multimodal referring expressions. In Proceedings of the 5th International Conference on Spoken Language Processing (ICSLP'04), Jeju, Korea.

Cited By

Stec KLarsen L(2024)Gestural Interfaces in Human–Computer InteractionThe Cambridge Handbook of Gesture Studies10.1017/9781108638869.027(661-682)Online publication date: 1-May-2024
https://doi.org/10.1017/9781108638869.027
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3636458
Hosseini MIhmels TChen ZKoelle MMüller HBoll S(2023)Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across DomainsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581420(1-24)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581420
Show More Cited By

Index Terms

Gestures for Controlling a Moveable TV
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Tactile and hand-based interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. Interaction techniques
      1. Gestural input
  2. Interaction design
    1. Empirical studies in interaction design

Recommendations

Leap gestures for TV: insights from an elicitation study
TVX '14: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video

We present insights from a gesture elicitation study in the context of interacting with TV, during which 18 participants contributed and rated the execution difficulty and recall likeliness of free-hand gestures for 21 distinct TV tasks. Our study ...
User-defined gestures for free-hand TV control
EuroITV '12: Proceedings of the 10th European Conference on Interactive TV and Video

As researchers and industry alike are proposing TV interfaces that use gestures in their designs, understanding users' preferences for gesture commands becomes an important problem. However, no rules or guidelines currently exist to assist designers and ...
How we gesture towards machines: an exploratory study of user perceptions of gestural interaction
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

This paper explores if people perceive and perform touchless gestures differently when communicating with technology vs. with humans. Qualitative reports from a lab study of 10 participants revealed that people perceive differences in the speed of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

TVX '18: Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video

June 2018

266 pages

ISBN:9781450351157

DOI:10.1145/3210825

General Chairs:
Hokyoung Ryu
Hanyang University, Republic of Korea
,
Jieun Kim
Hanyang University, Republic of Korea
,
Teresa Chambel
LASIGE, Fac. de Ciências, Universidade de Lisboa, Portugal
,
Program Chairs:
Tom Bartindale
Newcastle University, UK
,
Vinoba Vinayagamoorthy
BBC Research & Development, UK
,
Wei Tsang Ooi
National University of Singapore, Singapore

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

TVX '18

Sponsor:

TVX '18: ACM International Conference on Interactive Experiences for TV and Online Video

June 26 - 28, 2018

SEOUL, Republic of Korea

Acceptance Rates

TVX '18 Paper Acceptance Rate 12 of 36 submissions, 33%;

Overall Acceptance Rate 69 of 245 submissions, 28%

Upcoming Conference

IMX '25

Sponsor:
sigchi

ACM International Conference on Interactive Media Experiences

June 3 - 6, 2025

Niter?i , Brazil

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
266
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)3

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Stec KLarsen L(2024)Gestural Interfaces in Human–Computer InteractionThe Cambridge Handbook of Gesture Studies10.1017/9781108638869.027(661-682)Online publication date: 1-May-2024
https://doi.org/10.1017/9781108638869.027
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3636458
Hosseini MIhmels TChen ZKoelle MMüller HBoll S(2023)Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across DomainsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581420(1-24)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581420
Bilius LUngurean OVatavu R(2023)Understanding Wheelchair Users’ Preferences for On-Body, In-Air, and On-Wheelchair GesturesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580929(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580929
Şiean APamparău CSluÿters AVatavu RVanderdonckt J(2023)Flexible gesture input with radars: systematic literature review and taxonomy of radar sensing integration in ambient intelligence environmentsJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-023-04606-914:6(7967-7981)Online publication date: 10-Apr-2023
https://doi.org/10.1007/s12652-023-04606-9
Siean APamparău CVatavu R(2022)Scenario-based Exploration of Integrating Radar Sensing into Everyday Objects for Free-Hand Television ControlProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3532982(357-362)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3505284.3532982
Jiang HChignell MMizobuchi SFarhadi Niaki FLiu ZZhou WLi W(2021)Demographic Effects on Mid-Air Gesture Preference for Control of Devices: Implications for DesignProceedings of the 21st Congress of the International Ergonomics Association (IEA 2021)10.1007/978-3-030-74614-8_47(379-386)Online publication date: 13-Jun-2021
https://doi.org/10.1007/978-3-030-74614-8_47
Qian JShamma DAvrahami DBiehl J(2020)Modality and Depth in Touchless Smartphone Augmented Reality InteractionsProceedings of the 2020 ACM International Conference on Interactive Media Experiences10.1145/3391614.3393648(74-81)Online publication date: 17-Jun-2020
https://dl.acm.org/doi/10.1145/3391614.3393648
Magrofuoco NVanderdonckt J(2019)GelicitProceedings of the ACM on Human-Computer Interaction10.1145/33311483:EICS(1-41)Online publication date: 13-Jun-2019
https://dl.acm.org/doi/10.1145/3331148
Popovici IVatavu RWu W(2019)TV Channels in Your Pocket! Linking Smart Pockets to Smart TVsProceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video10.1145/3317697.3325119(193-198)Online publication date: 4-Jun-2019
https://dl.acm.org/doi/10.1145/3317697.3325119
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents