More Web Proxy on the site http://driver.im/

research-article

Pointable: an in-air pointing technique to manipulate out-of-reach targets on tabletops

Authors:

Amartya Banerjee,

Audrey Girouard,

Roel VertegaalAuthors Info & Claims

ITS '11: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces

Pages 11 - 20

https://doi.org/10.1145/2076354.2076357

Published: 13 November 2011 Publication History

Abstract

Selecting and moving digital content on interactive tabletops often involves accessing the workspace beyond arm's reach. We present Pointable, an in-air, bimanual perspective-based interaction technique that augments touch input on a tabletop for distant content. With Pointable, the dominant hand selects remote targets, while the non-dominant hand can scale and rotate targets with a dynamic C/D gain. We conducted 3 experiments; the first showed that pointing at a distance using Pointable has a Fitts' law throughput comparable to that of a mouse. In the second experiment, we found that Pointable had the same performance as multi-touch input in a resize, rotate and drag task. In a third study, we observed that when given the choice, over 75% of participants preferred to use Pointable over multi-touch for target manipulation. In general, Pointable allows users to manipulate out-of-reach targets, without loss of performance, while minimizing the need to lean, stand up, or involve collocated collaborators.

Supplementary Material

JPG File (p11-banerjee.jpg)

Download
7.93 KB

M4V File (p11-banerjee.m4v)

Download
21.09 MB

References

[1]

Abednego, M., Lee, J., Moon, W., and Park, J. I-Grabber: Expanding Physical Reach in a Large-Display Tabletop Environment Through the Use of a Virtual Grabber. Proc. ITS, (2009), 61--64.

Digital Library

[2]

Baudisch, P., Cutrell, E., Robbins, D., et al. Drag-and-pop and drag-and-pick: Techniques for accessing remote screen content on touch-and pen-operated systems. Proc. INTERACT, (2003), 57--64.

[3]

Bezerianos, A. and Balakrishnan, R. The vacuum: facilitating the manipulation of distant objects. Proc. CHI, (2005), 2--7.

Digital Library

[4]

Dietz, P. and Leigh, D. DiamondTouch: a multi-user touch technology. Proc. UIST, (2001), 219--226.

Digital Library

[5]

Fitts, P. M. The information capacity of the human motor system in controlling amplitude of movement. Journal of Experimental Psychology 47, (1954), 381--391.

[6]

Forlines, C., Wigdor, D., Shen, C., and Balakrishnan, R. Direct-touch vs. mouse input for tabletop displays. Proc. CHI, (2007), 647--656.

Digital Library

[7]

Grossman, T., Wigdor, D., and Balakrishnan, R. Multi-finger gestural interaction with 3d volumetric displays. Proc. UIST, (2004), 61--70.

Digital Library

[8]

Guiard, Y. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior. (1987), 486--517.

[9]

Hill, A. and Johnson, A. Withindows: A Framework for Transitional Desktop and Immersive User Interfaces. IEEE SI3D, (2008), 3--10.

Digital Library

[10]

Hilliges, O., Izadi, S., Wilson, A., Hodges, S., Garcia-Mendoza, A., and Butz, A. Interactions in the Air: Adding Further Depth to Interactive Tabletops. Proc. UIST, (2009), 139--148.

Digital Library

[11]

Hinckley, K., Yatani, K., Pahud, M., et al. Pen + Touch = New Tools. Proc. UIST, (2010), 27--36.

Digital Library

[12]

Holz, C. and Baudisch, P. The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. Proc. CHI, (2010), 581--590.

Digital Library

[13]

Jota, R., Nacenta, M. A., Jorge, J. A., Carpendale, S., and Greenberg, S. A comparison of ray pointing techniques for very large displays. Proc. GI, (2010), 269--276.

Digital Library

[14]

Kendon, A. Gesture: visible action as utterance. Cambridge University Press, 2004.

[15]

Khan, A., Fitzmaurice, G., Almeida, D., Burtnyk, N., and Kurtenbach, G. A remote control interface for large displays. Proc. UIST, (2004), 127--136.

Digital Library

[16]

Microsoft Kinect. http://www.xbox.com/en-US/kinect.

[17]

Latulipe, C., Kaplan, C. S., and Clarke, C. L. A. Bimanual and unimanual image alignment: an evaluation of mouse-based techniques. Proc. UIST, (2005), 123--131.

Digital Library

[18]

MacKenzie, S. and Isokoski, P. Fitts' throughput and the speed-accuracy tradeoff. Proc. CHI, (2008), 1633--1636.

Digital Library

[19]

Microsoft Surface, http://www.microsoft.com/surface/.

[20]

Myers, B., Bhatnagar, R., Nichols, J., et al. Interacting at a distance: measuring the performance of laser pointers and other devices. Proc. CHI, (2002), 33--40.

Digital Library

[21]

Myers, B. A. and Buxton, W. A Study in Two-Handed Input. Proc. CHI, (1986), 321--326.

Digital Library

[22]

Nacenta, M., Pinelle, D., Stuckel, D., and Gutwin, C. The effects of interaction technique on coordination in tabletop groupware. Proc. GI, (2007), 191--198.

Digital Library

[23]

Nancel, M., Wagner, J., Pietriga, E., Chapuis, O., and Mackay, W. Mid-air pan-and-zoom on wall-sized displays. Proc. CHI, (2011), 177--186.

Digital Library

[24]

Oblong Industries, http://www.oblong.com/.

[25]

Parker, J. K., Mandryk, R. L., Nunes, M. N., and Inkpen, K. M. TractorBeam selection aids: Improving target acquisition for pointing input on tabletop displays. Proc. INTERACT, (2005), 80--93.

Digital Library

[26]

Parker, J. K., Mandryk, R. L., and Inkpen, K. M. TractorBeam: seamless integration of local and remote pointing for tabletop displays. Proc. GI, (2005), 33--40.

Digital Library

[27]

Pierce, J., Forsberg, A., Conway, M., Hong, S., Zeleznik, R. C., and Mine, M. R. Image plane interaction techniques in 3D immersive environments. Proc. I3DG, (1997), 39--43.

Digital Library

[28]

Pierce, J. and Pausch, R. Comparing voodoo dolls and HOMER: exploring the importance of feedback in virtual environments. Proc. SIGCHI, (2002), 105--112.

Digital Library

[29]

Pinelle, D., Barjawi, M., Nacenta, M., and Mandryk, R. An evaluation of coordination techniques for protecting objects and territories in tabletop groupware. Proc. CHI, (2009), 2129--2138.

Digital Library

[30]

Reetz, A., Gutwin, C., Stach, T., Nacenta, M., and Subramanian, S. Superflick: a natural and efficient technique for long-distance object placement on digital tables. Proc. GI, (2006), 163--170.

Digital Library

[31]

Rekimoto, J. SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. Proc. CHI, (2002), 113--120.

Digital Library

[32]

Ringel, M., Berg, H., Jin, Y., and Winograd, T. Barehands: implement-free interaction with a wall-mounted display. Proc. CHI EA, (2001), 368--374.

Digital Library

[33]

Scott, S. D., Carpendale, S., and Inkpen, K. M. Territoriality in collaborative tabletop workspaces. Proc. CSCW, (2004), 294--393.

Digital Library

[34]

Shoemaker, G., Tang, A., and Booth, K. S. Shadow Reaching: A New Perspective on Interaction for Large Wall Displays. Proc. UIST, (2007), 53--56.

Digital Library

[35]

SMART Technologies, http://www.smarttech.com/.

[36]

Toney, A. and Thomas, B. H. Applying reach in direct manipulation user interfaces. Proc. OZCHI, (2006), 393--396.

Digital Library

[37]

Vogel, D. and Balakrishnan, R. Distant freehand pointing and clicking on very large, high resolution displays. Proc. UIST, (2005), 33--42.

Digital Library

[38]

Welford, A. T. Fundamentals of Skill. Methuen, London, 1968.

[39]

Wigdor, D., Benko, H., Pella, J., Lombardo, J., and Williams, S. Rock & rails: extending multi-touch interactions with shape gestures to enable precise spatial manipulations. Proc. CHI, (2011), 1581--1590.

Digital Library

[40]

Wilson, A. D. and Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. Proc. UIST, (2010), 273--282.

Digital Library

[41]

Wilson, A. D. TouchLight: an imaging touch screen and display for gesture-based interaction. Proc. Multimodal Interfaces, (2004), 69--76.

Digital Library

[42]

Wu, M. and Balakrishnan, R. Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. Proc. UIST, (2003), 193--202.

Digital Library

Cited By

Maquil VAnastasiou DAfkari HCoppens AHermen JSchwartz L(2023)Establishing Awareness through Pointing Gestures during Collaborative Decision-Making in a Wall-Display EnvironmentExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585830(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585830
Courtoux EAppert CChapuis O(2023)SurfAirs: Surface + Mid-air Input for Large Vertical DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580877(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580877
Lou XChen ZHansen PPeng R(2022)Asymmetric Free-Hand Interaction on a Large Display and Inspirations for Designing Natural User InterfacesSymmetry10.3390/sym1405092814:5(928)Online publication date: 2-May-2022
https://doi.org/10.3390/sym14050928
Show More Cited By

Index Terms

Pointable: an in-air pointing technique to manipulate out-of-reach targets on tabletops
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms

Recommendations

MultiPoint: Comparing laser and manual pointing as remote input in large display interactions

We present MultiPoint, a set of perspective-based remote pointing techniques that allows users to perform bimanual and multi-finger remote manipulation of graphical objects on large displays. We conducted two empirical studies that compared remote ...
Novel interaction techniques using touch-sensitive tangibles in tabletop environments
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

In this work, we propose techniques for interaction that use a touch-sensitive tangible to assist 3D manipulation in tabletop applications. The objective of this research is to investigate the effectiveness and user satisfaction with this combination ...
Sinkpad: a malleable mouse pad consisted of an elastic material
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

The computer mouse has been used for more than 40 years; users, however, can only perform simple actions. To solve this problem, we present "Sinkpad", an augmented mouse pad that has a malleable surface consisted of an elastic material. Sinkpad augments ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ITS '11: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces

November 2011

295 pages

ISBN:9781450308717

DOI:10.1145/2076354

General Chairs:
Jun Rekimoto
The University of Tokyo / Sony CSL, Japan
,
Hideki Koike
University of Electro-Communications, Japan
,
Kentaro Fukuchi
Meiji University, Japan
,
Program Chairs:
Yoshifumi Kitamura
Tohoku University, Japan
,
Daniel Wigdor
University of Toronto, Canada

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ITS'11

Sponsor:

SIGCHI

ITS'11: Interactive Tabletops and Surfaces

November 13 - 16, 2011

Kobe, Japan

Acceptance Rates

Overall Acceptance Rate 119 of 418 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

46
Total Citations
View Citations
1,098
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Maquil VAnastasiou DAfkari HCoppens AHermen JSchwartz L(2023)Establishing Awareness through Pointing Gestures during Collaborative Decision-Making in a Wall-Display EnvironmentExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585830(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585830
Courtoux EAppert CChapuis O(2023)SurfAirs: Surface + Mid-air Input for Large Vertical DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580877(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580877
Lou XChen ZHansen PPeng R(2022)Asymmetric Free-Hand Interaction on a Large Display and Inspirations for Designing Natural User InterfacesSymmetry10.3390/sym1405092814:5(928)Online publication date: 2-May-2022
https://doi.org/10.3390/sym14050928
Shen VHarrison C(2022)Pull Gestures with Coordinated Graphics on Dual-Screen DevicesProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3556620(270-277)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3536221.3556620
Dickson TWehbe RMatulic FVogel D(2021)HybridPointing for TouchProceedings of the ACM on Human-Computer Interaction10.1145/34885405:ISS(1-22)Online publication date: 5-Nov-2021
https://dl.acm.org/doi/10.1145/3488540
Pfeuffer KDinc AObernolte JRivu RAbdrabou YShelter FAbdelrahman YAlt F(2021)Bi-3D: Bi-Manual Pen-and-Touch Interaction for 3D Manipulation on TabletsThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474741(149-161)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474741
Wang LChen JMa QPopescu V(2021)Disocclusion Headlight for Selection Assistance in VR2021 IEEE Virtual Reality and 3D User Interfaces (VR)10.1109/VR50410.2021.00043(216-225)Online publication date: Mar-2021
https://doi.org/10.1109/VR50410.2021.00043
Plasson CCunin DLaurillau YNigay L(2021)A Lens-Based Extension of Raycasting for Accurate Selection in Dense 3D EnvironmentsHuman-Computer Interaction – INTERACT 202110.1007/978-3-030-85610-6_28(501-524)Online publication date: 26-Aug-2021
https://doi.org/10.1007/978-3-030-85610-6_28
Fujita SYanagihara NShizuki BTakahashi S(2019)Ray-Casting Based Interaction Using an Extended Pull-Out Gesture for Interactive TabletopsProceedings of the 31st Australian Conference on Human-Computer-Interaction10.1145/3369457.3369528(546-549)Online publication date: 2-Dec-2019
https://dl.acm.org/doi/10.1145/3369457.3369528
Poor GJude A(2019)Interaction can hurt - Exploring gesture-based interaction for users with Chronic PainSymposium on Spatial User Interaction10.1145/3357251.3357589(1-5)Online publication date: 19-Oct-2019
https://dl.acm.org/doi/10.1145/3357251.3357589
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents