research-article

Gesturemote: interacting with remote displays through touch gestures

Authors:

Hao Lü,

Matei Negulescu,

Yang LiAuthors Info & Claims

AVI '14: Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces

Pages 325 - 328

https://doi.org/10.1145/2598153.2598195

Published: 27 May 2014 Publication History

Get Access

Abstract

We present Gesturemote, a technique for interacting with remote displays through touch gestures on a handheld touch surface. By combining a variety of different touch gestures and connecting them smoothly, Gesturemote supports a wide range of interaction behaviors, from low pixel-level interaction such as pointing and clicking, to medium-level interaction such as structured navigation of a user interface, to high-level interaction such as invoking a function directly (e.g. shortcuts). Gesturemote requires no visual attention to use and thus is eyes-free. We received positive initial feedback for Gesturemote from the participants in an interview where we walked them through the design. In addition, we investigated the usability of our gesture-based target acquisition technique by comparing it with a trackpad in a target acquisition task. The results indicate that Gesturemote performs better when visual search is required and is preferable to a general-purpose trackpad.

References

[1]

Boring, S., Baur, D., Butz, A., Gustafson, S., and Baudisch, P. Touch projector: mobile interaction through video. Proc. CHI 2010, (2010), 2287--2296.

Digital Library

Google Scholar

[2]

Google Glass. http://www.google.com/glass.

Google Scholar

[3]

Hardy, R. and Rukzio, E. Touch & interact: mobile interaction through video. Proc. MobileHCI 2008, ACM Press (2008), 245--254.

Digital Library

Google Scholar

[4]

Hick, W. E. On the rate of gain of information. The Quarterly Journal of Experimental Psychology 4, 1, 11--26.

Google Scholar

[5]

Jansen, Y., Dragicevic, P., and Fekete, J.-D. Tangible remote controllers for wall-size displays. Proc. CHI 2012, ACM Press (2012), 2865--2874.

Digital Library

Google Scholar

[6]

Lorenz, A., De Castro, C. F., and Rukzio, E. Using handheld devices for mobile interaction with displays in home environments. Proc. MobileHCI 2009, ACM Press (2009), Article 18.

Digital Library

Google Scholar

[7]

Lü, H. and Li, Y. Gesture avatar: a technique for operating mobile user interfaces using gestures. Proc. CHI 2011, ACM Press (2011), 207--216.

Digital Library

Google Scholar

[8]

Mackenzie, I. S. Fitts' law as a performance model in human-computer interaction. Doctoral Thesis. University of Toronto.

Digital Library

Google Scholar

[9]

Nancel, M., Wagner, J., Pietriga, E., Chapuis, O., and Mackay, W. Mid-air pan-and-zoom on wall-sized displays. Proc. CHI 2011, ACM Press (2011), 177--186.

Digital Library

Google Scholar

[10]

Norman, D. A. Activity-Centered Design: Why I like my Harmony Remote Control. http://www.jnd.org/dn.mss/activitycentere.html.

Google Scholar

[11]

Shoemaker, G., Tang, A., and Booth, K. S. Shadow reaching: a new perspective on interaction for large displays. Proc. UIST 2007, ACM Press (2007), 53--56.

Digital Library

Google Scholar

[12]

Vogel, D. and Balakrishnan, R. Distant freehand pointing and clicking on very large, high resolution displays. Proc. UIST 2005, ACM Press (2005), 33--42.

Digital Library

Google Scholar

Cited By

View all

Langner RKister UDachselt R(2019)Multiple Coordinated Views at Large Displays for Multiple Users: Empirical Findings on User Behavior, Movements, and DistancesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.286523525:1(608-618)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1109/TVCG.2018.2865235
Bernhaupt RManciet FPirker M(2015)User Experience as a Parameter to Enhance Automation AcceptanceProceedings of the 5th International Conference on Application and Theory of Automation in Command and Control Systems10.1145/2899361.2899376(140-150)Online publication date: 30-Sep-2015
https://dl.acm.org/doi/10.1145/2899361.2899376
Matulic FHusmann MWalter SNorrie MNunes NCostanza EOlivier PSchöning J(2015)Eyes-Free Touch Command Support for Pen-Based Digital Whiteboards via Handheld DevicesProceedings of the 2015 International Conference on Interactive Tabletops & Surfaces10.1145/2817721.2817728(141-150)Online publication date: 15-Nov-2015
https://dl.acm.org/doi/10.1145/2817721.2817728

Recommendations

On the design of display processors

The flexibility and power needed in the channel for a computer display are considered. To work efficiently, such a channel must have a sufficient number of instruction that it is best understood as a small processor rather than a powerful channel. As it ...
SurfAirs: Surface + Mid-air Input for Large Vertical Displays
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Large vertical surfaces such as wall displays allow users to work with a very large and high-resolution workspace. Such displays promote physical navigation: users can step close to the display to see details, but also move away to get a wider view of ...
Towards estimating web search result relevance from touch interactions on mobile devices
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

Fine-grained search interactions such as mouse cursor movements and scrolling have been shown to be valuable for modeling user attention and preferences of Web search results, in the desktop setting. However, users increasingly search the Web on touch-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

AVI '14: Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces

May 2014

438 pages

ISBN:9781450327756

DOI:10.1145/2598153

General Chair:
Paolo Paolini
Politecnico di Milano (Italy)
,
Program Chair:
Franca Garzotto
Politecnico di Milano (Italy)

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 May 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AVI' 14

Sponsor:

Centro Cultura Volta
Politecnico di Milano

AVI' 14: International Working Conference on Advanced Visual Interfaces

May 27 - 29, 2014

Como, Italy

Acceptance Rates

AVI '14 Paper Acceptance Rate 32 of 112 submissions, 29%;

Overall Acceptance Rate 128 of 490 submissions, 26%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
279
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Langner RKister UDachselt R(2019)Multiple Coordinated Views at Large Displays for Multiple Users: Empirical Findings on User Behavior, Movements, and DistancesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.286523525:1(608-618)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1109/TVCG.2018.2865235
Bernhaupt RManciet FPirker M(2015)User Experience as a Parameter to Enhance Automation AcceptanceProceedings of the 5th International Conference on Application and Theory of Automation in Command and Control Systems10.1145/2899361.2899376(140-150)Online publication date: 30-Sep-2015
https://dl.acm.org/doi/10.1145/2899361.2899376
Matulic FHusmann MWalter SNorrie MNunes NCostanza EOlivier PSchöning J(2015)Eyes-Free Touch Command Support for Pen-Based Digital Whiteboards via Handheld DevicesProceedings of the 2015 International Conference on Interactive Tabletops & Surfaces10.1145/2817721.2817728(141-150)Online publication date: 15-Nov-2015
https://dl.acm.org/doi/10.1145/2817721.2817728

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Recommendations

On the design of display processors

SurfAirs: Surface + Mid-air Input for Large Vertical Displays

Towards estimating web search result relevance from touch interactions on mobile devices

Comments

Information

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations