More Web Proxy on the site http://driver.im/

research-article

The Effects of Encumbrance and Mobility on Touch-Based Gesture Interactions for Mobile Phones

Authors:

John Williamson,

Stephen BrewsterAuthors Info & Claims

MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

Pages 536 - 546

https://doi.org/10.1145/2785830.2785853

Published: 24 August 2015 Publication History

Abstract

In this paper, we investigate the effects of mobility and encumbrance (holding objects such as shopping bags) on standard gestures commonly performed on touchscreens: tapping, dragging, spreading & pinching and rotating clockwise & anticlockwise when completed using a two-handed input posture. These one- and two- finger on-screen gesture inputs have become common but previous research has only examined tapping performance in everyday walking and encumbered situations. Therefore, a series of Fitts' Law style targeting tasks was designed to measure the performance of each gesture with users walking only and walking while carrying bags. The results showed that encumbrance and walking had a negative impact on each gesture in terms of accuracy except for rotational actions, which were performed well. Tapping and dragging both performed poorly which shows the input difficulties of single finger interactions when encumbered and on the move. Our findings will help designers choose the appropriate input techniques for future mobile user interfaces and apps in physically demanding contexts.

References

[1]

Avery, J., Choi, M., Vogel, D., and Lank, E. Pinch-to-zoom-plus. Proceedings of UIST 2014, 595--604.

Digital Library

[2]

Barnard, L., Yi, J.S., Jacko, J.A., and Sears, A. An empirical comparison of use-in-motion evaluation scenarios for mobile computing devices. International Journal of Human Computer Studies 62, 4 (2005), 487--520.

Digital Library

[3]

Bergstrom-Lehtovirta, J., Oulasvirta, A., and Brewster, S. The effects of walking speed on target acquisition on a touchscreen interface. Proceedings of MobileHCI 2011, 143--146.

Digital Library

[4]

Cockburn, A., Ahlström, D., and Gutwin, C. Understanding performance in touch selections: Tap, drag and radial pointing drag with finger, stylus and mouse. International Journal of Human-Computer Studies 70, 3 (2012), 218--233.

Digital Library

[5]

Crossan, A., Murray-Smith, R., Brewster, S., Kelly, J., and Musizza, B. Gait Phase Effects in Mobile Interaction. Extended Abstracts on Human Factors in Computing Systems - CHI EA 2005, 1312--1315.

Digital Library

[6]

Findlater, L., Froehlich, J.E., Fattal, K., Wobbrock, J.O., and Dastyar, T. Age-related differences in performance with touchscreens compared to traditional mouse input. Proceedings of CHI 2013, 343--346.

Digital Library

[7]

Fitts, P.M. The information capacity of the human motor system in controlling the amplitude of movement. 1954. Journal of experimental psychology. General 121, 6 (1992), 262--269.

[8]

Goel, M., Findlater, L., and Wobbrock, J. WalkType: Using Accelerometer Data to Accommodate Situational Impairments in Mobile Touch Screen Text Entry. Proceedings of CHI 2012, 2687--2696.

Digital Library

[9]

Hoggan, E., Williamson, J., Oulasvirta, A., Nacenta, M., Kristensson, P.O., and Lehtiö, A. Multi-touch rotation gestures: performance and ergonomics. Proceedings of CHI 2013, 3047--3050.

Digital Library

[10]

Hoggan, E., Williamson, J., Oulasvirta, A., Nacenta, M., Kristensson, P.O., and Lehtiö, A. Multi-touch pinch gestures: performance and ergonomics. Proceedings of ITS 2013, 219--222.

Digital Library

[11]

Hoober, S. How Do Users Really Hold Mobile Devices? www.uxmatters.com

[12]

Kane, S.K., Wobbrock, J.O., and Smith, I.E. Getting off the treadmill: evaluating walking user interfaces for mobile devices in public spaces. Proceedings of MobileHCI 2008, 109--118.

Digital Library

[13]

Karlson, A., Bederson, B., and Contreras-Vidal, J. Understanding single-handed mobile device interaction. Technical Report 2006.

[14]

Kobayashi, M., Hiyama, A., Miura, T., Asakawa, C., Hirose, M., and Ifukube, T. Elderly user evaluation of mobile touchscreen interactions. Proceeding of INTERACT 2011, 83--99.

Digital Library

[15]

Lin, M., Goldman, R., Price, K.J., Sears, A., and Jacko, J. How do people tap when walking? An empirical investigation of nomadic data entry. International Journal of Human-Computer Studies 65, 9 (2007), 759--769.

Digital Library

[16]

MacKenzie, I.S. and Isokoski, P. Fitts' throughput and the speed-accuracy tradeoff. Proceedings of CHI 2008, 1633--1636.

Digital Library

[17]

MacKenzie, I.S., Kauppinen, T., and Silfverberg, M. Accuracy measures for evaluating computer pointing devices. Proceedings of CHI 2001, 9--16.

Digital Library

[18]

MacKenzie, I.S. Fitts' Law as a Research and Design Tool in Human-Computer Interaction. Human-Computer Interaction 7, 1 (1992), 91--139.

Digital Library

[19]

Mainwaring, S.D., Anderson, K., and Chang, M.F. Living for the global city: mobile kits, urban interfaces, and ubicomp. Proceeding of UbiComp 2005, 269--286.

Digital Library

[20]

Mizobuchi, S., Chignell, M., and Newton, D. Mobile text entry: relationship between walking speed and text input task difficulty. Proceedings of MobileHCI 2005, 122--128.

Digital Library

[21]

Ng, A., Brewster, S., and Williamson, J. The Impact of Encumbrance on Mobile Interactions. Proceeding of INTERACT 2013, 92--109.

Digital Library

[22]

Ng, A., Brewster, S.A., and Williamson, J.H. Investigating the effects of encumbrance on one- and two- handed interactions with mobile devices. Proceedings of CHI 2014, 1981--1990.

Digital Library

[23]

Ng, A., Williamson, J.H., and Brewster, S.A. Comparing evaluation methods for encumbrance and walking on interaction with touchscreen mobile devices. Proceedings of MobileHCI 2014, 23--32.

Digital Library

[24]

Nicolau, H. and Jorge, J. Touch typing using thumbs: understanding the effect of mobility and hand posture. Proceedings of CHI 2012, 2683--2686.

Digital Library

[25]

Oulasvirta, A. and Bergstrom-Lehtovirta, J. Ease of juggling: studying the effects of manual multitasking. Proceedings of CHI 2011, 3103--3112.

Digital Library

[26]

Schedlbauer, M. and Heines, J. Selecting While Walking : An Investigation of Aiming Performance in a Mobile Work Context Selecting While Walking : An Investigation of Aiming Performance in a Mobile Work Context. Proceedings of AMCIS 2007.

[27]

Schildbach, B. and Rukzio, E. Investigating Selection and Reading Performance on a Mobile Phone while Walking. Proceedings of MobileHCI 2010, 93--102.

Digital Library

[28]

Sears, A., Lin, M., Jacko, J., and Yang, X. When computers fade: Pervasive computing and situationally induced impairments and disabilities. Proceedings of HCI Int'l 2003, 1298--1302.

[29]

Tran, J.J., Trewin, S., Swart, C., John, B.E., and Thomas, J.C. Exploring pinch and spread gestures on mobile devices. Proceedings of MobileHCI 2013, 151--160.

Digital Library

[30]

Wobbrock, J.O., Shinohara, K., and Jansen, A. The effects of task dimensionality, endpoint deviation, throughput calculation, and experiment design on pointing measures and models. Proceedings of CHI 2011, 1639--1648.

Digital Library

[31]

Zhao, J., Soukoreff, R.W., and Balakrishnan, R.A Model of Multi-touch Manipulation. Proceedings of GRAND 2011.

Cited By

Marentakis GBalic A(2024)Situational impairment due to walking with conversational versus graphical interfacesProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678307(77-85)Online publication date: 18-Sep-2024
https://dl.acm.org/doi/10.1145/3678299.3678307
Coutrix CProst C(2024)Impact of Fingernails Length on Mobile Tactile InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642037(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642037
Jamalzadeh MRekik YGrisoni L(2023)The Effect of Attention Saturating Task on Eyes-Free Gesture Production on Mobile DevicesCompanion Proceedings of the 2023 Conference on Interactive Surfaces and Spaces10.1145/3626485.3626535(27-31)Online publication date: 5-Nov-2023
https://dl.acm.org/doi/10.1145/3626485.3626535
Show More Cited By

Index Terms

The Effects of Encumbrance and Mobility on Touch-Based Gesture Interactions for Mobile Phones
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Investigating the effects of encumbrance on one- and two- handed interactions with mobile devices
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In this paper, we investigate the effects of encumbrance (carrying typical objects such as shopping bags during interaction) and walking on target acquisition on a touchscreen mobile phone. Users often hold objects and use mobile devices at the same ...
Comparing evaluation methods for encumbrance and walking on interaction with touchscreen mobile devices
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

In this paper, two walking evaluation methods were compared to evaluate the effects of encumbrance while the preferred walking speed (PWS) is controlled. Users frequently carry cumbersome objects (e.g. shopping bags) and use mobile devices at the same ...
Investigating Pressure-based Interactions with Mobile Phones While Walking and Encumbered
MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

In encumbered (e.g. carrying shopping bags) and walking situations, interacting with mobile phones is physically demanding and leads to poor input performance. This paper presents two user studies which investigate the effectiveness of using pressure as ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 2015

611 pages

ISBN:9781450336529

DOI:10.1145/2785830

General Chairs:
Sebastian Boring
University of Copenhagen, Denmark
,
Enrico Rukzio
University of Ulm, Germany
,
Program Chairs:
Hans Gellersen
Lancaster University, UK
,
Ken Hinckley
Microsoft Research Redmond, USA

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 August 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

MobileHCI '15

Sponsor:

SIGCHI

MobileHCI '15: 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 24 - 27, 2015

Copenhagen, Denmark

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
397
Total Downloads

Downloads (Last 12 months)42
Downloads (Last 6 weeks)13

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Marentakis GBalic A(2024)Situational impairment due to walking with conversational versus graphical interfacesProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678307(77-85)Online publication date: 18-Sep-2024
https://dl.acm.org/doi/10.1145/3678299.3678307
Coutrix CProst C(2024)Impact of Fingernails Length on Mobile Tactile InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642037(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642037
Jamalzadeh MRekik YGrisoni L(2023)The Effect of Attention Saturating Task on Eyes-Free Gesture Production on Mobile DevicesCompanion Proceedings of the 2023 Conference on Interactive Surfaces and Spaces10.1145/3626485.3626535(27-31)Online publication date: 5-Nov-2023
https://dl.acm.org/doi/10.1145/3626485.3626535
Olade ILiang HFleming C(2023)Story-based authentication for mobile devices using semantically-linked imagesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102967171:COnline publication date: 1-Mar-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2022.102967
Jamalzadeh MRekik YGrisoni LVatavu RVolpe GDancu A(2023)Effects of Moving Speed and Phone Location on Eyes-Free Gesture Input with Mobile DevicesHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_30(469-478)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42280-5_30
Tanigaki KTeoh TYoshimura NMaekawa THara T(2022)Predicting Performance Improvement of Human Activity Recognition Model by Additional Data CollectionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503196:3(1-33)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550319
Feng CWang NJiang YZheng XLi KWang ZChen X(2022)Wi-LearnerProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503186:3(1-27)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550318
Devine JMoskal Mde Halleux PBall THodges SD'Amone GGakure DFinney JUnderwood LHartley KKos POppenheim M(2022)Plug-and-play Physical Computing with JacdacProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503176:3(1-30)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550317
Deldari SXue HSaeed ASmith DSalim F(2022)COCOAProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503166:3(1-28)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550316
Chen YFennedy KFogel AZhao SZhang CLiu LYen C(2022)SSpoonProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503126:3(1-32)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550312
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents