research-article

Investigating how the hand interacts with different mobile phones

Authors:

Joanna HareAuthors Info & Claims

MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

Pages 698 - 705

https://doi.org/10.1145/2957265.2961840

Published: 06 September 2016 Publication History

Get Access

Abstract

In this paper we investigate the physical interaction between the hand and three types of mobile device interaction: touchscreen, physical keyboard and stylus. Through a controlled study using video observational analysis, we observed firstly, how the participants gripped the three devices and how these grips were device dependent. Secondly we looked closely at these grips to uncover how participants performed what we call micro-movements to facilitate a greater range of interaction, e.g. reaching across the keyboard. The results extend current knowledge by comparing three handheld device input methods and observing the movements, which the hand makes in five grips. The paper concludes by describing the development of a conceptual design, proposed as a provocation for the opening of dialogue on how we conceive hand usage and how it might be optimized when designed for mobile devices.

References

[1]

Guiard, Y. (1987). Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. J. Motor Behavior, 19(4), 486--517.

Crossref

Google Scholar

[2]

iOS App Anatomy Retrieved February 9, 2016 from https://developer.apple.com/library/ios/documentation/UserExperience/Conceptual/MobileHIG/Anatomy.html#//apple_ref/doc/uid/TP40006556-CH24-SWl

Google Scholar

[3]

K. Kim, W. Chang, S. Cho, J. Shim, H. Lee, J. Park, Y. Lee, and S. Kim. Hand Grip Pattern Recognition for Mobile User Interfaces. In Proceedings of the National Conference on Artificial Intelligence, vol 21, page 1789. Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press; 1999, 2006.

Digital Library

Google Scholar

[4]

Lung-Pan Cheng, Fang-I Hsiao, Yen-Ting Liu, and Mike Y. Chen. 2012. iRotate: automatic screen rotation based on face orientation. Proc. CHI '12. ACM, New York, NY, USA, 2203--2210.

Digital Library

Google Scholar

[5]

Lung-Pan Cheng, Hsiang-Sheng Liang, Che-Yang Wu, and Mike Y. Chen. 2013. iGrasp: grasp-based adaptive keyboard for mobile devices. Proc. CHI EA '13. ACM, New York, NY, USA, 2791--2792.

Digital Library

Google Scholar

[6]

Matei Negulescu, Joanna McGrenere, Grip Change as an Information Side Channel for Mobile Touch Interaction, Proc. 33rd Annual ACM Conference on Human Factors in Computing Systems, April 18-23, 2015, Seoul, Republic of Korea.

Digital Library

Google Scholar

[7]

Mohd Noor, M. F., Ramsay, A., Hughes, S., Rogers, S., Williamson, J., and Murray-Smith, R. 28 Frames Later: Predicting Screen Touches from Back-of-device Grip Changes. Proc. CHI'14, ACM (2014), 2005--2008.

Digital Library

Google Scholar

[8]

Napier, J., (1993) Hands, Published by Princeton University Press.

Google Scholar

[9]

R. Wimmer, S. Boring, HandSense: discriminating different ways of grasping and holding a tangible user interface, Proc. 3rd International Conference on Tangible and Embedded Interaction, February 16-18, 2009, Cambridge, United Kingdom

Digital Library

Google Scholar

[10]

Research Into Left-Handedness And Its Effects. Retrieved September 25, 2015 from http://www.anythinglefthanded.co.uk/research/lefthanded-research.html#sthash.9u4nKjNS.dpbs

Google Scholar

[11]

Youli Chang, Sehi L'Yi, Kyle Koh, and Jinwook Seo. 2015. Understanding Users' Touch Behavior on Large Mobile Touch-Screens and Assisted Targeting by Tilting Gesture. Proc. CHI '15. ACM, New York, NY, USA, 1499--1508.

Digital Library

Google Scholar

[12]

Tactus Retrieved May 3, 2016 from http://tactustechnology.com/technology/

Google Scholar

Cited By

View all

Zieher TProbst K(2024)Usability Optimization for Mobile Menu Design: An Empirical Study of Hand Grips and User PreferencesProceedings of the ACM on Human-Computer Interaction10.1145/36765088:MHCI(1-19)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676508
Zhao KWu CXu THe LSerrano MRoudaut A(2024)Grip-Reach-Touch-Repeat: A Refined Model of Grasp to Encompass One-Handed Interaction with Arbitrary Form Factor DevicesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642022(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642022
Ikematsu KOshima HEardley RSiio I(2020)Investigating How Smartphone Movement is Affected by Lying Down Body PostureProceedings of the ACM on Human-Computer Interaction10.1145/34273204:ISS(1-17)Online publication date: 4-Nov-2020
https://dl.acm.org/doi/10.1145/3427320
Show More Cited By

Index Terms

Investigating how the hand interacts with different mobile phones
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Finger Placement and Hand Grasp during Smartphone Interaction
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Smartphones are currently the most successful mobile devices. Through their touchscreens, they combine input and output in a single interface. A body of work investigated interaction beyond direct touch. In particular, previous work proposed using the ...
Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

In this paper we present an investigation into how hand usage is affected by different mobile phone form factors. Our initial (qualitative) study explored how users interact with various mobile phone types (touchscreen, physical keyboard and stylus). ...
Investigating How Smartphone Movement is Affected by Body Posture
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

We present an investigation into how hand usage is affected by different body postures (Sitting at a table, Lying down and Standing) when interacting with smartphones. We theorize a list of factors (smartphone support, body support and muscle usage) and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

September 2016

664 pages

ISBN:9781450344135

DOI:10.1145/2957265

General Chairs:
Fabio Paternò
CNR-ISTI, Italy
,
Kaisa Väänänen
Tampere University of Technology, Finland
,
Program Chairs:
Karen Church
Intercom, USA
,
Jonna Häkkilä
University of Lapland, Finland
,
Antonio Krüger
DFKI, Germany
,
Marcos Serrano
University of Toulouse, France

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 September 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI '16

Sponsor:

SIGCHI

MobileHCI '16: 18th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 6 - 9, 2016

Florence, Italy

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
357
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zieher TProbst K(2024)Usability Optimization for Mobile Menu Design: An Empirical Study of Hand Grips and User PreferencesProceedings of the ACM on Human-Computer Interaction10.1145/36765088:MHCI(1-19)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676508
Zhao KWu CXu THe LSerrano MRoudaut A(2024)Grip-Reach-Touch-Repeat: A Refined Model of Grasp to Encompass One-Handed Interaction with Arbitrary Form Factor DevicesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642022(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642022
Ikematsu KOshima HEardley RSiio I(2020)Investigating How Smartphone Movement is Affected by Lying Down Body PostureProceedings of the ACM on Human-Computer Interaction10.1145/34273204:ISS(1-17)Online publication date: 4-Nov-2020
https://dl.acm.org/doi/10.1145/3427320
Mayer SLe HFunk MHenze NLee BLee GScott STory MKim J(2019)Finding the Sweet SpotProceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces10.1145/3343055.3359705(171-179)Online publication date: 10-Nov-2019
https://dl.acm.org/doi/10.1145/3343055.3359705
Le HMayer SSteuerlein BHenze N(2019)Investigating Unintended Inputs for One-Handed Touch Interaction Beyond the TouchscreenProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3340145(1-14)Online publication date: 1-Oct-2019
https://dl.acm.org/doi/10.1145/3338286.3340145
Rosso JCoutrix CJones MNigay LCatarci TNorman KMecella M(2018)Simulating an extendable tangible slider for eyes-free one-handed interaction on mobile devicesProceedings of the 2018 International Conference on Advanced Visual Interfaces10.1145/3206505.3206510(1-9)Online publication date: 29-May-2018
https://dl.acm.org/doi/10.1145/3206505.3206510
Eardley RRoudaut AGill SThompson SKoskinen ILim YCerratto-Pargman TChow KOdom W(2018)Designing for Multiple Hand Grips and Body Postures within the UX of a moving SmartphoneProceedings of the 2018 Designing Interactive Systems Conference10.1145/3196709.3196711(611-621)Online publication date: 8-Jun-2018
https://dl.acm.org/doi/10.1145/3196709.3196711
Le HKosch TBader PMayer SHenze NMandryk RHancock MPerry MCox A(2018)PalmTouchProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173934(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173934
Eardley RRoudaut AGill SThompson SMandryk RHancock MPerry MCox A(2018)Investigating How Smartphone Movement is Affected by Body PostureProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173776(1-8)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173776
Le HMayer SBader PHenze NMandryk RHancock MPerry MCox A(2018)Fingers' Range and Comfortable Area for One-Handed Smartphone Interaction Beyond the TouchscreenProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173605(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173605
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Finger Placement and Hand Grasp during Smartphone Interaction

Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones

Investigating How Smartphone Movement is Affected by Body Posture