More Web Proxy on the site http://driver.im/

research-article

Switching Between Standard Pointing Methods with Current and Emerging Computer Form Factors

Authors:

Margaret Jean Foley,

Daniel VogelAuthors Info & Claims

CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Article No.: 212, Pages 1 - 14

https://doi.org/10.1145/3491102.3517433

Published: 29 April 2022 Publication History

Abstract

We investigate performance characteristics when switching between four pointing methods: absolute touch, absolute pen, relative mouse, and relative trackpad. The established “subtraction method” protocol used in mode-switching studies is extended to test pairs of methods and accommodate switch direction, multiple baselines, and controlling relative cursor position. A first experiment examines method switching on and around the horizontal surface of a tablet. Results find switching between pen and touch is fastest, and switching between relative and absolute methods incurs additional time penalty. A second experiment expands the investigation to an emerging foldable all-screen laptop form factor where switching also occurs on an angled surface and along a smoothly curved hinge. Results find switching between trackpad and touch is fastest, with all switching times generally higher. Our work contributes missing empirical evidence for switching performance using modern input methods, and our results can inform interaction design for current and emerging device form factors.

Supplementary Material

MP4 File (3491102.3517433-video-figure.mp4)

Video Figure

Download
288.83 MB

MP4 File (3491102.3517433-talk-video.mp4)

Talk Video

Download
180.54 MB

References

[1]

[1] [n.d.]. https://www.microsoft.com/en-us/surface/devices/surface-duo?activetab=overview

[2]

2020. HUAWEI Mate Xs. https://consumer.huawei.com/ca/phones/mate-x-s/

[3]

2021. Samsung Galaxy Z Fold2 5G. https://www.samsung.com/ca/smartphones/galaxy-z-fold2/

[4]

Johnny Accot and Shumin Zhai. 1999. Performance Evaluation of Input Devices in Trajectory-Based Tasks: An Application of the Steering Law. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Pittsburgh, Pennsylvania, USA) (CHI ’99). Association for Computing Machinery, New York, NY, USA, 466–472. https://doi.org/10.1145/302979.303133

Digital Library

[5]

Shiroq Al-Megren, Ahmed Kharrufa, Jonathan Hook, Amey Holden, Selina Sutton, and Patrick Olivier. 2015. Comparing Fatigue When Using Large Horizontal and Vertical Multi-touch Interaction Displays. In Human-Computer Interaction – INTERACT 2015, Julio Abascal, Simone Barbosa, Mirko Fetter, Tom Gross, Philippe Palanque, and Marco Winckler (Eds.). Springer International Publishing, Cham, 156–164.

Digital Library

[6]

Florian Block and Hans Gellersen. 2010. Two-handed input in a standard configuration of notebook with external mouse. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries. 62–71.

Digital Library

[7]

Stuart K Card, William K English, and Betty J Burr. 1978. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT. Ergonomics 21, 8 (1978), 601–613.

[8]

Stuart K. Card, Thomas P. Moran, and Allen Newell. 1980. The Keystroke-Level Model for User Performance Time with Interactive Systems. Commun. ACM 23, 7 (July 1980), 396–410. https://doi.org/10.1145/358886.358895

Digital Library

[9]

Géry Casiez and Nicolas Roussel. 2011. No More Bricolage! Methods and Tools to Characterize, Replicate and Compare Pointing Transfer Functions. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST ’11). Association for Computing Machinery, New York, NY, USA, 603–614. https://doi.org/10.1145/2047196.2047276

Digital Library

[10]

Brendan Cassidy, Janet C. Read, and I. Scott MacKenzie. 2019. FittsFarm: Comparing Children’s Drag-and-Drop Performance Using Finger and Stylus Input on Tablets. In Human-Computer Interaction – INTERACT 2019, David Lamas, Fernando Loizides, Lennart Nacke, Helen Petrie, Marco Winckler, and Panayiotis Zaphiris (Eds.). Springer International Publishing, Cham, 656–668.

Digital Library

[11]

A. Cockburn, D. Ahlström, and C. Gutwin. 2012. Understanding performance in touch selections: Tap, drag and radial pointing drag with finger, stylus and mouse. International Journal of Human-Computer Studies 70, 3 (2012), 218–233. https://doi.org/10.1016/j.ijhcs.2011.11.002

Digital Library

[12]

Terence Dickson, Rina R. Wehbe, Fabrice Matulic, and Daniel Vogel. 2021. HybridPointing for Touch: Switching Between Absolute and Relative Pointing on Large Touch Screens. Proc. ACM Hum.-Comput. Interact. 5, ISS, Article 495 (nov 2021), 22 pages. https://doi.org/10.1145/3488540

Digital Library

[13]

R. F. Dillon, Jeff D. Edey, and Jo W. Tombaugh. 1990. Measuring the True Cost of Command Selection: Techniques and Results. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Seattle, Washington, USA) (CHI ’90). Association for Computing Machinery, New York, NY, USA, 19–26. https://doi.org/10.1145/97243.97247

Digital Library

[14]

Lisa A Elkin, Matthew Kay, James J Higgins, and Jacob O Wobbrock. 2021. An Aligned Rank Transform Procedure for Multifactor Contrast Tests. arXiv preprint arXiv:2102.11824(2021).

[15]

Paul M. Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement.Journal of Experimental Psychology 47, 6 (1954), 381–391. https://doi.org/10.1037/h0055392

[16]

Clifton Forlines and Ravin Balakrishnan. 2008. Evaluating Tactile Feedback and Direct vs. Indirect Stylus Input in Pointing and Crossing Selection Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI ’08). Association for Computing Machinery, New York, NY, USA, 1563–1572. https://doi.org/10.1145/1357054.1357299

Digital Library

[17]

Clifton Forlines, Daniel Vogel, and Ravin Balakrishnan. 2006. HybridPointing: Fluid Switching between Absolute and Relative Pointing with a Direct Input Device. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (Montreux, Switzerland) (UIST ’06). Association for Computing Machinery, New York, NY, USA, 211–220. https://doi.org/10.1145/1166253.1166286

Digital Library

[18]

Clifton Forlines, Daniel Wigdor, Chia Shen, and Ravin Balakrishnan. 2007. Direct-Touch vs. Mouse Input for Tabletop Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’07). Association for Computing Machinery, New York, NY, USA, 647–656. https://doi.org/10.1145/1240624.1240726

Digital Library

[19]

Ashley General, Brandon Da Silva, Daniel Esteves, Matthew Halleran, and Michael Liut. [n.d.]. A comparative analysis between the mouse, trackpad and the leap motion.

[20]

Jiseong Gu, Seongkook Heo, Jaehyun Han, Sunjun Kim, and Geehyuk Lee. 2013. LongPad: A Touchpad Using the Entire Area below the Keyboard of a Laptop Computer. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 1421–1430. https://doi.org/10.1145/2470654.2466188

Digital Library

[21]

Morten Hertzum and Kasper Hornbæk. 2010. How age affects pointing with mouse and touchpad: A comparison of young, adult, and elderly users. Intl. Journal of Human–Computer Interaction 26, 7(2010), 703–734.

[22]

Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-Air Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 1063–1072. https://doi.org/10.1145/2556288.2557130

Digital Library

[23]

Ken Hinckley and Bill Buxton. 2016. Inking outside the box: how context sensing affords more natural pen (and touch) computing. In Revolutionizing Education with Digital Ink. Springer, 27–47.

[24]

Ken Hinckley, Morgan Dixon, Raman Sarin, Francois Guimbretiere, and Ravin Balakrishnan. 2009. Codex: A Dual Screen Tablet Computer. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, NY, USA, 1933–1942. https://doi.org/10.1145/1518701.1518996

Digital Library

[25]

Ken Hinckley, Francois Guimbretiere, Patrick Baudisch, Raman Sarin, Maneesh Agrawala, and Ed Cutrell. 2006. The Springboard: Multiple Modes in One Spring-Loaded Control. Association for Computing Machinery, New York, NY, USA, 181–190. https://doi.org/10.1145/1124772.1124801

Digital Library

[26]

ISO”. 2000. ISO 9241-9:2000. https://www.iso.org/standard/30030.html

[27]

Gourab Kar, Amy Vu, Begoña Juliá Nehme, and Alan Hedge. 2015. Effects of Mouse, Trackpad and 3d Motion and Gesture Control on Performance, Posture, and Comfort. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 59, 1(2015), 327–331. https://doi.org/10.1177/1541931215591068 arXiv:https://doi.org/10.1177/1541931215591068

[28]

Sangyoon Lee, Youn-kyung Lim, and Geehyuk Lee. 2020. MirrorPad: Mirror on Touchpad for Direct Pen Interaction in the Laptop Environment. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3313831.3376212

Digital Library

[29]

Lenovo”. [n.d.]. ThinkPad X1 Fold (13”) PC. https://www.lenovo.com/ca/en/laptops/thinkpad/thinkpad-x1/X1-Fold-G1/p/22TP2X1X1F1

[30]

Yang Li, Ken Hinckley, Zhiwei Guan, and James A. Landay. 2005. Experimental Analysis of Mode Switching Techniques in Pen-Based User Interfaces. Association for Computing Machinery, New York, NY, USA, 461–470. https://doi.org/10.1145/1054972.1055036

Digital Library

[31]

I. Scott MacKenzie and William Buxton. 1992. Extending Fitts’ Law to Two-Dimensional Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Monterey, California, USA) (CHI ’92). Association for Computing Machinery, New York, NY, USA, 219–226. https://doi.org/10.1145/142750.142794

Digital Library

[32]

Fabrice Matulic and Moira Norrie. 2012. Empirical Evaluation of Uni- and Bimodal Pen and Touch Interaction Properties on Digital Tabletops. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (Cambridge, Massachusetts, USA) (ITS ’12). Association for Computing Machinery, New York, NY, USA, 143–152. https://doi.org/10.1145/2396636.2396659

Digital Library

[33]

Donald A Norman. 1981. Categorization of action slips.Psychological review 88, 1 (1981), 1.

[34]

J Karen Parker, Regan L Mandryk, and Kori M Inkpen. 2005. TractorBeam: seamless integration of local and remote pointing for tabletop displays. In Proceedings of Graphics interface 2005. Citeseer, 33–40.

Digital Library

[35]

Ken Pfeuffer, Jason Alexander, Ming Ki Chong, Yanxia Zhang, and Hans Gellersen. 2015. Gaze-shifting: Direct-indirect input with pen and touch modulated by gaze. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. 373–383.

Digital Library

[36]

Ken Pfeuffer, Ken Hinckley, Michel Pahud, and Bill Buxton. 2017. Thumb+ Pen Interaction on Tablets. In CHI. Citeseer, 3254–3266.

[37]

J.A. Pickering. 1986. Touch-sensitive screens: the technologies and their application. International Journal of Man-Machine Studies 25, 3 (1986), 249–269. https://doi.org/10.1016/S0020-7373(86)80060-8

Digital Library

[38]

Gazelle Saniee-Monfared, Kevin Fan, Qianq Xu, Sachi Mizobuchi, Lewis Zhou, Pourang Polad Irani, and Wei Li. 2020. Tent Mode Interactions: Exploring Collocated Multi-User Interaction on a Foldable Device. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services (Oldenburg, Germany) (MobileHCI ’20). Association for Computing Machinery, New York, NY, USA, Article 14, 12 pages. https://doi.org/10.1145/3379503.3403566

Digital Library

[39]

Dominik Schmidt, Florian Block, and Hans Gellersen. 2009. A comparison of direct and indirect multi-touch input for large surfaces. In IFIP Conference on Human-Computer Interaction. Springer, 582–594.

Digital Library

[40]

Andrew Sears and Ben Shneiderman. 1991. High precision touchscreens: design strategies and comparisons with a mouse. International Journal of Man-Machine Studies 34, 4 (1991), 593–613. https://doi.org/10.1016/0020-7373(91)90037-8

Digital Library

[41]

Junwei Sun, Wolfgang Stuerzlinger, and Bernhard E. Riecke. 2018. Comparing Input Methods and Cursors for 3D Positioning with Head-Mounted Displays. In Proceedings of the 15th ACM Symposium on Applied Perception (Vancouver, British Columbia, Canada) (SAP ’18). Association for Computing Machinery, New York, NY, USA, Article 8, 8 pages. https://doi.org/10.1145/3225153.3225167

Digital Library

[42]

Hemant Bhaskar Surale, Fabrice Matulic, and Daniel Vogel. 2017. Experimental Analysis of Mode Switching Techniques in Touch-Based User Interfaces. Association for Computing Machinery, New York, NY, USA, 3267–3280. https://doi.org/10.1145/3025453.3025865

Digital Library

[43]

Hemant Bhaskar Surale, Fabrice Matulic, and Daniel Vogel. 2019. Experimental Analysis of Barehand Mid-Air Mode-Switching Techniques in Virtual Reality. Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300426

Digital Library

[44]

Larry Tesler. 1981. The smalltalk environment. Byte 6, 8 (1981).

[45]

Huawei Tu, Xing-Dong Yang, Feng Wang, Feng Tian, and Xiangshi Ren. 2012. Mode Switching Techniques through Pen and Device Profiles. In Proceedings of the 10th Asia Pacific Conference on Computer Human Interaction (Matsue-city, Shimane, Japan) (APCHI ’12). Association for Computing Machinery, New York, NY, USA, 169–176. https://doi.org/10.1145/2350046.2350081

Digital Library

[46]

Daniel Vogel and Patrick Baudisch. 2007. Shift: A Technique for Operating Pen-Based Interfaces Using Touch. Association for Computing Machinery, New York, NY, USA, 657–666. https://doi.org/10.1145/1240624.1240727

Digital Library

[47]

Jacob O Wobbrock, Leah Findlater, Darren Gergle, and James J Higgins. 2011. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proceedings of the SIGCHI conference on human factors in computing systems. 143–146.

Digital Library

Cited By

Pei YJiang BZhang KLu ZZha MWang GLiu ZXie NYang YShen H(2024)Toward Optimized AR-Based Human-Robot Interaction Ergonomics: Modeling and Predicting Interaction Comfort2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00195(797-798)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00195
Chen XGuo DFeng LChen BLiu W(2023)Compass+Ring: A Multimodal Menu to Improve Interaction Performance and Comfortability in One-handed Scenarios2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00062(473-482)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00062
Plasson CBlanch RNigay L(2022)Selection Techniques for 3D Extended Desktop Workstation with AR HMD2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00062(460-469)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00062

Index Terms

Switching Between Standard Pointing Methods with Current and Emerging Computer Form Factors
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques

Recommendations

Mode switching techniques through pen and device profiles
APCHI '12: Proceedings of the 10th asia pacific conference on Computer human interaction

In pen-based interfaces, inking and gesturing are two central tasks, and switching from inking to gesturing is an important issue. Previous studies have focused on mode switching in pen-based desktop devices. However, because pen-based handheld devices ...
Foldable interactive displays
UIST '08: Proceedings of the 21st annual ACM symposium on User interface software and technology

Modern computer displays tend to be in fixed size, rigid, and rectilinear rendering them insensitive to the visual area demands of an application or the desires of the user. Foldable displays offer the ability to reshape and resize the interactive ...
Comparing input methods and cursors for 3D positioning with head-mounted displays
SAP '18: Proceedings of the 15th ACM Symposium on Applied Perception

Moving objects is an important task in 3D user interfaces. In this work, we focus on (precise) 3D object positioning in immersive virtual reality systems, especially head-mounted displays (HMDs). To evaluate input method performance for 3D positioning, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

April 2022

10459 pages

ISBN:9781450391573

DOI:10.1145/3491102

Editors:
Simone Barbosa
PUC-Rio, Brazil
,
Cliff Lampe
University of Michigan, USA
,
Caroline Appert
Université Paris-Saclay, France
,
David A. Shamma
Toyota Research Institute, USA
,
Steven Drucker
Microsoft Research, USA
,
Julie Williamson
University of Glasgow, UK
,
Koji Yatani
University of Tokyo, Japan

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

NSERC Discovery Grant
Waterloo-Huawei Joint Innovation Lab

Conference

CHI '22

Sponsor:

SIGCHI

CHI '22: CHI Conference on Human Factors in Computing Systems

April 29 - May 5, 2022

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
491
Total Downloads

Downloads (Last 12 months)135
Downloads (Last 6 weeks)22

Reflects downloads up to 17 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pei YJiang BZhang KLu ZZha MWang GLiu ZXie NYang YShen H(2024)Toward Optimized AR-Based Human-Robot Interaction Ergonomics: Modeling and Predicting Interaction Comfort2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00195(797-798)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00195
Chen XGuo DFeng LChen BLiu W(2023)Compass+Ring: A Multimodal Menu to Improve Interaction Performance and Comfortability in One-handed Scenarios2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00062(473-482)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00062
Plasson CBlanch RNigay L(2022)Selection Techniques for 3D Extended Desktop Workstation with AR HMD2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00062(460-469)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00062

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents