Article

Accuracy measures for evaluating computer pointing devices

Authors:

I. Scott MacKenzie,

Tatu Kauppinen,

Miika SilfverbergAuthors Info & Claims

CHI '01: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 9 - 16

https://doi.org/10.1145/365024.365028

Published: 01 March 2001 Publication History

Get Access

Abstract

In view of the difficulties in evaluating computer pointing devices across different tasks within dynamic and complex systems, new performance measures are needed. This paper proposes seven new accuracy measures to elicit (sometimes subtle) differences among devices in precision pointing tasks. The measures are target re-entry, task axis crossing, movement direction change, orthogonal direction change, movement variability, movement error, and movement offset. Unlike movement time, error rate, and throughput, which are based on a single measurement per trial, the new measures capture aspects of movement behaviour during a trial. The theoretical basis and computational techniques for the measures are described, with examples given. An evaluation with four pointing devices was conducted to validate the measures. A causal relationship to pointing device efficiency (viz. throughput) was found, as was an ability to discriminate among devices in situations where differences did not otherwise appear. Implications for pointing device research are discussed.

References

[1]

Accot, J., and Zhai, S. Beyond Fitts' law: Models for trajectory-based HCI tasks, In Proceedings of the CHI '97 Conference on Human Factors in Computing Systems. New York: ACM, 1997, pp. 295-302.

Digital Library

Google Scholar

[2]

Akamatsu, M., MacKenzie, I. S., and Hasbrouq, T. A comparison of tactile, auditory, and visual feedback in a pointing task using a mouse-type device, Ergonomics 38 (1995), 816-827.

Crossref

Google Scholar

[3]

Bailey, R. W. Human performance engineering: Designing high quality, professional user interfaces for computer products, applications, and systems, 3rd ed. Upper Saddle River, NJ: Prentice Hall, 1996).

Digital Library

Google Scholar

[4]

Card, S. K., English, W. K., and Burr, B. J. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT, Ergonomics 21 (1978), 601-613.

Crossref

Google Scholar

[5]

Douglas, S. A., Kirkpatrick, A. E., and MacKenzie, I. S. Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard, In Proceedings of the CHI '99 Conference on Human Factors in Computing Systems. New York: ACM, 1999, pp. 215-222.

Digital Library

Google Scholar

[6]

English, W. K., Engelbart, D. C., and Berman, M. L. Display selection techniques for text manipulation, IEEE Transactions on Human Factors in Electronics HFE-8 (1967), 5-15.

Crossref

Google Scholar

[7]

Epps, B. W. Comparison of six cursor control devices based on Fitts' law models, In Proceedings of the Human Factors Society 30th Annual Meeting. Santa Monica, CA: Human Factors Society, 1986, pp. 327-331.

Crossref

Google Scholar

[8]

ISO ISO/TC 159/SC4/WG3 N147: Ergonomic requirements for office work with visual display terminals (VDTs) - Part 9 - Requirements for non-keyboard input devices, International Organisation for Standardisation, May 25, 1998.

Google Scholar

[9]

Karat, J., McDonald, J. E., and Anderson, M. A comparison of selection techniques: touch panel, mouse, and keyboard, In Human-Computer Interaction--INTERACT '84. Elsevier Science Publishers, 1985, pp. 189-193.

Google Scholar

[10]

MacKenzie, I. S. Fitts' law as a research and design tool in human-computer interaction, Human-Computer Interaction 7 (1992), 91-139.

Digital Library

Google Scholar

[11]

MacKenzie, I. S., Sellen, A., and Buxton, W. A comparison of input devices in elemental pointing and dragging tasks, In Proceedings of the ACM Conference on Human Factors in Computing Systems - CHI '91. New York: ACM, 1991, pp. 161-166.

Digital Library

Google Scholar

[12]

Mithal, A. K., and Douglas, S. A. Differences in movement microstructure of the mouse and the fingercontrolled isometric joystick, In Proceedings of the ACM Conference on Human Factors in Computing Systems - CHI '96. New York: ACM, 1996, pp. 300-307.

Digital Library

Google Scholar

[13]

Murata, A. An experimental evaluation of mouse, joystick, joycard, lightpen, trackball, and touchscreen for pointing: Basic study on human interface design, In Proceedings of the Fourth International Conference on Human-Computer Interaction. Elsevier, 1991, 123-127.

Google Scholar

[14]

Stevens, J. Applied multivariate statistics for the social sciences, 3rd ed. (Mahwah, NJ: Erlbaum, 1996).

Digital Library

Google Scholar

Cited By

View all

Zielasko DJaquez Lora J(2024)Ubiquitous BlowClick: Non-verbal Vocal Input for Confirmation with Hand-held Mobile Devices in the FieldProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682101(1-8)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682101
Kong JZhong MFogarty JWobbrock J(2024)The Ability-Based Design Mobile Toolkit (ABD-MT): Developer Support for Runtime Interface Adaptation Based on Users' AbilitiesProceedings of the ACM on Human-Computer Interaction10.1145/36765248:MHCI(1-26)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676524
Mitchell CWobbrock J(2024)Characterizing "Motor Ability" for Ability-Based DesignProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675646(1-15)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675646
Show More Cited By

Index Terms

Accuracy measures for evaluating computer pointing devices
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
    2. Interaction devices
      1. Touch screens

Recommendations

Pupil vs. Eyelid: Evaluating the Accuracy of Blink Detection in Pupil-based Eye Tracking Devices
Abstract
Spontaneous eye blinks as a means to tap into human cognitive and affective processes have been demonstrated to offer valuable insight in various fields of application, such as human-computer-interaction and driver drowsiness detection. ...
Accuracy of interpreting pointing gestures in egocentric view
UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Communicating spatial information by pointing is ubiquitous in human interactions. With the growing use of head-mounted cameras for collaborative purposes, it is important to assess how accurately viewers of the resulting egocentric videos can interpret ...
MAGIC pointing for eyewear computers
ISWC '15: Proceedings of the 2015 ACM International Symposium on Wearable Computers

In this paper, we propose a combination of head and eye movements for touchlessly controlling the "mouse pointer" on eyewear devices, exploiting the speed of eye pointing and accuracy of head pointing. The method is a wearable computer-targeted ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI '01: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

March 2001

559 pages

ISBN:1581133278

DOI:10.1145/365024

Chairmen:
Julie Jacko
Georgia Institute of Technology
,
Andrew Sears
UMBC

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 March 2001

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI01

Sponsor:

SIGCHI

CHI01: Human Factors in Computing Systems

Washington, Seattle, USA

Acceptance Rates

CHI '01 Paper Acceptance Rate 69 of 352 submissions, 20%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

307
Total Citations
View Citations
3,658
Total Downloads

Downloads (Last 12 months)114
Downloads (Last 6 weeks)10

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zielasko DJaquez Lora J(2024)Ubiquitous BlowClick: Non-verbal Vocal Input for Confirmation with Hand-held Mobile Devices in the FieldProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682101(1-8)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682101
Kong JZhong MFogarty JWobbrock J(2024)The Ability-Based Design Mobile Toolkit (ABD-MT): Developer Support for Runtime Interface Adaptation Based on Users' AbilitiesProceedings of the ACM on Human-Computer Interaction10.1145/36765248:MHCI(1-26)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676524
Mitchell CWobbrock J(2024)Characterizing "Motor Ability" for Ability-Based DesignProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675646(1-15)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675646
Islam MSojib NKabir IAmit AAmin MBillah S(2024)Wheeler: A Three-Wheeled Input Device for Usable, Efficient, and Versatile Non-Visual InteractionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676396(1-20)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676396
V S RS AR AV NPrabhakar G(2024)To Show or Hide - Investigating the Effect of Cursor Visibility in Gaze-controlled InterfacesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651005(1-6)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651005
Kang DKim NKang DYoon JKim SLee B(2024)Quantifying Wrist-Aiming Habits with A Dual-Sensor Mouse: Implications for Player Performance and WorkloadProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642797(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642797
Kundu AEg RClaypool M(2024)The Interplay Between Delay and Device in a Moving Target Selection Game2024 IEEE Conference on Games (CoG)10.1109/CoG60054.2024.10645564(1-8)Online publication date: 5-Aug-2024
https://doi.org/10.1109/CoG60054.2024.10645564
Thushara BAdithya VSreekanth N(2024)Gesture centric interaction: evaluating hand and head gestures in touchless cursor controlErgonomics10.1080/00140139.2024.2411302(1-21)Online publication date: 23-Oct-2024
https://doi.org/10.1080/00140139.2024.2411302
Warburton MCampagnoli CMon-Williams MMushtaq FMorehead J(2024)Input device matters for measures of behaviour in online experimentsPsychological Research10.1007/s00426-024-02065-189:1Online publication date: 28-Nov-2024
https://doi.org/10.1007/s00426-024-02065-1
Villamañe MAlvarez A(2024)Facilitating and automating usability testing of educational technologiesComputer Applications in Engineering Education10.1002/cae.2272532:3Online publication date: 19-Feb-2024
https://doi.org/10.1002/cae.22725
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Pupil vs. Eyelid: Evaluating the Accuracy of Blink Detection in Pupil-based Eye Tracking Devices

Accuracy of interpreting pointing gestures in egocentric view

MAGIC pointing for eyewear computers