More Web Proxy on the site http://driver.im/

article

Free access

Evaluating user and system models: applying scaling techniques to problems in human-computer interaction

Authors:

Wendy A. Kellogg,

Timothy J. BreenAuthors Info & Claims

ACM SIGCHI Bulletin, Volume 17, Issue SI

Pages 303 - 308

https://doi.org/10.1145/30851.275647

Published: 01 May 1986 Publication History

Abstract

A user's mental model of a system should be an important determinant of performance and as well as a means of understanding why particular user errors occur. In particular, experienced users' models should be in closer agreement with the system than less experienced users' models, and deviations of expert models from the system should correspond to difficulties in performance and suggest ways that system usability could be improved. The present study explored the utility of scaling techniques for defining and comparing user and system models. The results support the assertion that with experience users' mental models approach the system model. However, even experienced users had significant deviations from the system model, leading to predictions of where experts would have difficulty using the system and suggestions for improving usability.

References

[1]

Adelson, B. When novices surpass experts: The difficulty of a task can increase with expertise. Journal Experimental Psychology: Learning, Memory and Cognition, 10(3), 1984, 483-495.

[2]

Anderson, J.R. The Architecture of Cognition. Harvard University Press, Cambridge, Massachusetts, 1983.

Digital Library

[3]

Baggett, P., and Ehrenfeucht, A. Conceptualizing assembly tasks. Technical Report No. 139, Institute of Cognitive Science, University of Colorado, Boulder, Colorado 80309, 1985.

[4]

Bonar, J., and Soloway, E. Preprogramming knowledge: A major source of misconceptions in novice programmers. Human-Computer Interaction, 1(2), 1986, 133-162.

Digital Library

[5]

Carroll, J.M., and Mack, R.L. Learning to use a word processor: By doing, by thinking, and by knowing. In J.C. Thomas and M. L. Schneider (Eds.), Human Factors in Computer Systems. Ablex: Norwood, New Jersey, 1984.

Digital Library

[6]

Cohen, J., and Cohen, P. Applied Multiple Regression~Correlation Analysis for the Behavioral Sciences. Erlbaum: Hillsdale, New Jersey, 1975.

[7]

Cooke, N.M., and Schvaneveldt, R.W. Variations in cognitive networks with computer programming experience. Unpublished manuscript, New Mexico State University, Las Cruces, New Mexico 88003, 1986.

[8]

Hays, W.L. Statistics for the Social Sciences, 2nd Edition. Holt, Rinehart and Winston, Inc.: New York, New York, 1973.

[9]

Kay, D.S., and Black, J.B. Changes in knowledge representations of computer systems with experience. Proceedings of the Human Factors Society, 28th Annual Meeting, San Antonio, Texas, 1984.

[10]

Kay, D.S., and Black, J.B. The evolution of knowledge representations with increasing expertise in using systems. Proceedings of the Seventh Annual Conference of the Cognitive Science Society, Irvine, California, 1985.

[11]

Kellogg, W.A., and Breen, T.J. Using psychological scaling techniques to evaluate user and system models. Unpublished manuscript, T.J. Watson Research Center, Yorktown Heights, NY, 1987.

[12]

Schvaneveldt, R.W., Durso, F.T., and Dearholt, D.W. Pathfinder: Scaling with network structures. Memoranda in Computer and Cognitive Science, Report No. MCCS-85-9, Computer Research Laboratory, New Mexico State University, 1985.

[13]

Sehvaneveldt, R.W., Durso, F.T., Goldsmith, T.E., Breen, T.J., Cooke, N.J., Tucker, R.G., and DeMaio, J.C. Measuring the structure of expertise. Memoranda in Computer and Cognitive Science, Report No. MCCS-85-32, Computer Research Laboratory, New Mexico State University, 1985.

[14]

Sebrechts, M.M., Black, J.B., Galambos, J.A., Wagner, R.K., Deck, J.A., and Wikler, E.A. The effects of diagrams on learning to use a system. Report No. 2, Learning and Using Systems, Yale University, New Haven, Connecticut, 1983.

[15]

Stevens, A., Collins, A., and Goldin, S. Misconceptions in students' understanding. International Journal of Man-Machine Studies, 11, 1979, 145-156.

Cited By

Palmer JDuffy TGomoll KGomoll TRichards-Palmquist JTrumble J(1988)The design and evaluation of online help for Unix EMACS: capturing the user in menu designIEEE Transactions on Professional Communication10.1109/47.692031:1(44-51)Online publication date: Mar-1988
https://doi.org/10.1109/47.6920
Doi T(2021)Effects of Asymmetry between Design Models and User Models on Subjective Comprehension of User InterfaceSymmetry10.3390/sym1305079513:5(795)Online publication date: 3-May-2021
https://doi.org/10.3390/sym13050795
DOI TMURATA A(2017)Effects of Knowledge of In-vehicle GUI Operation on Driving and GUI Tasks車載GUIの操作に関する知識がその操作と自動車運転に与える影響Transactions of Japan Society of Kansei Engineering10.5057/jjske.TJSKE-D-17-0007417:2(233-241)Online publication date: 2017
https://doi.org/10.5057/jjske.TJSKE-D-17-00074
Show More Cited By

Index Terms

Evaluating user and system models: applying scaling techniques to problems in human-computer interaction
1. Computing methodologies
  1. Artificial intelligence
    1. Knowledge representation and reasoning
      1. Cognitive robotics
    2. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Evaluating user and system models: applying scaling techniques to problems in human-computer interaction
CHI '87: Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface

A user's mental model of a system should be an important determinant of performance and as well as a means of understanding why particular user errors occur. In particular, experienced users' models should be in closer agreement with the system than ...
Evaluating user and system models: applying scaling techniques to problems in human-computer interaction

A user's mental model of a system should be an important determinant of performance and as well as a means of understanding why particular user errors occur. In particular, experienced users' models should be in closer agreement with the system than ...
Mental Models, Performance and Usability of a Complex Interactive System: The Case of Twitter
ENC '13: Proceedings of the 2013 Mexican International Conference on Computer Science

This work presents the study of a complex interactive system (Twitter) and the analysis of the relation between people's mental models, performance and usability perceptions. Participants were asked to perform a number of activities with Twitter and to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGCHI Bulletin

ACM SIGCHI Bulletin Volume 17, Issue SI

May 1987

319 pages

ISSN:0736-6906

DOI:10.1145/30851

Issue’s Table of Contents

CHI '87: Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface
May 1987
344 pages
ISBN:0897912136
DOI:10.1145/29933
Editors:
John M. Carroll,
Peter P. Tanner

Copyright © 1986 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 May 1986

Published in SIGCHI Volume 17, Issue SI

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
730
Total Downloads

Downloads (Last 12 months)84
Downloads (Last 6 weeks)12

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Palmer JDuffy TGomoll KGomoll TRichards-Palmquist JTrumble J(1988)The design and evaluation of online help for Unix EMACS: capturing the user in menu designIEEE Transactions on Professional Communication10.1109/47.692031:1(44-51)Online publication date: Mar-1988
https://doi.org/10.1109/47.6920
Doi T(2021)Effects of Asymmetry between Design Models and User Models on Subjective Comprehension of User InterfaceSymmetry10.3390/sym1305079513:5(795)Online publication date: 3-May-2021
https://doi.org/10.3390/sym13050795
DOI TMURATA A(2017)Effects of Knowledge of In-vehicle GUI Operation on Driving and GUI Tasks車載GUIの操作に関する知識がその操作と自動車運転に与える影響Transactions of Japan Society of Kansei Engineering10.5057/jjske.TJSKE-D-17-0007417:2(233-241)Online publication date: 2017
https://doi.org/10.5057/jjske.TJSKE-D-17-00074
Wilson JRutherford A(2016)Mental Models: Theory and Application in Human FactorsHuman Factors: The Journal of the Human Factors and Ergonomics Society10.1177/00187208890310060131:6(617-634)Online publication date: 23-Nov-2016
https://doi.org/10.1177/001872088903100601
Kjeldskov JSkov MStage JDonaldson A(2005)Does time heal?Proceedings of the 17th Australia conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the Future10.5555/1108368.1108394(1-10)Online publication date: 21-Nov-2005
https://dl.acm.org/doi/10.5555/1108368.1108394
Potosnak KAtwood M(1999)Conceptual designCHI '99 Extended Abstracts on Human Factors in Computing Systems10.1145/632716.632808(153-154)Online publication date: 15-May-1999
https://dl.acm.org/doi/10.1145/632716.632808
Potosnak KKarat CLund A(1998)Conceptual designCHI 98 Conference Summary on Human Factors in Computing Systems10.1145/286498.286643(163-164)Online publication date: 1-Apr-1998
https://dl.acm.org/doi/10.1145/286498.286643
Stager P(1991)Error Models for Operating Irregularities: Implications for AutomationAutomation and Systems Issues in Air Traffic Control10.1007/978-3-642-76556-8_31(321-338)Online publication date: 1991
https://doi.org/10.1007/978-3-642-76556-8_31
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents