Article

Free access

The growth of software skill: a longitudinal look at learning & performance

Authors:

Sharon MutterAuthors Info & Claims

CHI '93: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems

Pages 149 - 156

https://doi.org/10.1145/169059.169126

Published: 01 May 1993 Publication History

PDF eReader

Abstract

This research follows a group of users over time (16 months) as they progress from novice towards expert in their use of Lotus 1-2-3. Quantitative and qualitative measures of performance are compared with expert users having over three years of experience. The results indicate that the motor aspects of performance are relatively stable over time, while improvement in the cognitive components of the skill are dependent on aspects of the menu structure and how many things must be retrieved from memory, among other things. These results imply extensions to the Keystroke Level Model of skilled performance as well as suggest ways to design the user interfaces so as to speed the acquisition of expertise.

References

[1]

Anderson, J.R. (1982) Acquisition of cognitive skill Psychological Review, 89(4), 369-406.

Google Scholar

[2]

Card, S. K., Moran, T. P., and Newell, A. (1983) The Psychology of Human-Computer interaction. HiUsdale, NJ: Lawrence Erlbaum Assoc.

Digital Library

Google Scholar

[3]

Ericsson, K. A. and Smith, J. E. (Eds) (1991) Toward a general theory of expertise: Prospects and limits. Cambridge, UK: Cambridge University Press.

Google Scholar

[4]

Doane, S. M., Pelligrino, J. W., and Klatzky, R. L. (1990) Expertise in a computer operating system: Conceptualization and performance. Human Computer interaction, 5, 267-304.

Google Scholar

[5]

Kieras, D. E. and Poison, P. G. (1985) An approach to the formal analysis of user complexity. international Journal of Man-Machine Studies, 22, 365-394.

Google Scholar

[6]

Laird, J.E., Newell, A. and Rosenbloom, P. S. (1987) SOAR: An architecture for general intelligence. Artificial Intelligence, 33,1-64.

Digital Library

Google Scholar

[7]

Lane, D. M., Napier, H. A., Batsell, R. R., and Naman, J. L. (1991) The application of Card, Moran, and Newell's keystroke-level model to the operation of hierarchical menu systems. Unpublished manuscript under review, Rice University.

Google Scholar

[8]

Neves, D.M., and Anderson, J.R. (1981) Knowledge compilation: Mechanisms for the automatization of cognitive skills. In J.R. Anderson (Ed.) Cognitive skills and their acquisition. Hillsdale, NJ: John Wiley and Sons, 57-84.

Google Scholar

[9]

Newell, A., and Rosenbloom, P. S. (1981) Mechanisms of skill acquisition and the law of practice. In J.R. Anderson (Ed.) Cognitive skills and their acquisition. Hillsdale, NJ: John Wiley and Sons, 1-55.

Google Scholar

[10]

Nilsen, E., Jong, H., Olson, J. S., and Polson, P. G. (1992) Method engineering: From data to model to practice. Proceedings of CHI'92 Human Factors in Computing Systems, NY: ACM Press, 313-320.

Digital Library

Google Scholar

[11]

Olson, J. R. and Nilsen, E. (1987-1988) Analysis of the cognition involved in spreadsheet software interaction. Human-Computer Interaction, 3,309- 349.

Digital Library

Google Scholar

[12]

Olson, J. R. and Olson, G.M. (1990) The growth of cognitive modelling in human-computer interaction since GOMS. Human-Computer Interaction, 5, 221- 265.

Digital Library

Google Scholar

[13]

Poison, P.G. and Lewis, C.H. (1991) Theory-based design for easily learned interfaces. Human-Computer Interaction, 15, 191-220.

Google Scholar

[14]

Rosson, M. B. (1984) Effects of experience on learning, using, and evaluating a text editor. Human Factors, 26, 463-475.

Crossref

Google Scholar

Cited By

View all

Bailly GGiannisakis EMorel MAchard CKubicki SGirard PCalvary GLavoué E(2018)Characterize the transition from menus to hotkeysProceedings of the 30th Conference on l'Interaction Homme-Machine10.1145/3286689.3286699(30-41)Online publication date: 23-Oct-2018
https://dl.acm.org/doi/10.1145/3286689.3286699
Zheng JLewis BAvery JVogel DBaudisch PSchmidt AWilson A(2018)FingerArc and FingerChordProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242589(347-363)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3242587.3242589
Gray WLindstedt J(2016)Plateaus, Dips, and Leaps: Where to Look for Inventions and Discoveries During Skilled PerformanceCognitive Science10.1111/cogs.1241241:7(1838-1870)Online publication date: 20-Oct-2016
https://doi.org/10.1111/cogs.12412
Show More Cited By

Index Terms

The growth of software skill: a longitudinal look at learning & performance

Recommendations

Method engineering: from data to model to practice
CHI '92: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

This paper explores the behavior of experts choosing among various methods to accomplish tasks. Given the results showing that methods are not chosen solely on the basis of keystroke efficiency, we recommend a technique to help designers assess whether ...
Automatic detection of users' skill levels using high-frequency user interface events

Computer users have different levels of system skills. Moreover, each user has different levels of skill across different applications and even in different portions of the same application. Additionally, users' skill levels change dynamically as users ...
Determination of optimal paths to task goals using expert system based on GOMS model

Website users often experience several difficulties while trying to access or navigate a website. This is mostly due to their inability to familiarize themselves with the structures in the website or as a result of complex procedures which prevent them ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI '93: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems

May 1993

547 pages

ISBN:0897915755

DOI:10.1145/169059

Chairmen:
Bert Arnold
Delft Univ. of Technology, The Netherlands
,
Gerrit van der Veer
Univ. of Twente and Vrije Univ., The Netherlands
,
Ted White
Univ. of Twente and Univ. of Ultrecht, Utrecht, The Netherlands

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 May 1993

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

INTERCHI93

Sponsor:

SIGCAPH
Austrian Comp Soc
SIGGRAPH
Human Factors Soc
SIGCHI
SIGGROUP
IEEE-CS
IFIP
NGI

INTERCHI93: Conference on Human Factors in Computing

April 24 - 29, 1993

Amsterdam, The Netherlands

Acceptance Rates

CHI '93 Paper Acceptance Rate 62 of 330 submissions, 19%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
389
Total Downloads

Downloads (Last 12 months)91
Downloads (Last 6 weeks)11

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Bailly GGiannisakis EMorel MAchard CKubicki SGirard PCalvary GLavoué E(2018)Characterize the transition from menus to hotkeysProceedings of the 30th Conference on l'Interaction Homme-Machine10.1145/3286689.3286699(30-41)Online publication date: 23-Oct-2018
https://dl.acm.org/doi/10.1145/3286689.3286699
Zheng JLewis BAvery JVogel DBaudisch PSchmidt AWilson A(2018)FingerArc and FingerChordProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242589(347-363)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3242587.3242589
Gray WLindstedt J(2016)Plateaus, Dips, and Leaps: Where to Look for Inventions and Discoveries During Skilled PerformanceCognitive Science10.1111/cogs.1241241:7(1838-1870)Online publication date: 20-Oct-2016
https://doi.org/10.1111/cogs.12412
Harbich SHassenzahl M(2016)User Experience in the Work Domain: A Longitudinal Field StudyInteracting with Computers10.1093/iwc/iww022Online publication date: 29-Jul-2016
https://doi.org/10.1093/iwc/iww022
Grossman TFitzmaurice G(2015)An Investigation of Metrics for the In Situ Detection of Software ExpertiseHuman-Computer Interaction10.1080/07370024.2014.88166830:1(64-102)Online publication date: 1-Jan-2015
https://dl.acm.org/doi/10.1080/07370024.2014.881668
Cockburn AGutwin CScarr JMalacria S(2014)Supporting Novice to Expert Transitions in User InterfacesACM Computing Surveys10.1145/265979647:2(1-36)Online publication date: 12-Nov-2014
https://dl.acm.org/doi/10.1145/2659796
Nakatani MOhno TNakane AKomatsubara AHashimoto SGo KKarashima MFukuzumi SRen X(2012)How to motivate people to use internet at homeProceedings of the 10th asia pacific conference on Computer human interaction10.1145/2350046.2350100(259-268)Online publication date: 28-Aug-2012
https://dl.acm.org/doi/10.1145/2350046.2350100
Oulasvirta AWahlström MAnders Ericsson K(2011)What does it mean to be good at using a mobile device? An investigation of three levels of experience and skillInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2010.11.00369:3(155-169)Online publication date: 1-Mar-2011
https://dl.acm.org/doi/10.1016/j.ijhcs.2010.11.003
Fu WGray W(2010)Resolving the paradox of the active user: stable suboptimal performance in interactive tasksCognitive Science10.1207/s15516709cog2806_228:6(901-935)Online publication date: 11-Feb-2010
https://doi.org/10.1207/s15516709cog2806_2
Bhavnani SBates M(2005)Separating the knowledge layers: Cognitive analysis of search knowledge through hierarchical goal decompositionsProceedings of the American Society for Information Science and Technology10.1002/meet.145039012239:1(204-213)Online publication date: 31-Jan-2005
https://doi.org/10.1002/meet.1450390122
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Method engineering: from data to model to practice

Automatic detection of users' skill levels using high-frequency user interface events

Determination of optimal paths to task goals using expert system based on GOMS model