More Web Proxy on the site http://driver.im/

research-article

Reliability and validity of the mobile phone usability questionnaire (MPUQ)

Authors:

Tonya L. Smith-JacksonAuthors Info & Claims

Journal of Usability Studies, Volume 2, Issue 1

Pages 39 - 53

Published: 01 November 2006 Publication History

Abstract

This study was a follow-up to determine the psychometric quality of the usability questionnaire items derived from a previous study (Ryu and Smith-Jackson, 2005), and to find a subset of items that represents a higher measure of reliability and validity. To evaluate the items, the questionnaire was administered to a representative sample involving approximately 300 participants. The findings revealed a six-factor structure, including (1) Ease of learning and use, (2) Assistance with operation and problem solving, (3) Emotional aspect and multimedia capabilities, (4) Commands and minimal memory load, (5) Efficiency and control, and (6) Typical tasks for mobile phones. The appropriate 72 items constituted the Mobile Phone Usability Questionnaire (MPUQ), which evaluates the usability of mobile phones for the purpose of making decisions among competing variations in the end-user market, determining alternatives of prototypes during the development process, and evolving versions during an iterative design process.

References

[1]

Chin, JP, et al. (1988) Development of an instrument measuring user satisfaction of the human-computer interface. In Proceedings of ACM CHI'88, Washington, DC.

[2]

Comfrey, AL and Lee, HB. (1992) A First Course in Factor Analysis. Hillsdale, NJ: Lawrence Erlbaum Associates.

[3]

Cortina, JM. (1993) What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology and Aging, 78, pp. 98--104.

[4]

Cronbach, LJ. (1951) Coefficient alpha and the internal structure of tests. Psychometrika, 16, pp. 297--334.

[5]

DeVillis, RF. (1991) Scale Development: Theory and Applications. Newbury Park, CA: Sage.

[6]

Floyd, FJ and Widaman, KF. (1995) Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7, pp. 286--299.

[7]

Ghiselli, EE, et al. (1981) Measurement theory for the behavioral sciences. San Francisco: Freeman.

[8]

Gorusch, RL. (1983) Factor Analysis (2nd ed.) Hillsdale, NJ: Lawrence Erlbaum Associates.

[9]

Green, SB, et al. (1977) Limitations of coefficient alpha as an index of test unidimensionality. Educational and Psychological Measurement, pp. 37, 827--838.

[10]

Hair, JF, et al. (1998) Multivariate Data Analysis (5th ed.) Englewood Cliffs, NJ: Prentice Hall.

[11]

Hatcher, L. (1994) A Step-by-Step Approach to Using the SAS® System for Factor Analysis and Structural Equation Modeling. Cary, N. C.: SAS Institutte, Inc.

[12]

IDC. (2003) Exploring Usage Models in Mobility: A Cluster Analysis of Mobile Users (No. IDC #30358): International Data Corporation.

[13]

ISO 9241-11. (1998) Ergonomic requirements for office work with visual display terminals (VDTs) - Part 11: Guidance on usability. International Organization for Standardization.

[14]

ISO/IEC 9126-1. (2001) Software engineering- product quality - Part 1: Quality model. International Organization for Standardization.

[15]

Keinonen, T. (1998) One-dimensional usability - Influence of usability on consumers' product preference: University of Art and Design Helsinki, UIAH A21.

[16]

Kirakowski, J. (1996) The software usability measurement inventory: Background and usage. In PW Jordan, B. Thomas, BA Weerdmeester and IL McClelland (Eds.), Usability evaluation in industry (pp. 169--178) London: Taylor and Francis.

[17]

Kirakowski, J and Cierlik, B. (1998) Measuring the usability of web sites. In Proceedings of Human Factors and Ergonomics Society 42nd Annual Meeting. Santa Monica, CA.

[18]

Kirakowski, J, and Corbett, M. (1993) SUMI: The software usability measurement inventory. British Journal of Educational Technology, 24(3), pp. 210--212.

[19]

Konradt, U, et al. (2003) Usability in online shops: scale construction, validation and the influence on the buyers' intention and decision. Behavior and Information Technology, 22(3), pp. 165--174.

[20]

LaLomia, MJ, and Sidowski, JB. (1990) Measurements of computer satisfaction, literacy, and aptitudes: A review. International Journal of Human-Computer Interaction, 2(3), pp. 231--253.

[21]

Lewis, JR. (1995) IBM computer usability satisfaction questionnaire: psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction, 7(1), pp. 57--78.

[22]

Lewis, JR. (2002) Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies. International Journal of Human-Computer Interaction, 14(3-4), pp. 463--488.

[23]

Netemeyer, RG, et al. (2003) Scaling procedures: Issues and applications. Thousand Oaks, CA: Sage Publications, Inc.

[24]

Newman, A. (2003) IDC labels mobile device users. Retrieved February 28, 2004, from http://www.infosyncworld.com/news/n/4384.html

[25]

Nielsen, J. (1993) Usability Engineering. Cambridge, MA: Academic Press.

[26]

Nunnally, JC. (1978) Psychometric theory. New York: McGraw-Hill.

[27]

Rencher, AC. (2002) Methods of Multivariate Analysis (2nd ed.) New York: Wiley Inter-science.

[28]

Ryu, YS and Smith-Jackson, TL. (2005) Usability Questionnaire Items for Mobile Products and Content Validity. In Proceedings of HCI International 2005, Las Vegas.

[29]

Shackel, B. (1991) Usability - context, framework, design and evaluation. In B. Shackel and S. Richardson (Eds.), Human Factors for Informatics Usability (pp. 21--38) Cambridge: Cambridge University Press.

[30]

van Veenendaal, E. (1998) Questionnaire based usability testing. In Proceedings of European Software Quality Week, Brussels.

Cited By

Klein AOliveira KCaetano BPaula M(2024)Engaging Through Games: An Analysis of Gamification as an Intervention in Opinion ResearchProceedings of the 20th Brazilian Symposium on Information Systems10.1145/3658271.3658334(1-10)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3658271.3658334
Galeano IMerín MGonzález MCernuzzi L(2023)A methodological approach for mobile applications developmentScience of Computer Programming10.1016/j.scico.2023.102986230:COnline publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1016/j.scico.2023.102986
Lim JYun HHam AKim S(2022)Mine Yourself!: A Role-playing Privacy Tutorial in Virtual Reality EnvironmentExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519773(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519773
Show More Cited By

Index Terms

Reliability and validity of the mobile phone usability questionnaire (MPUQ)
1. Applied computing
  1. Computers in other domains
    1. Personal computers and PC applications
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Mobile Phone Usability Questionnaire (MPUQ) and Automated Usability Evaluation
Proceedings of the 13th International Conference on Human-Computer Interaction. Part I: New Trends

The mobile phone has become one of the most popular products amongst today's consumers. The Mobile Phone Usability Questionnaire (MPUQ) was developed to provide an effective subjective usability measurement tool, tailored specifically to the mobile ...
Decision models for comparative usability evaluation of mobile phones using the mobile phone usability questionnaire (MPUQ)

A comparative usability evaluation was performed using various subjective evaluation methods, including Mobile Phone Usability Questionnaire (MPUQ). Further, decision-making models using Analytic Hierarchy Process (AHP) and multiple linear regression ...
Reliability, equivalence and respondent preference of computerized versus paper-and-pencil mental health questionnaires

The purpose of this study was to examine the reliability, equivalence and respondent preference of a computerized version of the General Health Questionnaire (GHQ-12), Symptom Checklist (SCL-90-R), Medical Outcomes Study Social Support Survey (MOSSSS), ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Journal of Usability Studies

Journal of Usability Studies Volume 2, Issue 1

November 2006

53 pages

Issue’s Table of Contents

Publisher

Usability Professionals' Association

Bloomingdale, IL

Publication History

Published: 01 November 2006

Published in JUS Volume 2, Issue 1

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
835
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)0

Reflects downloads up to 11 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Klein AOliveira KCaetano BPaula M(2024)Engaging Through Games: An Analysis of Gamification as an Intervention in Opinion ResearchProceedings of the 20th Brazilian Symposium on Information Systems10.1145/3658271.3658334(1-10)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3658271.3658334
Galeano IMerín MGonzález MCernuzzi L(2023)A methodological approach for mobile applications developmentScience of Computer Programming10.1016/j.scico.2023.102986230:COnline publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1016/j.scico.2023.102986
Lim JYun HHam AKim S(2022)Mine Yourself!: A Role-playing Privacy Tutorial in Virtual Reality EnvironmentExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519773(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519773
Jung JWellard-Cole LCai CKoprinska IYacef KAllman-Farinelli MKay J(2020)Foundations for Systematic Evaluation and Benchmarking of a Mobile Food Logger in a Large-scale Nutrition StudyProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33973274:2(1-25)Online publication date: 15-Jun-2020
https://dl.acm.org/doi/10.1145/3397327
Yaddaden ABier NAndrée-Anne PLussier MAboujaoudé AGagnon-Roy MBujari AManzoni PForster AMota EGaggi O(2019)Usability questionnaires for telemonitoring and assistive technology for cognition for older adultsProceedings of the 5th EAI International Conference on Smart Objects and Technologies for Social Good10.1145/3342428.3342653(102-107)Online publication date: 25-Sep-2019
https://dl.acm.org/doi/10.1145/3342428.3342653
Baumgartner JFrei NKleinke MSauer JSonderegger ABrewster SFitzpatrick GCox AKostakos V(2019)Pictorial System Usability Scale (P-SUS)Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300299(1-11)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300299
Sauro JZarolia P(2017)SUPR-QmJournal of Usability Studies10.5555/3173069.317307213:1(17-37)Online publication date: 1-Nov-2017
https://dl.acm.org/doi/10.5555/3173069.3173072
Plessas AStefanis VKomninos AGarofalakis J(2017)Field evaluation of context aware adaptive interfaces for efficient mobile contact retrievalPervasive and Mobile Computing10.1016/j.pmcj.2016.04.01135:C(51-64)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1016/j.pmcj.2016.04.011
Sekhavat Y(2016)KioskARInternational Journal of Computer Games Technology10.1155/2016/76907542016(4)Online publication date: 1-Mar-2016
https://dl.acm.org/doi/10.1155/2016/7690754
Yu NKong J(2016)User experience with web browsing on small screensInformation Sciences: an International Journal10.1016/j.ins.2015.06.004330:C(427-443)Online publication date: 10-Feb-2016
https://dl.acm.org/doi/10.1016/j.ins.2015.06.004
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents