Decision models for comparative usability evaluation of mobile phones using the mobile phone usability questionnaire (MPUQ)
Authors: 
Young Sam Ryu, Kari Babski-Reeves, Tonya L. Smith-Jackson, Maury A. NussbaumAuthors Info & Claims
Pages 24 - 39
Abstract
A comparative usability evaluation was performed using various subjective evaluation methods, including Mobile Phone Usability Questionnaire (MPUQ). Further, decision-making models using Analytic Hierarchy Process (AHP) and multiple linear regression were developed and applied. Although the mean rankings of the four phones were not significantly different across the evaluation methods, there were variations across the methods in terms of the number of rank orderings, preference proportions, and methods to select their initial preference. Thus, this study provided a useful insight into how users make different decisions through different evaluation methods. Also, the result showed that answering a usability questionnaire affected a user's decision-making process for comparative evaluation.
References
[1]
Bell, D. E., Raiffa, H., & Tversky, A. (1988a). Decision-making: Descriptive, Normative, and Prescriptive Interactions. Cambridge: Cambridge University Press.
[2]
Bell, D. E., Raiffa, H., & Tversky, A. (1988b). Descriptive, normative, and prescriptive interactions in decision-making. In D. E. Bell, H. Raiffa & A. Tversky (Eds.), Decision-making: Descriptive, Normative, and Prescriptive Interactions. Cambridge: Cambridge University Press.
[3]
Condorcet, M. J. (1785). Essai sur l'application de l'analyse a la probabilite des decisions rendues a la pluralite des voix. Paris.
[4]
Dillon, S. M. (1998). Descriptive Decision-making: Comparing Theory with Practice. In Proceedings of 33rd ORSNZ Conference, University of Auckland, New Zealand.
[5]
Harper, P. D., & Norman, K. L. (1993). Improving user satisfaction: The questionnaire for user interaction satisfaction version 5.5. In Proceedings of The 1st Annual Mid-Atlantic Human Factors Conference, Virginia Beach, VA.
[6]
IDC. (2003). Exploring Usage Models in Mobility: A Cluster Analysis of Mobile Users. (No. IDC #30358): International Data Corporation.
[7]
Kirakowski, J. (1996). The software usability measurement inventory: Background and usage. In P. W. Jordan, B. Thomas, B. A. Weerdmeester & I. L. McClelland (Eds.), Usability Evaluation In Industry (pp. 169--178). London: Taylor & Francis.
[8]
Kirakowski, J., & Corbett, M. (1993). SUMI: The software usability measurement inventory. British Journal of Educational Technology, 24(3), 210--212.
[9]
Lewis, J. R. (1995). IBM computer usability satisfaction questionnaire: psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction, 7(1), 57--78.
[10]
Lin, H. X., Choong, Y.-Y., & Salvendy, G. (1997). A Proposed Index of Usability: A Method for Comparing the Relative Usability of Different Software Systems. Behaviour & Information Technology, 16(4/5), 267--278.
[11]
Nunnally, J. C. (1978). Psychometric Theory. New York: McGraw-Hill.
[12]
Payne, J. W. (1976). Task complexity and contingent processing in decision-making: An information search and protocol analysis. Organizational Behavior and Human Performance, 16, 366--387.
[13]
Payne, J. W., Bettman, J. R., & Johnson, E. J. (1993). The Adaptive Decision Maker. Cambridge: Cambridge University Press.
[14]
Ryu, Y. S., Babski-Reeves, K., Smith-Jackson, T. L., & Nussbaum, M. A. (2007). Enhancing the Mobile Phone Usability Questionnaire (MPUQ) with a Multi-criteria Decision-making Method. In Proceedings of Human Computer Interaction International 2007, Beijing, China.
[15]
Ryu, Y. S., & Smith-Jackson, T. L. (2006). Reliability and Validity of the Mobile Phone Usability Questionnaire (MPUQ). Journal of Usability Studies, 2(1), 39--53.
[16]
Schoemaker, P. J. H. (1980). Experiments On Decisions Under Risk: The Expected Unitiry Theorem. Boston, MA: Martinus Nijhoff Publishing.
[17]
Taplin, R. H. (1997). The statistical analysis of preference data. Applied Statistics, 46(4), 493--512.
Index Terms
- Decision models for comparative usability evaluation of mobile phones using the mobile phone usability questionnaire (MPUQ)
Recommendations
Reliability and validity of the mobile phone usability questionnaire (MPUQ)
This study was a follow-up to determine the psychometric quality of the usability questionnaire items derived from a previous study (Ryu and Smith-Jackson, 2005), and to find a subset of items that represents a higher measure of reliability and ...
Mobile Phone Usability Questionnaire (MPUQ) and Automated Usability Evaluation
Proceedings of the 13th International Conference on Human-Computer Interaction. Part I: New TrendsThe mobile phone has become one of the most popular products amongst today's consumers. The Mobile Phone Usability Questionnaire (MPUQ) was developed to provide an effective subjective usability measurement tool, tailored specifically to the mobile ...
Usability risk level evaluation for physical user interface of mobile phone
The mobile phone has become an indispensable device in everyday life. However, many usability problems were generated by the multi-functionality of mobile phones. There was an important increase on the user interface (UI) design and usability. With the ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Publisher
Usability Professionals' Association
Bloomingdale, IL
Publication History
Published: 01 November 2007
Published in JUS Volume 3, Issue 1
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 104Total Downloads
- Downloads (Last 12 months)3
- Downloads (Last 6 weeks)0
Reflects downloads up to 22 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in