article

Free access

Usability testing vs. heuristic evaluation: was there a contest?

Authors:

Robin Jeffries,

Heather DesurvireAuthors Info & Claims

ACM SIGCHI Bulletin, Volume 24, Issue 4

Pages 39 - 41

https://doi.org/10.1145/142167.142179

Published: 01 October 1992 Publication History

PDF eReader

Abstract

Recent research comparing usability assessment methods has been interpreted by some to imply that usability testing is no longer necessary, because other techniques, such as heuristic evaluation, can find some usability problems more cost-effectively. Such an interpretation grossly overstates the actual results of the studies. In this article, we, as authors of studies that compared inspection methods to usability testing, point out the rather severe limitations to using inspection methods as a substitute for usability testing and argue for a more balanced repertoire of usability assessment techniques.

References

[1]

Desurvire, H., Kondziela, J., and Atwood, M. (1992a; short paper version). What is Gained and Lost When Using Evaluation Methods Other Than Empirical Testing. A short talk presented at CHI'92 (Monterey, California, May 3--7, 1992), ACM, collection of abstracts, pp. 125--126.

Digital Library

Google Scholar

[2]

Desurvire, H., Kondziela, J., and Atwood, M. (1992b; full paper version). What is Gained and Lost When Using Evaluation Methods Other Than Empirical Testing. In the proceedings of HCI 1992, Cambridge University Press, edited by Monk, A., Diaper, D., and Harrison, M. D., (University of York, U. K., September 15--18, 1992).

Digital Library

Google Scholar

[3]

Desurvire, H., Lawrence D., and M. E. Atwood. Empiricism versus judgment: Comparing user interface evaluation methods on a new telephone-based interface. SIGCHI Bulletin, 23, 4, pp.58--59,1991.

Digital Library

Google Scholar

[4]

Jeffries, R., Miller, J. R., Wharton, C., and Uyeda, K. M. User interface evaluation in the real world: A comparison of four techniques. Proceedings of CHI, 1991 (New Orleans, Louisiana, April 28 - May 2, 1991) ACM, New York, 1991. pp. 119--124.

Digital Library

Google Scholar

[5]

Karat C., Campbell R., and T. Fiegel. Comparison of empirical testing and walkthrough methods in user interface evaluation. In Proceedings of CHI '92 (Monterey, California, May 3--7, 1992) ACM, New York, 1992. pp. 397--404.

Digital Library

Google Scholar

[6]

Lewis C., Polson P., Wharton C., and J. Rieman. Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces. In Proceedings of CHI'90 (Seattle), ACM, J. C. Chew &amp; J. Whiteside (Eds.), Addison-Wesley, NY, pp.235--242, 1990.

Digital Library

Google Scholar

[7]

Molich R., and J. Nielsen. Improving a human-computer dialogue. Communications of the ACM, 33,3, pp. 338--342, March 1990.

Digital Library

Google Scholar

[8]

Nielsen J. Finding Usability Problems Through Heuristic Evaluation. In Proceedings of CHI '92 (Monterey), ACM, 1992, pp. 373--380.

Digital Library

Google Scholar

[9]

Nielsen J. Usability Engineering At a Discount. In Salvendy, G., and Smith, M. J., (Eds.), Designing and Using Human-Computer Interfaces and Knowledge-Based Systems. Elsevier Science Publishers, Amsterdam, pp. 394--401, 1989.

Digital Library

Google Scholar

[10]

Nielsen J., and Molich, R. Heuristic Evaluations of User Interfaces. In Proceedings of CHI'90, (Seattle), ACM, J. C. Chew &amp; J. Whiteside (Eds.), Addison-Wesley, NY, pp. 249--256, 1990.

Digital Library

Google Scholar

Cited By

View all

Militello LDiiulio JWilson DNguyen KHarle CGellad WLo-Ciganic W(2024)Using human factors methods to mitigate bias in artificial intelligence-based clinical decision supportJournal of the American Medical Informatics Association10.1093/jamia/ocae291Online publication date: 21-Nov-2024
https://doi.org/10.1093/jamia/ocae291
Cavalcanti J(2024)A Neuroeducational Approach in the Integration of Virtual Reality Technologies in the Development of Serious Games: Case Study in the Field of Occupational Safety and Risk PreventionDesign, User Experience, and Usability10.1007/978-3-031-61359-3_2(21-31)Online publication date: 12-Jun-2024
https://doi.org/10.1007/978-3-031-61359-3_2
Nault KRuhi U(2023)User experience with disinformation-countering tools: usability challenges and suggestions for improvementFrontiers in Computer Science10.3389/fcomp.2023.12531665Online publication date: 2-Oct-2023
https://doi.org/10.3389/fcomp.2023.1253166
Show More Cited By

Index Terms

Usability testing vs. heuristic evaluation: was there a contest?
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Software and its engineering
  1. Software notations and tools
    1. Development frameworks and environments
      1. Integrated and visual development environments

Recommendations

Usability testing: what have we overlooked?
CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

For more than a decade, the number of usability test participants has been a major theme of debate among usability practitioners and researchers keen to improve usability test performance. This paper provides evidence suggesting that the focus be ...
Heuristic evaluation and usability testing: case study
IDGD'11: Proceedings of the 4th international conference on Internationalization, design and global development

The goal of this user centered design (UCD) study was to to identify usability issues on the Bogaziçi University Industrial Engineering (BUIE) department website user interface (UI) and also to provide a re-design guideline for the website. In this ...
Heuristic Evaluation as a Complement to Usability Testing: A Case Study in Web Domain
ITNG '15: Proceedings of the 2015 12th International Conference on Information Technology - New Generations

Usability testing is one of the most used methods to define the level of usability of a software product. However, there is always uncertainty to determine the best method that complements user testing in a depth usability assessment. Nowadays, the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ACM SIGCHI Bulletin Volume 24, Issue 4

Oct. 1992

49 pages

ISSN:0736-6906

DOI:10.1145/142167

Editor:
Bill Hefley
Carnegie Mellon Univ., Pittsburgh, PA

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 1992

Published in SIGCHI Volume 24, Issue 4

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

82
Total Citations
View Citations
6,651
Total Downloads

Downloads (Last 12 months)278
Downloads (Last 6 weeks)41

Reflects downloads up to 19 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Militello LDiiulio JWilson DNguyen KHarle CGellad WLo-Ciganic W(2024)Using human factors methods to mitigate bias in artificial intelligence-based clinical decision supportJournal of the American Medical Informatics Association10.1093/jamia/ocae291Online publication date: 21-Nov-2024
https://doi.org/10.1093/jamia/ocae291
Cavalcanti J(2024)A Neuroeducational Approach in the Integration of Virtual Reality Technologies in the Development of Serious Games: Case Study in the Field of Occupational Safety and Risk PreventionDesign, User Experience, and Usability10.1007/978-3-031-61359-3_2(21-31)Online publication date: 12-Jun-2024
https://doi.org/10.1007/978-3-031-61359-3_2
Nault KRuhi U(2023)User experience with disinformation-countering tools: usability challenges and suggestions for improvementFrontiers in Computer Science10.3389/fcomp.2023.12531665Online publication date: 2-Oct-2023
https://doi.org/10.3389/fcomp.2023.1253166
Nizamani SNizamani SBasir NLaghari GKhoumbati KNizamani S(2022)Heuristic Evaluation Versus Guideline Reviews: A Tale of Comparing Two Domain Usability Expert's Evaluation MethodsIEEE Transactions on Professional Communication10.1109/TPC.2022.320173265:4(516-529)Online publication date: Dec-2022
https://doi.org/10.1109/TPC.2022.3201732
Williams S(2022)Exploring the User Experience Design of Commercially Available Cybersecurity Products for Personal Mobile Devices2022 IEEE International Professional Communication Conference (ProComm)10.1109/ProComm53155.2022.00037(187-191)Online publication date: 17-Jul-2022
https://dl.acm.org/doi/10.1109/ProComm53155.2022.00037
Nasir MIkram NJalil Z(2022)Usability inspection: Novice crowd inspectors versus expertJournal of Systems and Software10.1016/j.jss.2021.111122183(111122)Online publication date: Jan-2022
https://doi.org/10.1016/j.jss.2021.111122
Lu JSchmidt MLee MHuang R(2022)Usability research in educational technology: a state-of-the-art systematic reviewEducational technology research and development10.1007/s11423-022-10152-670:6(1951-1992)Online publication date: 22-Aug-2022
https://doi.org/10.1007/s11423-022-10152-6
Othman MOng LAman S(2022)Expert vs novice collaborative heuristic evaluation (CHE) of a smartphone app for cultural heritage sitesMultimedia Tools and Applications10.1007/s11042-022-11991-481:5(6923-6942)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1007/s11042-022-11991-4
Frías SMezura-Godoy CBenítez-Guerrero ESantana-Mancilla PValderrama E(2019)FrUtEGProceedings of the IX Latin American Conference on Human Computer Interaction10.1145/3358961.3358965(1-8)Online publication date: 30-Sep-2019
https://dl.acm.org/doi/10.1145/3358961.3358965
Hassan MTukiainen MQureshi A(2019)(Un)Discounted UsabilityProceedings of the 8th International Conference on Software and Information Engineering10.1145/3328833.3328860(253-258)Online publication date: 9-Apr-2019
https://dl.acm.org/doi/10.1145/3328833.3328860
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

Usability testing: what have we overlooked?

Heuristic evaluation and usability testing: case study

Heuristic Evaluation as a Complement to Usability Testing: A Case Study in Web Domain

Comments

Information

Published In

Publisher

Publication History

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations