short-paper

How novel evaluators perceive their first Heuristic Evaluation

Authors:

Federico Botella,

Cristian Rusu,

Virginica Rusu,

Daniela QuiñonesAuthors Info & Claims

Interacción '18: Proceedings of the XIX International Conference on Human Computer Interaction

Article No.: 18, Pages 1 - 4

https://doi.org/10.1145/3233824.3233835

Published: 12 September 2018 Publication History

Get Access

Abstract

Usability is still an evolving concept. Heuristic evaluation is one of the best known and widely employed usability evaluation methods, but forming heuristic evaluators is a challenging task. The paper discusses how novel evaluators perceive Nielsen's usability heuristics. It presents the results of a two years' study made at Miguel Hernandez University of Elche, in Spain. It also compares the findings with a similar experiment made at Pontificia Universidad Católica de Valparaíso, in Chile.

References

[1]

Amanda Anganes, Mark S. Pfaff, Jill L. Drury, and Christine M. O'Toole. 2016. The Heuristic Quality Scale. Interacting with Computers 28, 5 (Aug. 2016), 584--597.

Crossref

Google Scholar

[2]

Atrapalo. 2018. Retrieved April 15, 2018 from www.atrapalo.com

Google Scholar

[3]

Federico Botella, Eloy Alarcon, and Antonio Peñalver. 2014. How to classify to experts in usability evaluation. In Proceedings of the XV International Conference on Human Computer Interaction Interacción '14. ACM.

Digital Library

Google Scholar

[4]

Setia Hermawati and Glyn Lawson. 2016. Establishing usability heuristics for heuristics evaluation in a specific domain: Is there a consensus? Applied ergonomics 56, (Sept. 2016), 34--51.

Google Scholar

[5]

ISO 9241-210. 2010. Ergonomics of human-system interaction --- Part 210: Human-centered design for interactive systems. International Organization for Standardization, Geneva, 2010.

Google Scholar

[6]

Jakob Nielsen. 1995. 10 Usability Heuristics for User Interface Design. (January 1995). Retrieved April 15, 2018 from http://www.nngroup.com/articles/ten-usability-heuristics

Google Scholar

[7]

Jakob Nielsen and Robert L. Mack. 1994. Usability inspection methods. John Wiley & Sons, New York, NY.

Digital Library

Google Scholar

[8]

Daniela Quiñones and Cristian Rusu. 2017. How to develop usability heuristics: A systematic literature review. Computer Standards & Interfaces 53, (August 2017), 89--122.

Digital Library

Google Scholar

[9]

Cristian Rusu, Federico Botella, Virginica Rusu, Silvana Roncagliolo, and Daniela Quiñones. 2018. An Online Travel Agency Comparative Study: Heuristic Evaluators Perception. In International Conference on Social Computing and Social Media, G. Meiselwitz (Ed.). Lecture Notes in Computer Science. Springer, Heidelberg.

Google Scholar

Cited By

View all

Dutronc ECaffiau SDupuy-Chessa S(2024)Usability inspections based on heuristics: towards a state of practices and requirements for supportCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661330(49-56)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661330
Dutronc ECaffiau SDupuy-Chessa S(2024)Play to Inspect: How to Help Expert to Inspect UIProceedings of the 35th International Francophone Conference on Human-Computer Interaction10.1145/3650104.3652906(1-6)Online publication date: 25-Mar-2024
https://dl.acm.org/doi/10.1145/3650104.3652906
May DJahnke IMoore S(2023)Online laboratories and virtual experimentation in higher education from a sociotechnical-pedagogical design perspectiveJournal of Computing in Higher Education10.1007/s12528-023-09380-335:2(203-222)Online publication date: 8-Aug-2023
https://doi.org/10.1007/s12528-023-09380-3
Show More Cited By

Index Terms

How novel evaluators perceive their first Heuristic Evaluation
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Heuristic evaluations
      2. Usability testing

Recommendations

Finding usability problems through heuristic evaluation
CHI '92: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Usability specialists were better than non-specialists at performing heuristic evaluation, and “double experts” with specific expertise in the kind of interface being evaluated performed even better. Major usability problems have a higher probability ...
An Online Travel Agency Comparative Study: Heuristic Evaluators Perception
Social Computing and Social Media. User Experience and Behavior
Abstract
Forming usability professionals, particularly heuristic evaluators, is a challenging task. Heuristic evaluation is a well-known and widely employed usability evaluation method. A heuristic evaluation may be performed based on generic or specific ...
Coherent Heuristic Evaluation (CoHE): Toward Increasing the Effectiveness of Heuristic Evaluation for Novice Evaluators
Design, User Experience, and Usability. Interaction Design
Abstract
Heuristic evaluation (HE) is an inspection-based usability evaluation method in which a number of evaluators, typically 3–5, assess the usability of a system based on a set of usability guidelines. HE was first introduced by Nielsen and Molich and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

Interacción '18: Proceedings of the XIX International Conference on Human Computer Interaction

September 2018

232 pages

ISBN:9781450364911

DOI:10.1145/3233824

Conference Chairs:
Cristina Manresa-Yee,
Ramon Mas Sansó

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 September 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

Interacción 2018

Interacción 2018: XIX International Conference on Human Computer Interaction

September 12 - 14, 2018

Palma, Spain

Acceptance Rates

Interacción '18 Paper Acceptance Rate 47 of 73 submissions, 64%;

Overall Acceptance Rate 109 of 163 submissions, 67%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
130
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)2

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Dutronc ECaffiau SDupuy-Chessa S(2024)Usability inspections based on heuristics: towards a state of practices and requirements for supportCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661330(49-56)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661330
Dutronc ECaffiau SDupuy-Chessa S(2024)Play to Inspect: How to Help Expert to Inspect UIProceedings of the 35th International Francophone Conference on Human-Computer Interaction10.1145/3650104.3652906(1-6)Online publication date: 25-Mar-2024
https://dl.acm.org/doi/10.1145/3650104.3652906
May DJahnke IMoore S(2023)Online laboratories and virtual experimentation in higher education from a sociotechnical-pedagogical design perspectiveJournal of Computing in Higher Education10.1007/s12528-023-09380-335:2(203-222)Online publication date: 8-Aug-2023
https://doi.org/10.1007/s12528-023-09380-3
Abulfaraj ASteele A(2020)Coherent Heuristic Evaluation (CoHE): Toward Increasing the Effectiveness of Heuristic Evaluation for Novice EvaluatorsDesign, User Experience, and Usability. Interaction Design10.1007/978-3-030-49713-2_1(3-20)Online publication date: 19-Jul-2020
https://dl.acm.org/doi/10.1007/978-3-030-49713-2_1
Rusu VRusu CQuiñones DBotella FRoncagliolo SRusu V(2019)On-Line Travel Agencies’ Usability: Evaluator eXperienceSocial Computing and Social Media. Communication and Social Communities10.1007/978-3-030-21905-5_35(452-463)Online publication date: 12-Jun-2019
https://doi.org/10.1007/978-3-030-21905-5_35

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Finding usability problems through heuristic evaluation

An Online Travel Agency Comparative Study: Heuristic Evaluators Perception

Coherent Heuristic Evaluation (CoHE): Toward Increasing the Effectiveness of Heuristic Evaluation for Novice Evaluators