[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3660515.3661330acmconferencesArticle/Chapter ViewAbstractPublication PageseicsConference Proceedingsconference-collections
short-paper

Usability inspections based on heuristics: towards a state of practices and requirements for support

Published: 24 June 2024 Publication History

Abstract

User interface evaluation using heuristics is one of the most widely used evaluation methods in Human-Computer Interaction design. However, the quality of heuristic evaluations is highly dependent on the experts who perform them. To limit this bias, recommendations and tools to support some of the evaluation steps are proposed. Considering these recommendations and tools, this article investigates how the heuristics evaluations are really carried out and can be improved. Two studies are performed. First, an online survey investigates how practitioners perform heuristics inspection and studies the tools they used. The answers shows inequalities in the way the different tasks of the inspection process are realized. In particular, there is few well matured practices for proposing feasible solutions to usability problems and transferring inspection results to designers. These tasks are the moments when the knowledge of the experts who carried out the inspection is passed on to the people who will implement the interface. As such, they are particularly dependent on the communication quality. Our second study focused on this communication aspect by studying the use of a serious game, JADE, for usability evaluation. The JADE game has been successfully proposed in teaching to promote communication between learners. Two workshops investigates whether this game can also be a useful tool for experts in their inspection tasks, particularly as a support for exchanges. JADE seems to encourage communication between experts in particular to include non-ergonomic experts in the evaluation process.

References

[1]
Federico Botella, Cristian Rusu, Virginica Rusu, and Daniela Quiñones. 2018. How novel evaluators perceive their first heuristic evaluation. In Proceedings of the XIX International Conference on Human Computer Interaction. 1–4.
[2]
Eric Brangier, Michel Desmarais, Nemery Alexandra, and Sandrine Prom Tep. 2015. Évolution de l’inspection heuristique: vers une intégration des critères d’accessibilité, de praticité, d’émotion et de persuasion dans l’évaluation ergonomique. Journal d’Interaction Personne-Système 4, Special Issue" PISTIL" (2015).
[3]
Dana E Chisnell, Janice C Ginny Redish, and AMY Lee. 2006. New heuristics for understanding older adults as web users. Technical Communication 53, 1 (2006), 39–59.
[4]
Gilbert Cockton and Alan Woolrych. 2001. Understanding inspection methods: lessons from an assessment of heuristic evaluation. In People and Computers XV—Interaction without Frontiers: Joint Proceedings of HCI 2001 and IHM 2001. Springer, 171–191.
[5]
Gilbert Cockton and Alan Woolrych. 2002. Sale must end: should discount methods be cleared off HCI’s shelves?interactions 9, 5 (2002), 13–18.
[6]
Jon Fernández and José A Macías. 2021. Heuristic-based usability evaluation support: A systematic literature review and comparative study. In Proceedings of the XXI International Conference on Human Computer Interaction. 1–9.
[7]
Asbjørn Følstad, Effie Law, and Kasper Hornbæk. 2012. Analysis in practical usability evaluation: a survey study. In proceedings of the SIGCHI conference on human factors in computing systems. 2127–2136.
[8]
Asbjørn Følstad, Effie Lai-Chong Law, and Kasper Hornbæk. 2010. Analysis in usability evaluations: an exploratory study. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries. 647–650.
[9]
Erin Friess. 2015. Personas in heuristic evaluation: an exploratory study. IEEE Transactions on Professional Communication 58, 2 (2015), 176–191.
[10]
Stéphanie Jean-Daubias. 2023. JADE: a board game to teach software ergonomics. arXiv preprint arXiv:2308.03487 (2023).
[11]
Cristhy Jiménez, Hector Allende Cid, and Ismael Figueroa. 2017. PROMETHEUS: procedural methodology for developing heuristics of usability. IEEE Latin America Transactions 15, 3 (2017), 541–549.
[12]
Elizabeth Kemp and DT Setungamudalige. 2006. A resource support toolkit (R-IDE) supporting the DECIDE framework. In Proceedings of the 7th ACM SIGCHI New Zealand chapter’s international conference on Computer-human interaction: design centered HCI. 61–66.
[13]
Llúcia Masip, Marta Oliva, and Toni Granollers. 2011. OPEN-HEREDEUX: open heuristic resource for designing and evaluating user experience. In Human-Computer Interaction–INTERACT 2011: 13th IFIP TC 13 International Conference, Lisbon, Portugal, September 5-9, 2011, Proceedings, Part IV 13. Springer, 418–421.
[14]
Jakob Nielsen and Rolf Molich. 1990. Heuristic evaluation of user interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems. 249–256.
[15]
Kwandee Phetcharakarn and Twittie Senivongse. 2018. Heuristic-Based Usability Evaluation Tool for Android Applications. Applied Computing & Information Technology (2018), 161–175.
[16]
Janice Redish, Randolph G Bias, Robert Bailey, Rolf Molich, Joe Dumas, and Jared M Spool. 2002. Usability in practice: formative usability evaluations-evolution and revolution. In CHI’02 extended abstracts on Human factors in computing systems. 885–890.

Index Terms

  1. Usability inspections based on heuristics: towards a state of practices and requirements for support

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    EICS '24 Companion: Companion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems
    June 2024
    129 pages
    ISBN:9798400706516
    DOI:10.1145/3660515
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 24 June 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. JADE
    2. evaluation method
    3. heuristic inspection

    Qualifiers

    • Short-paper
    • Research
    • Refereed limited

    Conference

    EICS '24
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 73 of 299 submissions, 24%

    Upcoming Conference

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 28
      Total Downloads
    • Downloads (Last 12 months)28
    • Downloads (Last 6 weeks)5
    Reflects downloads up to 21 Dec 2024

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media