More Web Proxy on the site http://driver.im/

extended-abstract

Understanding Usability Defect Reporting in Software Defect Repositories

Author:

Nor Shahida Mohamad YusopAuthors Info & Claims

ASWEC ' 15 Vol. II: Proceedings of the ASWEC 2015 24th Australasian Software Engineering Conference

Pages 134 - 137

https://doi.org/10.1145/2811681.2817757

Published: 28 September 2015 Publication History

Abstract

Software defect management is a critical component of good software engineering practice. The information reported about a defect is a key element to ensure defects are rectified effectively. However, based on research, reporting usability defects using an existing defect tracking system (DTS) is impractical. This is due to text-centric design and lack of features to support usability attributes. In addition, not all defects can be explained textually; especially defects that involve interface redesign. Another aspect to consider is that the reporters describe usability defects based on their usability knowledge and the information available at the time the defects are found. Defects stored in a DTS in a universal format. Therefore, when reporting usability defects there are some possibilities: the data may not be relevant or irrelevant, useful or not useful, or may even be beyond the reporter's knowledge. This makes it impossible to submit a high quality defect report. To address these issues, I propose a custom defect template that can adjust defect form according to whom, when and how the defect is found. In this way, it will provide flexibility to the reporters to record data based on their expertise and knowledge.

References

[1]

ISO/IEC, "Information technology --- Software product quality --- Part 1: Quality model," vol. 2000. 2000.

[2]

L. Chung, J. Cesar, and P. Leite, "On Non-Functional Requirements in Software," Concept. Model. Found. Appl., pp. 363--379, 2009.

Digital Library

[3]

J. Doerr, D. Kerkow, T. Koenig, T. Olsson, and G.- Kaiserslautern, "Non-Functional Requirements in Industry -- Three Case Studies Adopting an Experience-based NFR Method," in Proceedings of the 2005 13th IEEE International Conference on Requirements Engineeringno, 2005.

Digital Library

[4]

M. B. Twidale, D. M. Nichols, and N. Zealand, "Exploring Usability Discussions in Open Source Development," in Proceedings of the 38th Annual Hawaii Internatioal Conference on System Sciences, 2005, pp. 1--10.

Digital Library

[5]

A. Dingli and S. Cassar, "An Intelligent Framework for Website Usability," Adv. Human-Computer Interact., vol. 2014, pp. 1--13, 2014.

Digital Library

[6]

D. M. Nichols and M. B. Twidale, "Usability processes in open source projects," Softw. Process Improv. Pract., vol. 11, no. 2, pp. 149--162, Mar. 2006.

[7]

S. L. Keenan, H. R. Hartson, dennis G. Kafura, and R. S. Schulman, "The Usability Problem Taxonomy : A Framework for Classification and Analysis," Empir. Softw. Eng., vol. 4, pp. 71--104, 1999.

Digital Library

[8]

M. G. Capra, "Usability Problem Description and the Evaluator Effect in Usability Testing,". PhD Thesis. Viginia Tech, Blackburg, VA, 2006.

Digital Library

[9]

T. S. Andre, S. M. Belz, F. a. McCrearys, and H. R. Hartson, "Testing a Framework for Reliable Classification of Usability Problems," in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2000, vol. 44, no. 37, pp. 573--576.

[10]

G. Çetin, D. Verzulli, and S. Frings, "An Analysis of Involvement of HCI Experts in Distributed Software Development: Practical Issues," Online Communities Soc. Comput., vol. 4564, pp. 32--40, 2007.

Digital Library

[11]

B. J. S. Dumas, B. R. Molich, and B. R. Jeffries, "Describing usability problems: Are we sending the right message?," Interactions, pp. 0--4, 2004.

Digital Library

[12]

M. Nørgaard and R. T. Høegh, "Evaluating Usability -- Using Models of Argumentation to Improve Persuasiveness of Usability Feedback," in Proceedings of the 7th ACM conference on Designing interactive systems, 2008, pp. 212--221.

Digital Library

[13]

E. T. Hvannberg, E. L.-C. Law, and M. K. Lárusdóttir, "Heuristic evaluation: Comparing ways of finding and reporting usability problems," Interact. Comput., vol. 19, no. 2, pp. 225--240, Mar. 2007.

Digital Library

[14]

T. S. Andre, H. R. Hartson, and R. C. Williges, "Determining the Effectiveness of the Usability Problem Inspector: A Theory-Based Model and Tool for Finding Usability Problems," Hum. Factors J. Hum. Factors Ergon. Soc., 2003.

[15]

F. Heller, "Me Hates This : Exploring Different Levels of User Feedback for ( Usability ) Bug Reporting," in Extended Abstracts on Human Factors in Computing Systems, 2011, pp. 1357--1362.

Digital Library

[16]

S. Bernonville, C. Kolski, and N. Leroy, "First Experimentation of the ErgoPNets Method Using Dynamic Modeling to Communicate Usability Evaluation Results," Hum. Error, Saf. Syst. Dev., vol. 5962, pp. 81--95, 2010.

Digital Library

[17]

D. M. Nichols, D. Mckay, N. Zealand, and M. B. Twidale, "Participatory Usability : supporting proactive users," in Proceedings of the 4th Annual Conference of the ACM Special Interest Group on Computer-Human Interaction, 2003, pp. 63--68.

Digital Library

[18]

A. Beirekdar, M. Keita, M. Noirhomme, and F. Randolet, "Flexible Reporting for Automated Usability and Accessibility Evaluation of Web Sites," Human-Computer Interact., vol. 3585, pp. 281--294, 2005.

Digital Library

[19]

K. Hornbaek and E. Frokjaer, "What Kinds of Usability-Problem Description are Useful to Developers?," in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2006, vol. 50, no. 24, pp. 2523--2527.

[20]

G. F. Jonasson and E. T. Hvannberg, "Sharing Usability Problem Sets within and between Groups," Human-Computer Interact., vol. 5727, pp. 596--599, 2009.

Digital Library

[21]

I. Douglas, "Collaborative International Usability Testing : Moving from Document-based Reporting to Information Object Sharing," in IEEE International Conference on Global Software Engineering, 2006, pp. 0--4.

Digital Library

[22]

M. G. Capra, "Comparing Usability Problem Identification and Description by Practitioners and Students," in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2007.

[23]

J. Howarth, T. Smith-jackson, and R. Hartson, "Supporting novice usability practitioners with usability engineering tools," Int. J. Human-Computer Stud., vol. 67, no. 6, pp. 533--549, 2009.

Digital Library

[24]

M. B. Skov and J. Stage, "Training software developers and designers to conduct usability evaluations," Behav. Inf. Technol., vol. 31, no. 4, pp. 425--435, Apr. 2009.

Digital Library

[25]

R. T. Høegh and J. Stage, "The Impact of Usability Reports and User Test Observations on Developers ' Understanding of Usability Data : An Exploratory Study," Int. J. HUMAN--COMPUTER Interact., vol. 21, no. 2, pp. 173--196, 2006.

[26]

A. Fernandez, E. Insfran, and S. Abrahão, "Usability evaluation methods for the web: A systematic mapping study," Inf. Softw. Technol., vol. 53, no. 8, pp. 789--817, Aug. 2011.

Digital Library

[27]

M. V. Mäntylä and J. Itkonen, "How are software defects found? The role of implicit defect detection, individual responsibility, documents, and knowledge," Inf. Softw. Technol., vol. 56, no. 12, pp. 1597--1612, Dec. 2014.

[28]

L. Zhao and F. P. Deek, "Improving Open Source Software Usability," in Proceeedings of the Eleventh Americas Conference on Information Systems, 2005.

[29]

B. Kitchenham and P. Brereton, "A systematic review of systematic review process research in software engineering," Inf. Softw. Technol., vol. 55, no. 12, pp. 2049--2075, Dec. 2013.

Digital Library

[30]

K. Petersen, R. Feldt, S. Mujtaba, and M. Mattsson, "Systematic Mapping Studies in Software Engineering," in Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering, 2008, pp. 68--77.

Digital Library

Cited By

Theisen CDunaiski MWilliams LVisser W(2018)Software Engineering Research at the International Conference on Software Engineering in 2016ACM SIGSOFT Software Engineering Notes10.1145/3149485.314949642:4(1-7)Online publication date: 11-Jan-2018
https://dl.acm.org/doi/10.1145/3149485.3149496
Yin YDong XXu T(2018)Rapid and Efficient Bug Assignment Using ELM for IOT SoftwareIEEE Access10.1109/ACCESS.2018.28693066(52713-52724)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2869306

Index Terms

Understanding Usability Defect Reporting in Software Defect Repositories
1. Social and professional topics
  1. Professional topics
    1. Management of computing and information systems
      1. Software management
        Software maintenance
2. Software and its engineering
  1. Software creation and management
    1. Software post-development issues
    2. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Reporting Usability Defects: Limitations of Open Source Defect Repositories and Suggestions for Improvement
ASWEC ' 15 Vol. II: Proceedings of the ASWEC 2015 24th Australasian Software Engineering Conference

Capturing good quality defect reports is critical for ensuring quick resolution of defects. While a range of studies into defect reporting exists, to date, very few focused on usability defect reporting issues can be found. To better understand issues ...
A revised open source usability defect classification taxonomy
Abstract Context
: Reporting usability defects is a critical part of improving software. Accurately classifying these reported usability defects is critical for reporting, understanding, triaging, prioritizing and ultimately fixing ...
Reporting usability defects: do reporters report what software developers need?
EASE '16: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering

Reporting usability defects can be a challenging task, especially in convincing the software developers that the reported defect actually requires attention. Stronger evidence in the form of specific details is often needed. However, research to date in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ASWEC ' 15 Vol. II: Proceedings of the ASWEC 2015 24th Australasian Software Engineering Conference

September 2015

171 pages

ISBN:9781450337960

DOI:10.1145/2811681

Editors:
Fei-Ching (Diana) Kuo
Swinburne University of Technology, Australia
,
Stuart Marshall
Victoria University of Wellington, New Zealand
,
Haifeng Shen
Flinders University, Australia
,
Markus Stumptner
University of South Australia, Australia
,
M. Ali Babar
University of Adelaide, Australia

Copyright © 2015 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

Australian Comp Soc: Australian Computer Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 September 2015

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Conference

ASWEC ' 15 Vol. II

ASWEC ' 15 Vol. II: ASWEC 2015 24th Australasian Software Engineering Conference

September 28 - October 1, 2015

SA, Adelaide, Australia

Acceptance Rates

ASWEC ' 15 Vol. II Paper Acceptance Rate 12 of 27 submissions, 44%;

Overall Acceptance Rate 12 of 27 submissions, 44%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
112
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Theisen CDunaiski MWilliams LVisser W(2018)Software Engineering Research at the International Conference on Software Engineering in 2016ACM SIGSOFT Software Engineering Notes10.1145/3149485.314949642:4(1-7)Online publication date: 11-Jan-2018
https://dl.acm.org/doi/10.1145/3149485.3149496
Yin YDong XXu T(2018)Rapid and Efficient Bug Assignment Using ELM for IOT SoftwareIEEE Access10.1109/ACCESS.2018.28693066(52713-52724)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2869306

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents