Abstract
This paper deals with a case study of testing with a usability testing package (UTUM), which is also a tool for quality assurance, developed in cooperation between industry and research. It shows that within the studied company, there is a need to balance agility and formalism when producing and presenting results of usability testing to groups who we have called Designers and Product Owners. We have found that these groups have different needs, which can be placed on opposite sides of a scale, based on the agile manifesto. This becomes a Designer and a Product Owner Manifesto. The test package is seen as a successful hybrid method combining agility with formalism, satisfying organisational needs, and fulfilling the desire to create a closer relation between industry and research.
Chapter PDF
Similar content being viewed by others
References
Osterweil, L.: Strategic directions in software quality. ACM Computing Surveys (CSUR) 28(4), 738–750 (1996)
Harrold, M.J.: Testing: A Roadmap. In: Proceedings of the Conference on The Future of Software Engineering. ACM Press, Limmerick (2000)
WoSQ. Fifth Workshop on Software Quality, at ICSE 2007 (2007), http://attend.it.uts.edu.au/icse2007/ (cited June 13, 2008)
Boehm, B.W.: Keynote address. In: 5th Workshop on Software Quality, Minneapolis, MN (2007)
UIQ Technology. UIQ Technology Usability Metrics (2006), http://uiq.com/utum.html (cited June-13, 2008)
U-ODD. Use-Oriented Design and Development (2008), http://www.bth.se/tek/u-odd (cited June 09, 2008)
UIQ Technology. Company Information (2008), http://uiq.com/aboutus.html (cited June 12, 2008)
Martin, D., Rooksby, J., Rouncefield, M., Sommerville, I.: ’Good’ Organisational Reasons for ’Bad’ Software Testing: An Ethnographic Study of Testing in a Small Software Company. In: ICSE 2007. IEEE, Minneapolis (2007)
Royce, W.W.: Managing the development of large software systems: concepts and techniques. In: 9th International Conference on Software Engineering. IEEE Computer Society Press, Monterey (1987)
Boehm, B.W.: A spiral model of software development and enhancement. Computer 21(5), 61–72 (1988)
Sommerville, I.: Software Engineering, 8th edn., p. 840. Addison Wesley, Reading (2007)
Pfleeger, S.L., Atlee, J.M.: Software Engineering, 3rd edn. Prentice Hall, Upper Saddle River (2006)
Talby, D., Hazzan, O., Dubinsky, Y., Keren, A.: Agile Software Testing in a Large-Scale Project. IEEE Software 23(4), 30–37 (2006)
Beck, K.: Extreme Programming Explained. Addison Wesley, Reading (2000)
Pettichord, B.: Testers and Developers Think Differently. STGE Magazine (2000)
International Organization for Standardization, ISO 9241-11 (1998): Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs) - Part 11: Guidance on Usability (1998)
International Organization for Standardization, ISO9126-1 Software engineering - Product quality - Part 1: Quality model, p. 25 (2001)
UXEM. User eXpreience Evaluation Methods in product development, UXEM (2008), http://www.cs.tut.fi/ihte/CHI08_workshop/slides/Poster_UXEM_CHI08_V1.1.pdf (cited June 10, 2008)
Hassenzahl, M., Lai-Chong Law, E., Hvannberg, E.T.: User Experience - Towards a unified view. In: UX WS NordiCHI 2006, Oslo, Norway, cost294.org (2006)
Hassenzahl, M., Tractinsky, N.: User experience - a research agenda. Behaviour & Information Technology 25(2), 91–97 (2006)
UXNet:. UXNet: the User Experience network (2008), http://uxnet.org/ (cited June 09, 2008)
Brooke, J.: System Usability Scale (SUS): A Quick-and-Dirty Method of System Evaluation User Information. Digital Equipment Co. Ltd., Reading (1986)
Winter, J., Rönkkö, K., Ahlberg, M., Hinely, M., Hellman, M.: Developing Quality through Measuring Usability – The UTUM Test Package. In: 5th Workshop on Software Quality, at ICSE 2007. IEEE, Minneapolis (2007)
BTH. UIQ, Usability test (2008), http://www.youtube.com/watch?v=5IjIRlVwgeo (cited August 29, 2008)
UIQ Technology. UTUM website (2008), http://uiq.com/utum.html (cited June 14, 2008)
Dittrich, Y., Rönkkö, K., Eriksson, J., Hansson, C., Lindeberg, O.: Co-operative Method Development: Combining qualitative empirical research with method, technique and process improvement. Journal of Empirical Software Engineering (2007)
Dittrich, Y.: Doing Empirical Research in Software Engineering – finding a path between understanding, intervention and method development. In: Dittrich, Y., Floyd, C., Klischewski, R. (eds.) Social Thinking – Software Practice, pp. 243–262. MIT Press, Cambridge (2002)
Dittrich, Y., Rönkkö, K., Lindeberg, O., Eriksson, J., Hansson, C.: Co-Operative Method Development revisited. SIGSOFT Softw. Eng. Notes 30(4), 1–3 (2005)
Rönkkö, K.: Making Methods Work in Software Engineering: Method Deployment as a Social achievement. In: School of Engineering, Blekinge Institute of Technology, Ronneby (2005)
Mumford, E.: Advice for an action researcher. Information Technology and People 14(1), 12–27 (2001)
Robson, C.: Real World Research, 2nd edn. Blackwell Publishing, Oxford (2002)
Rönkkö, K.: Ethnography. In: Laplante, P. (ed.) Encyclopedia of Software Engineering (accepted, under review). Taylor and Francis Group, New York (2008)
Schuler, D., Namioka, A.: Participatory Design - Principles and Practices. In: Schuler, D., Namioka, A. (eds.), 1st edn., p. 319. Lawrence Erlbaum Associates, Hillsdale (1993)
Yin, R.K.: Case Study Research - Design and Methods. In: Robinson, S. (ed.) Applied Social Research Methods Series, 3rd edn., vol. 5, p. 181. SAGE publications, Thousand Oaks (2003)
The Agile Alliance, The Agile Manifesto (2001), http://agilemanifesto.org/ (cited June 04, 2008)
The Agile Alliance, Principlesof Agile Software (2001), http://www.agilemanifesto.org/principles.html (cited June 12, 2008)
Cockburn, A.: Agile Software Development. In: Cockburn, A., Highsmith, J. (eds.) The Agile Software Development Series, Addison-Wesley, Boston (2002)
Boehm, B.: Get Ready for Agile Methods, with Care. Computer 35(1), 64–69 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 IFIP International Federation for Information Processing
About this paper
Cite this paper
Winter, J., Rönkkö, K., Ahlberg, M., Hotchkiss, J. (2011). Meeting Organisational Needs and Quality Assurance through Balancing Agile and Formal Usability Testing Results. In: Huzar, Z., Koci, R., Meyer, B., Walter, B., Zendulka, J. (eds) Software Engineering Techniques. CEE-SET 2008. Lecture Notes in Computer Science, vol 4980. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22386-0_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-22386-0_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22385-3
Online ISBN: 978-3-642-22386-0
eBook Packages: Computer ScienceComputer Science (R0)