Abstract
Software engineering is not only about technical solutions. It is to a large extent also concerned with organizational issues, project management and human behaviour. For a discipline like software engineering, empirical methods are crucial, since they allow for incorporating human behaviour into the research approach taken. Empirical methods are common practice in many other disciplines. This chapter provides a motivation for the use of empirical methods in software engineering research. The main motivation is that it is needed from an engineering perspective to allow for informed and well-grounded decision. The chapter continues with a brief introduction to four research methods: controlled experiments, case studies, surveys and post-mortem analyses. These methods are then put into an improvement context. The four methods are presented with the objective to introduce the reader to the methods to a level that it is possible to select the most suitable method at a specific instance. The methods have in common that they all are concerned with quantitative data. However, several of them are also suitable for qualitative data. Finally, it is concluded that the methods are not competing. On the contrary, the different research methods can preferably be used together to obtain more sources of information that hopefully lead to more informed engineering decisions in software engineering.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Garvin, D.A.: Building a Learning Organization. In: Harward Business Review on Knowledge Management, pp. 47–80. Harward Business School Press, Boston (1998)
Basili, V.R., Caldiera, G., Rombach, H.D.: Experience Factory. In: Marciniak, J.J. (ed.) Encyclopaedia of Software Engineering. John Wiley & Sons, Inc., Hoboken (2002)
Denzin, N.K., Lincoln, Y.S.: Handbook of Qualitative Research. Sage Publications, London (1994)
Creswell, J.W.: Research Design, Qualitative and Quantitative Approaches. Sage Publications, Thousand Oaks (1994)
Fenton, N., Pfleeger, S.L.: Software Metrics: A Rigorous & Practical Approach, 2nd edn. International Thomson Computer Press (1996)
Kitchenham, B., Pickard, L., Pfleeger, S.L.: Case Studies for Method and Tool Evaluation. IEEE Software, pp. 52–62 (1995)
Montgomery, D.C.: Design and Analysis of Experiments, 4th edn. John Wiley & Sons, New York (1997)
Siegel, S., Castellan, J.: Nonparametric Statistics for the Behavioral Sciences, 2nd edn. McGraw-Hill International, New York (1988)
Robson, C.: Real World Research, 2nd edn. Blackwell, Malden (2002)
Zelkowitz, M.V., Wallace, D.R.: Experimental Models for Validating Technology. IEEE Computer 31(5), 23–31 (1998)
Manly, B.F.J.: Multivariate Statistical Methods – A Primer, 2nd edn. Chapman & Hall, London (1994)
Stake, R.E.: The Art of Case Study Research. SAGE Publications, Thousand Oaks (1995)
Pfleeger, S.: Experimental Design and Analysis in Software Engineering Part 1–5, ACM Sigsoft, Software Engineering Notes, 19(4), 16–20; 20(1), 22–26; 20(2), 14–16; 20(3), 13–15; 20(4), 14–17 (1994/1995)
Yin, R.K.: Case Study Research Design and Methods. Sage Publications, Beverly Hills (1994)
Babbie, E.: Survey Research Methods. Wadsworth, Belmont (1990) ISBN 0–524–12672–3
Tukey, J.W.: Exploratory Data Analysis. Addison-Wesley, Reading (1977)
Robson, C.: Design and Statistics in Psychology, 3rd edn. Penguin Books, London (1994)
Wohlin, C., Runeson, P., Höst, M., Ohlsson, M.C., Regnell, B., Wesslén, A.: Experimentation in Software Engineering – An Introduction. Kluwer Academic Publishers, Boston (1999)
Judd, C.M., Smith, E.R., Kidder, L.H.: Research Methods in Social Relations, 6th edn. Harcourt Brace Jovanovich College Publishers, Forth Worth (1991)
Juristo, N., Moreno, A.: Basics of Software Engineering Experimentation. Kluwer Academic Publishers, Boston (2001)
Birk, A., Dingsøyr, T., Stålhane, T.: Postmortem: Never Leave a Project without It. IEEE Software, 43–45 (2002)
Collier, B., DeMarco, T., Fearey, P.: A Defined Process for Project Postmortem Review. IEEE Software, 65–72 (1996)
Whitten, N.: Managing Software Development Projects – Formula for Success. John Wiley and Sons, Inc., New York (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Wohlin, C., Höst, M., Henningsson, K. (2003). Empirical Research Methods in Software Engineering. In: Conradi, R., Wang, A.I. (eds) Empirical Methods and Studies in Software Engineering. Lecture Notes in Computer Science, vol 2765. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45143-3_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-45143-3_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40672-3
Online ISBN: 978-3-540-45143-3
eBook Packages: Springer Book Archive