Abstract
Estimation of a software project effort, based on project analogies, is a promising method in the area of software cost estimation. Projects in a historical database, that are analogous (similar) to the project under examination, are detected, and their effort data are used to produce estimates. As in all software cost estimation approaches, important decisions must be made regarding certain parameters, in order to calibrate with local data and obtain reliable estimates. In this paper, we present a statistical simulation tool, namely the bootstrap method, which helps the user in tuning the analogy approach before application to real projects. This is an essential step of the method, because if inappropriate values for the parameters are selected in the first place, the estimate will be inevitably wrong. Additionally, we show how measures of accuracy and in particular, confidence intervals, may be computed for the analogy-based estimates, using the bootstrap method with different assumptions about the population distribution of the data set. Estimate confidence intervals are necessary in order to assess point estimate accuracy and assist risk analysis and project planning. Examples of bootstrap confidence intervals and a comparison with regression models are presented on well-known cost data sets.
Similar content being viewed by others
References
Abran, A., and Robillard, P. N. 1996. Function point analysis: an empirical study of its measurement processes. IEEE Trans. on Software Engineering 22(12): 895-909.
Albrecht, A. J., and Gaffney, J. E. 1983. Software function, source lines of code, and development effort prediction: a software science validation. IEEE Trans. 6: 639-648.
Boehm, B. W. 1981. Software Engineering Economics. Prentice-Hall.
Boehm, B. W. 1991. Software risk management: principles and practices. IEEE Software 8(1): 32-41.
Conte, S., Dunsmore, H., and Shen, V. Y. 1986. Software Engineering Metrics and Models. Menlo Park, Calif.: Benjamin Cummings.
DeMarco T. 1982. Controlling Software Projects. Englewood Cliffs, N.J.: Prentice Hall.
Efron, B., and Tibshirani, R. 1993. An Introduction to the Bootstrap. New York: Chapman and Hall.
Hoaglin, D. C., Mosteller, F., and Tukey, J. W. 1983. Understanding Robust and Exploratory Data Analysis. New York: John Wiley.
Kaufman, L., and Rousseeuw, P. J. 1990. Finding Groups in Data: An Introduction to Cluster Analysis. New York: John Wiley.
Kitchenham, B., and Linkman, S., 1997. Estimates, uncertainty and risk. IEEE Software 14(3): 69-74.
Krzanowski, W. J. 1993. Principles of Multivariate Analysis: A User's Perspective. Oxford University Press.
Law, A. M., and Kelton, W. D. 1991. Simulation Modeling and Analysis. McGraw-Hill.
Mukhopadhyay T., Vicinanza, S. S., and Prietula, M. J. 1992. Examining the feasibility of a case-based reasoning model for software effort estimation. MIS Quarterly 16: 155-171.
Johnson, R. A., and Wichern, D. W. 1988. Applied Multivariate Statistical Analysis. Prentice-Hall.
Shepperd, M. J., Shofield, C., and Kitchenham, B. A. 1996. Effort estimation using analogy. Proc. 18th Int'l Conf. Software Eng. Berlin, IEEE CS Press.
Shepperd, M. J. and Schofield, C. 1997. Estimating software project effort using analogies. IEEE Trans. on Software Engineering 23(12): 736-743.
Silverman, B. W. 1986. Density Estimation for Statistics and Data Analysis. Chapman and Hall, London.
Venables, W. N., and Ripley, B. D. 1994. Modern Applied Statistics with S-Plus. New York: Springer-Verlag.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Angelis, L., Stamelos, I. A Simulation Tool for Efficient Analogy Based Cost Estimation. Empirical Software Engineering 5, 35–68 (2000). https://doi.org/10.1023/A:1009897800559
Issue Date:
DOI: https://doi.org/10.1023/A:1009897800559