More Web Proxy on the site http://driver.im/

research-article

Effort estimation for agile software development: comparative case studies using COSMIC functional size measurement and story points

Authors:

Murat Salmanoglu,

Tuna Hacaloglu,

Onur DemirorsAuthors Info & Claims

IWSM Mensura '17: Proceedings of the 27th International Workshop on Software Measurement and 12th International Conference on Software Process and Product Measurement

Pages 41 - 49

https://doi.org/10.1145/3143434.3143450

Published: 25 October 2017 Publication History

Abstract

Agile methodologies have gained significant popularity among software development organizations during the last decade. Although agile methodologies are regarded as minimizing formal processes, they still utilize an estimation methodology for proper management. Story point is the most common input for agile effort estimation. Story point is an arbitrary measure; it reflects experiences of project participants. On the other hand, functional size is an alternative measure used in practice as an input for effort estimation. In this research, we collect and present the outcomes of three case studies which compared the effectiveness of COSMIC-based and story point based effort estimation in agile context. On selected projects of these organizations, software functional size was measured with COSMIC functional size measurement methodology. Effort prediction models were formed by using COSMIC size and actual effort spent; and the models were tested in terms of their effectiveness. The results show controversial outcomes. For all the cases, COSMIC based estimation was more precise. Therefore, COSMIC is an appropriate measure to estimate the effort in organizations that adopt agile software development. It is also observed that COSMIC allowed for computing productivity which has less disperse distribution than the productivity computed with SP. The data is also provided to help other researchers conduct their own studies.

References

[1]

A. Abran, Software Project Estimation. Wiley-IEEE Computer Society Press, 2015.

[2]

M. Jørgensen, B. Boehm, and S. Rifkin, "Software Development Effort Estimation: Formal Models or Expert Judgment?," IEEE Softw., vol. 26, no. 2, pp. 14--19, 2009.

Digital Library

[3]

A. Abran, J.-M. Desharnais, M. Zarour, and O. Demirörs, "Productivity - Based Software Estimation Models and Process Improvement: an Empirical Study," Int. J. Adv. Softw., vol. 8, no. 1&2, pp. 103--114, 2015.

[4]

C. Commeyne, A. Abran, and R. Djouab, "Effort Estimation with Story Points and COSMIC Function Points - An Industry Case Study," Softw. Meas. News, vol. 21, no. 1, pp. 25--36, 2016.

[5]

A. Tarhan and O. Demirors, "Apply Quantitative Management Now" IEEE Softw., vol. 29, no. 3, pp. 77--85, May 2012.

Digital Library

[6]

B. Ozkan, O. Turetken, and O. Demirors, "Software Functional Size: For Cost Estimation and More," in Software Process Improvement, Berlin, Heidelberg: Springer Berlin Heidelberg, 2008, pp. 59--69.

[7]

C. Gencel and O. Demirors, "Conceptual Differences Among Functional Size Measurement Methods," in First International Symposium on Empirical Software Engineering and Measurement, 2007, pp. 305--313.

Digital Library

[8]

C. Symons and A. Lesterhuis, "The COSMIC Functional Size Measurement Method Version 4.0.1 Measurement Manual," 2015.

[9]

K. Beck et al., "The Agile Manifesto," 2001. [Online]. Available: http://agilemanifesto.org/. [Accessed: 22-May-2017].

[10]

S. Ziauddin, T. Kamal, and Z. Shahrukh, "An Effort Estimation Model for Agile Software Development," Adv. Comput. Sci. its Appl., vol. 2, no. 1, pp. 314--324, 2012.

[11]

M. Usman, E. Mendes, F. Weidt, and R. Britto, "Effort estimation in agile software development: A Systematic Literature Review," in Proceedings of the 10th International Conference on Predictive Models in Software Engineering - PROMISE '14, 2014, pp. 82--91.

Digital Library

[12]

M. Usman and R. Britto, "Effort Estimation in Co-located and Globally Distributed Agile Software Development: A Comparative Study," in 2016 Joint Conference of the International Workshop on Software Measurement and the International Conference on Software Process and Product Measurement (IWSM-MENSURA), 2016, pp. 219--224.

[13]

S. M. Satapathy, A. Panda, and S. K. Rath, "Story Point Approach based Agile Software Effort Estimation using Various SVR Kernel Methods," in The 26th International Conference on Software Engineering and Knowledge Engineering, 2014, pp. 304--307.

[14]

M. Ali, Z. Shaikh, and E. Ali, "Estimation of Project Size Using User Stories," in The International Conference on Recent Advances in Computer Systems, 2015.

[15]

E. Coelho and A. Basu, "Effort Estimation in Agile Software Development using Story Points," Int. J. Appl. Inf. Syst., vol. 3, no. 7, pp. 7--10, 2012.

[16]

B. Ozkan and O. Demirors, "On the Seven Misconceptions about Functional Size Measurement," in 2016 Joint Conference of the International Workshop on Software Measurement and the International Conference on Software Process and Product Measurement (IWSM-MENSURA), 2016, pp. 45--52.

[17]

J. Leinonen, "Evaluating Software Development Effort Estimation Process in Agile Software Development Context," University of Oulu, 2016.

[18]

M. Tamrakar, R; Jørgensen, "Does the use of Fibonacci numbers in planning poker affect effort estimates?," in 16th International Conference on Evaluation {&} Assessment in Software Engineering (EASE 2012), 2012, pp. 228--232.

[19]

M. A. J. Zahraoui, H., & Idrissi, "Adjusting story points calculation in scrum effort & time estimation," in Intelligent Systems: Theories and Applications (SITA), 2015 10th International Conference on, 2015, pp. 1--8.

[20]

CMMI Product Team, CMMI® for Development, Version 1.3 CMMI-DEV, V1.3, no. November. 2010.

[21]

A. E. D. Hamouda, "Using Agile Story Points as an Estimation Technique in CMMI Organizations," in 2014 Agile Conference, 2014, pp. 16--23.

[22]

ISO/IEC, "20926: Software and systems engineering - Software measurement - IFPUG functional size measurement method." 2009.

[23]

C. Santana, F. Leoneo, A. Vasconcelos, and C. Gusmão, "Using Function Points in Agile Projects," Springer, Berlin, Heidelberg, 2011, pp. 176--191.

[24]

R. V Huijgens, H., & Solingen, "A replicated study on correlating agile team velocity measured in function and story points," in In Proceedings of the 5th International Workshop on Emerging Trends in Software Metrics, 2014, pp. 30--36.

[25]

ISO/IEC, "24570: Software engineering - NESMA functional size measurement method version 2.1 - Definitions and counting guidelines for the application of Function Point Analysis," 2005.

[26]

A. Özdemir, "Effort Estimation with Cosmic Functional Size Measurement Method In Agile Projects," METU/II-TR-2017--88, Ankara, 2017.

[27]

B. Çirtlik, "Comparison of Cosmic and Expert Judgement Effectiveness for Effort Prediction on Agile Projects," METU/II-TR-2016--27, Ankara, 2016.

[28]

N. Çizmeli, "Comparison of Functional Size and Story Points for Effort Prediction Effectiveness on Scrum Projects," METU/II-TR-2013-4, Ankara, 2013.

[29]

E. Ungan, N. Çizmeli, and O. Demirörs, "Comparison of Functional Size Based Estimation and Story Points, Based on Effort Estimation Effectiveness in SCRUM Projects," in 40th Euromicro Conference on Software Engineering and Advanced Applications Comparison, 2014, pp. 77--80.

Digital Library

Cited By

Ersoy EBagriyanik SSozer H(2024)On the Accuracy of Effort Estimations based on COSMIC Functional Size Measurement: A Case StudyProceedings of the 18th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/3674805.3695402(528-537)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3674805.3695402
Dewi RAraynawa TPrasanna FFelianasari NRahmawati RHartantc AKamilah LMazaya A(2024)Improving Software Size Estimation Using Data Complexity (Case Study: Research and Community Service Monitoring Apps)2024 11th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI)10.1109/EECSI63442.2024.10776530(315-319)Online publication date: 26-Sep-2024
https://doi.org/10.1109/EECSI63442.2024.10776530
Dewi RSoegiarto WFernando KReihan GPuspita MAl Ghazali MRaissa SKhodijah Nurhayati C(2024)Software Size Measurement Using Data Complexities (Case Study: Marketing Kit Monitoring System)2024 11th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI)10.1109/EECSI63442.2024.10776081(331-335)Online publication date: 26-Sep-2024
https://doi.org/10.1109/EECSI63442.2024.10776081
Show More Cited By

Index Terms

Effort estimation for agile software development: comparative case studies using COSMIC functional size measurement and story points
1. General and reference
  1. Cross-computing tools and techniques
    1. Metrics
2. Software and its engineering
  1. Software creation and management
    1. Software development process management
      1. Software development methods
        Agile software development

Recommendations

Effort estimation in agile software development: a systematic literature review
PROMISE '14: Proceedings of the 10th International Conference on Predictive Models in Software Engineering

Context: Ever since the emergence of agile methodologies in 2001, many software companies have shifted to Agile Software Development (ASD), and since then many studies have been conducted to investigate effort estimation within such context; however to ...
Effort estimation in agile software development: a survey on the state of the practice
EASE '15: Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering

Context: There are numerous studies on effort estimation in Agile Software Development (ASD) and the state of the art in this area has been recently documented in a Systematic Literature Review (SLR). However, to date there are no studies on the state ...
Understanding and improving effort estimation in Agile software development: an industrial case study
ICSSP '16: Proceedings of the International Conference on Software and Systems Process

Effort estimation is more challenging in an agile context, as instead of exerting strict control over changes in requirements, dynamism is embraced. Current practice relies on expert judgment, where the accuracy of estimates is sensitive to the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

IWSM Mensura '17: Proceedings of the 27th International Workshop on Software Measurement and 12th International Conference on Software Process and Product Measurement

October 2017

273 pages

ISBN:9781450348539

DOI:10.1145/3143434

General Chairs:
Miroslaw Staron
Chalmers | University of Gothenburg
,
Wilhelm Meding
Ericsson
,
Program Chairs:
Kai Petersen
Blekinge Institute of Technology
,
Cigdem Gencel
Free University of Bozen-Bolzano

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SWC: Software Center, University of Gothenburg, Sweden

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

IWSM/Mensura '17

Sponsor:

SWC

IWSM/Mensura '17: 27th International Workshop on Software Measurement and 12th International Conference on Software Process and Product Measurement

October 25 - 27, 2017

Gothenburg, Sweden

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
482
Total Downloads

Downloads (Last 12 months)58
Downloads (Last 6 weeks)7

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ersoy EBagriyanik SSozer H(2024)On the Accuracy of Effort Estimations based on COSMIC Functional Size Measurement: A Case StudyProceedings of the 18th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/3674805.3695402(528-537)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3674805.3695402
Dewi RAraynawa TPrasanna FFelianasari NRahmawati RHartantc AKamilah LMazaya A(2024)Improving Software Size Estimation Using Data Complexity (Case Study: Research and Community Service Monitoring Apps)2024 11th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI)10.1109/EECSI63442.2024.10776530(315-319)Online publication date: 26-Sep-2024
https://doi.org/10.1109/EECSI63442.2024.10776530
Dewi RSoegiarto WFernando KReihan GPuspita MAl Ghazali MRaissa SKhodijah Nurhayati C(2024)Software Size Measurement Using Data Complexities (Case Study: Marketing Kit Monitoring System)2024 11th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI)10.1109/EECSI63442.2024.10776081(331-335)Online publication date: 26-Sep-2024
https://doi.org/10.1109/EECSI63442.2024.10776081
Lavazza LLocoro AMeli R(2024)Using Machine Learning and Simplified Functional Measures to Estimate Software Development EffortIEEE Access10.1109/ACCESS.2024.347142812(142505-142523)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3471428
Ünlü HKennouche DSoylu GDemirörs O(2024)Microservice-based projects in agile worldInformation and Software Technology10.1016/j.infsof.2023.107334165:COnline publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1016/j.infsof.2023.107334
Benala TKaushik ADehuri SJain L(2024)Computational intelligence for estimating software development effort: a systematic mapping studyIran Journal of Computer Science10.1007/s42044-024-00178-97:3(607-630)Online publication date: 9-Apr-2024
https://doi.org/10.1007/s42044-024-00178-9
Rankovic NRanković DIvanovic MLazić LRankovic NRanković DIvanovic MLazić L(2024)Optimizing Effort and Cost Estimation: Model Implementation Using Artificial Neural Networks and Taguchi’s Orthogonal Vector PlansRecent Advances in Artificial Intelligence in Cost Estimation in Project Management10.1007/978-3-031-76572-8_9(291-417)Online publication date: 7-Dec-2024
https://doi.org/10.1007/978-3-031-76572-8_9
Alauthman Mal-Qerem AAlangari SAli ANabo AAldweesh AJebreen IAlmoman AGupta B(2023)Machine Learning for Accurate Software Development Cost Estimation in Economically and Technically Limited EnvironmentsInternational Journal of Software Science and Computational Intelligence10.4018/IJSSCI.33175315:1(1-24)Online publication date: 10-Oct-2023
https://doi.org/10.4018/IJSSCI.331753
Sarma Jampana PRushitasai SPathanjali S(2023)Suitability and feasibility study of the project for agilityi-manager’s Journal on Software Engineering10.26634/jse.17.3.1923617:3(13)Online publication date: 2023
https://doi.org/10.26634/jse.17.3.19236
Arachchi KAmalraj C(2023)An Agile Project Management Supporting Approach for Estimating Story Points in User Stories2023 8th International Conference on Information Technology Research (ICITR)10.1109/ICITR61062.2023.10382930(1-6)Online publication date: 7-Dec-2023
https://doi.org/10.1109/ICITR61062.2023.10382930
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents