[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
article

Three empirical studies on estimating the design effort of Web applications

Published: 01 September 2007 Publication History

Abstract

Our research focuses on the effort needed for designing modern Web applications. The design effort is an important part of the total development effort, since the implementation can be partially automated by tools.
We carried out three empirical studies with students of advanced university classes enrolled in engineering and communication sciences curricula. The empirical studies are based on the use of W2000, a special-purpose design notation for the design of Web applications, but the hypotheses and results may apply to a wider class of modeling notations (e.g., OOHDM, WebML, or UWE). We started by investigating the relative importance of each design activity. We then assessed the accuracy of a priori design effort predictions and the influence of a few process-related factors on the effort needed for each design activity. We also analyzed the impact of attributes like the size and complexity of W2000 design artifacts on the total effort needed to design the user experience of web applications. In addition, we carried out a finer-grain analysis, by studying which of these attributes impact the effort devoted to the steps of the design phase that are followed when using W2000.

References

[1]
Abrahão, S. M., Condori-Fernández, N., Olsina, L., and Pastor, O. 2003. Defining and validating metrics for navigational models. In Proceedings of the 9th IEEE International Software Metrics Symposium (METRICS 2003) (Sydney, Australia, Sept. 3--5). IEEE Computer Society Press, Los Alamitos, CA, 200--210.
[2]
Abrahão, S. M., Poels, G., and Pastor, O. 2004. Evaluating a functional size measurement method for web applications: An empirical analysis. In Proceedings of the 10th IEEE International Software Metrics Symposium (METRICS 2004) (Chicago, IL, Sept. 11--17). IEEE Computer Society Press, Los Alamitos, CA, 358--369.
[3]
Albrecht, A. J. and Gaffney, Jr., J. E. 1983. Software function, source lines of code, and development effort prediction: A software science validation. IEEE Trans. Softw. Eng. 9, 6, 639--648.
[4]
Baresi, L., Morasca, S., and Paolini, P. 2002. An empirical study on the design effort of web applications. In Proceedings of the 3rd International Conference on Web Information Systems Engineering (WISE 2002) (Singapore, Dec. 12--14). IEEE Computer Society Press, Los Alamitos, CA, 345--354.
[5]
Baresi, L., Morasca, S., and Paolini, P. 2003. Estimating the design effort of web applications. In Proceedings of the 9th IEEE International Software Metrics Symposium (METRICS 2003) (Sydney, Australia, Sept. 3--5). IEEE Computer Society Press, Los Alamitos, CA, 62--72.
[6]
Baresi, L., Colazzo, S., Mainetti, L., and Morasca, S. 2006. Web engineering, W2000: A modeling notation for complex Web applications. In Web Engineering, Mendes, E. and Mosley, N. Eds., Springer-Verlag, 335--364.
[7]
Boehm, B. M., Horowitz, E., Madachy, R., Reifer, D., Clark, B. K., Steece, B., Brown, A. W., Chulani, S., and Abts, C. 2000. Software Cost Estimation with Cocomo II. Prentice-Hall, Upper Saddle River, NJ.
[8]
Boehm, B. W. 1981. Software Engineering Economics. Prentice-Hall, Upper Saddle River, NJ.
[9]
Briand, L., El Emam, K., and Bomarius, F. 1998. COBRA: A hybrid method for software cost estimation, benchmarking, and risk assessment. In Proceedings of the 20th International Conference on Software Engineering (Kyoto, Japan, Apr. 19--25). IEEE Computer Society Press, Los Alamitos, CA, 390--399.
[10]
Calero, C., Ruiz, J., and, Piattini, M. 2004. A web metrics survey using WQM. In Web Engineering---4th International Conference, ICWE 2004 (Munich, Germany, July 26--30), Proceedings. Lecture Notes in Computer Science, vol. 3140. Springer-Verlag, Berlin, Germany, 147--160.
[11]
Carver, J., Jaccheri, L., Morasca, S., and Shull, F. 2003. Issues in using students in empirical studies in software engineering education. In Proceedings of the 9th IEEE International Software Metrics Symposium (METRICS 2003) (Sydney, Australia, Sept. 3--5). IEEE Computer Society Press, Los Alamitos, CA, 239--248.
[12]
Ceri, S., Fraternali, P., and Bongio, A. 2000. Web modeling language (WebML): A modeling language for designing Web sites. Comput. Netw. 33, 1--6 (June), 137--157.
[13]
Conallen, J. 2002. Building Web Applications with UML, 2nd ed. Addison-Wesley, Boston, MA.
[14]
COSMIC. 2003. COSMIC-FFP Measurement Manual, vers. 2.2. Common Software Measurement International Consortium. http://www.cosmicon.com.
[15]
Costagliola, G., Ferrucci, F., Gravino, C., Tortora, G., and Vitiello, G. 2004. A COSMIC-FFP based method to estimate web application development effort. In Web Engineering---4th International Conference, ICWE 2004 (Munich, Germany, July 26--30). Lecture Notes in Computer Science, vol. 3140. Springer-Verlag, Berlin, Germany, 161--165.
[16]
Dhyani, D., Ng, W. K., and Bhowmick, S. S. 2002. A survey of web metrics. ACM Comput. Surv. 34, 4, 469--503.
[17]
Fenton, N. 1991. Software Metrics: A Rigorous Approach. Chapman and Hall, London, UK.
[18]
Fenton, N. and Pfleeger, S. L. 1996. Software Metrics: A Rigorous and Practical Approach, 2nd ed. International Thomson Computer Press, London, UK.
[19]
Fewster, R. M. and Mendes, E. 2003. Portfolio management method for deadline planning. In Proceedings of the 9th IEEE International Software Metrics Symposium (METRICS 2003) (Sydney, Australia, Sept. 3--5). IEEE Computer Society Press, Los Alamitos, CA, 325--334.
[20]
Garmus, D. and Herron, D. 2001. Function point analysis: Measurement Practices for Successful Software Projects. Addison-Wesley Longman Publishing Co., Inc., Boston, MA.
[21]
Garrett, J. J. 2002. The Elements of User Experience: User-Centered Design for the Web. New Riders Press, Berkeley, CA.
[22]
Garzotto, F., Schwabe, D., and Paolini, P. 1993. HDM---A model based approach to hypermedia application design. ACM Trans. Inform. Syst. 11, 1 (Jan.), 1--26.
[23]
Gibbons, J. D. 1993. Nonparametric Measures of Association. SAGE Publications, Thousand Oaks, CA.
[24]
Ginige, A. and Murugesan, S. 2001. Guest editors' introduction: Web engineering---an introduction. IEEE MultiMedia 8, 1, 14--18.
[25]
Kappel, G., Pröll, B., Reich, S., and Retschitzegger, W. 2006. Web Engineering: The Discipline of Systematic Development of Web Applications. Wiley, New York, NY.
[26]
Kitchenham, B. A. and Mendes, E. 2004. Software productivity measurement using multiple size measures. IEEE Trans. Softw. Eng. 30, 12, 1023--1035.
[27]
Knapp, A., Koch, N., Zhang, G., and Hassler, H.-M. 2004. Modeling business processes in web applications with argouwe. In Proceedings of UML 2004---The Unified Modelling Language: Modelling Languages and Applications. 7th International Conference (Lisbon, Portugal, Oct. 11--15). Lecture Notes in Computer Science, vol. 3273. Springer-Verlag, Berlin, Germany, 69--83.
[28]
Mangia, L. and Paiano, R. 2003. Mmwa: A software sizing model for web applications. In Proceedings of the 4th International Conference on Web Information Systems Engineering (WISE 2003) (Rome, Italy, Dec. 10--12). IEEE Computer Society Press, Los Alamitos, CA, 53--61.
[29]
Mendes, E., Counsell, S., and Mosley, N. 2005a. Towards a taxonomy of hypermedia and web application size metrics. In Web Engineering, 5th International Conference, ICWE 2005 (Sydney, Australia, July 27--29). Lecture Notes in Computer Science, vol. 3579. Springer-Verlag, Berlin, Germany, 110--123.
[30]
Mendes, E. and Kitchenham, B. A. 2004. Further comparison of cross-company and within-company effort estimation models for web applications. In Proceedings of the 10th IEEE International Software Metrics Symposium (METRICS 2004) (Chicago, IL, Sept. 11--17). IEEE Computer Society Press, Los Alamitos, CA, 348--357.
[31]
Mendes, E. and Mosley, N. 2006. Web Engineering. Springer-Verlag, Berlin, Germany.
[32]
Mendes, E., Mosley, N., and Counsell, S. 2002a. Comparison of web size measures for predicting web design and authoring effort. IEE Proc.---Softw. 149, 3, 86--92.
[33]
Mendes, E., Mosley, N., and Counsell, S. 2003a. A replicated assessment of the use of adaptation rules to improve web cost estimation. In Proceedings of the 2003 International Symposium on Empirical Software Engineering (ISESE 2003) (Rome, Italy, Sept. 30--Oct. 1). IEEE Computer Society Press, Los Alamitos, CA, 100--109.
[34]
Mendes, E., Mosley, N., and Counsell, S. 2005b. Investigating web size metrics for early web cost estimation. J. Syst. Softw. 77, 2, 157--172.
[35]
Mendes, E., Mosley, N., and Counsell, S. 2006. Web Engineering. Springer-Verlag, Berlin, Germany (Chapter: Web Effort Estimation), 31--76.
[36]
Mendes, E., Watson, I., Triggs, C., Mosley, N., and Counsell, S. 2002b. A comparison of length, complexity and functionality as size measures for predicting web design and authoring effort. In Proceedings of the IEEE Metrics Symposium, 2002. IEEE Computer Society Press, Los Alamitos, CA.
[37]
Mendes, E., Watson, I., Triggs, C., Mosley, N., and Counsell, S. 2003b. A comparative study of cost estimation models for web hypermedia applications. Empir. Softw. Eng. 8, 2, 163--196.
[38]
Murugesan, S., and Deshpande, Y. 2002. Meeting the challenges of web application development: The web engineering approach. In Proceedings of the 22rd International Conference on Software Engineering, ICSE 2002 (Orlando, FL, May 19--25). ACM, New York, 687--688.
[39]
Reifer, D. 2000. Web-development: Estimating quick-time-to-market software. IEEE Softw. 17, 8 (Nov./Dec.), 57--64.
[40]
Reifer, D. 2002. Ten deadly risks in internet and intranet software development. IEEE Softw. 18, 2 (Mar./Apr.), 12--14.
[41]
Rousseeuw, P. J. and Leroy, A. M. 1987. Robust Regression and Outlier Detection. Wiley, New York.
[42]
Ruhe, M., Jeffery, D. R., and Wieczorek, I. 2003a. Using web objects for estimating software development effort for web applications. In Proceedings of the 9th IEEE International Software Metrics Symposium (METRICS 2003) (Sydney, Australia, Sept. 3--5). IEEE Computer Society Press, Los Alamitos, CA, 30--39.
[43]
Ruhe, M., Jeffery, R., and Wieczorek, I. 2003b. Cost estimation for web applications. In Proceedings of the 25th International Conference on Software Engineering (Portland, OR, May 3--10). IEEE Computer Society Press, Los Alamitos, CA, 285--294.
[44]
Schwabe, D. and Rossi, G. 1998. An object oriented approach to web-based applications design. Theory Pract. Obj. Syst. 4, 4, 207--225.
[45]
Tukutuku Benchmarking Project 2006. Home page, http://www.cs.auckland.ac.nz/tukutuku/.
[46]
Umbers, P. and Miles, G. 2004. Resource estimation for web applications. In Proceedings of the 10th IEEE International Software Metrics Symposium (METRICS 2004) (Chicago, IL, Sept. 11--17). IEEE Computer Society Press, Los Alamitos, CA, 370--381.

Cited By

View all
  • (2022)Towards a Life Cycle Model for the Development of Semantic Web Applications2022 International Conference on Fourth Industrial Revolution Based Technology and Practices (ICFIRTP)10.1109/ICFIRTP56122.2022.10059419(154-159)Online publication date: 23-Nov-2022
  • (2020)Effective Systems Security Requirements in Product Line EngineeringINSIGHT10.1002/inst.1230623:3(26-30)Online publication date: 8-Oct-2020
  • (2018)Definition and evaluation of a COSMIC measurement procedure for sizing Web applications in a model-driven development environmentInformation and Software Technology10.1016/j.infsof.2018.07.012104(144-161)Online publication date: Dec-2018
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Software Engineering and Methodology
ACM Transactions on Software Engineering and Methodology  Volume 16, Issue 4
September 2007
117 pages
ISSN:1049-331X
EISSN:1557-7392
DOI:10.1145/1276933
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 2007
Published in TOSEM Volume 16, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. W2000
  2. Web application design
  3. effort estimation
  4. empirical study

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)11
  • Downloads (Last 6 weeks)1
Reflects downloads up to 05 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Towards a Life Cycle Model for the Development of Semantic Web Applications2022 International Conference on Fourth Industrial Revolution Based Technology and Practices (ICFIRTP)10.1109/ICFIRTP56122.2022.10059419(154-159)Online publication date: 23-Nov-2022
  • (2020)Effective Systems Security Requirements in Product Line EngineeringINSIGHT10.1002/inst.1230623:3(26-30)Online publication date: 8-Oct-2020
  • (2018)Definition and evaluation of a COSMIC measurement procedure for sizing Web applications in a model-driven development environmentInformation and Software Technology10.1016/j.infsof.2018.07.012104(144-161)Online publication date: Dec-2018
  • (2018)The role and value of replication in empirical software engineering resultsInformation and Software Technology10.1016/j.infsof.2018.01.00699(120-132)Online publication date: Jul-2018
  • (2017)A case study for teaching students agile and scrum in Capstone courseJournal of Computing Sciences in Colleges10.5555/3069621.306964532:5(95-101)Online publication date: 1-May-2017
  • (2017)Web complexity factors! A novel approach for predicting size measures for web application development2017 International Conference on Inventive Computing and Informatics (ICICI)10.1109/ICICI.2017.8365266(897-902)Online publication date: Nov-2017
  • (2016)Web Effort EstimationInformation and Software Technology10.1016/j.infsof.2015.12.00172:C(90-109)Online publication date: 1-Apr-2016
  • (2015)Early effort estimation in web application developmentJournal of Systems and Software10.1016/j.jss.2015.02.006103:C(219-237)Online publication date: 1-May-2015
  • (2013)Towards a simplified definition of Function PointsInformation and Software Technology10.1016/j.infsof.2013.04.00355:10(1796-1809)Online publication date: 1-Oct-2013
  • (2012)Functional versus design measures for model-driven web applicationsProceedings of the 3rd International Workshop on Emerging Trends in Software Metrics10.5555/2669379.2669384(21-27)Online publication date: 3-Jun-2012
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media