Article

Assessing test-driven development at IBM

Authors:

E. Michael Maximilien,

Laurie WilliamsAuthors Info & Claims

ICSE '03: Proceedings of the 25th International Conference on Software Engineering

Pages 564 - 569

Published: 03 May 2003 Publication History

Publisher Site Get Access

Abstract

In a software development group of IBM Retail Store Solutions, we built a non-trivial software system based on a stable standard specification using a disciplined, rigorous unit testing and build approach based on the test- driven development (TDD) practice. Using this practice, we reduced our defect rate by about 50 percent compared to a similar system that was built using an ad-hoc unit testing approach. The project completed on time with minimal development productivity impact. Additionally, the suite of automated unit test cases created via TDD is a reusable and extendable asset that will continue to improve quality over the lifetime of the software system. The test suite will be the basis for quality checks and will serve as a quality contract between all members of the team.

References

[1]

Beck, K., Extreme Programming Explained: Embrace Change. Reading, Massachusetts: Addison-Wesley, 2000.

Digital Library

Google Scholar

[2]

Beck, K., Test Driven Development -- by Example. Boston: Addison Wesley, 2003.

Digital Library

Google Scholar

[3]

Boehm, B. W., Software Engineering Economics. Englewood Cliffs, NJ: Prentice-Hall, Inc., 1981.

Digital Library

Google Scholar

[4]

Cockburn, A., Agile Software Development. Reading, Massachusetts: Addison Wesley Longman, 2001.

Digital Library

Google Scholar

[5]

Dustin, E., Rashka, J., and Paul, J., Automated Software Testing. Reading, Massachusetts: Addison Wesley, 1999.

Digital Library

Google Scholar

[6]

Fowler, M., UML Distilled. Reading, Massachusetts: Addison Wesley, 2000.

Google Scholar

[7]

George, B. and Williams, L., "An Initial Investigation of Test-Driven Development in Industry," ACM SAC, Mel, FL, 2003.

Digital Library

Google Scholar

[8]

Meyer, B., "Applying Design by Contract," IEEE Computer, vol. 25, pp. 40--51, October 1992.

Digital Library

Google Scholar

[9]

Muller, M. M. and Hagner, O., "Experiment about Test-first Programming," presented at Conference on Empirical Assessment in Software Engineering (EASE), 2002.

Google Scholar

Cited By

View all

Kazerouni AShaffer CEdwards SServant FHawthorne EPérez-Quiñones MHeckman SZhang J(2019)Assessing Incremental Testing Practices and Their Impact on Project OutcomesProceedings of the 50th ACM Technical Symposium on Computer Science Education10.1145/3287324.3287366(407-413)Online publication date: 22-Feb-2019
https://dl.acm.org/doi/10.1145/3287324.3287366
Ju AFox APolycarpou IRead JAndreou PArmoni M(2018)TEAMSCOPE: measuring software engineering processes with teamwork telemetryProceedings of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education10.1145/3197091.3197107(123-128)Online publication date: 2-Jul-2018
https://dl.acm.org/doi/10.1145/3197091.3197107
Fucci DScanniello GRomano SShepperd MSigweni BUyaguari FTurhan BJuristo NOivo MGenero MJedlitschka AJørgensen MScanniello GSampath SCaivano DPort D(2016)An External Replication on the Effects of Test-driven Development Using a Multi-site Blind Analysis ApproachProceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/2961111.2962592(1-10)Online publication date: 8-Sep-2016
https://dl.acm.org/doi/10.1145/2961111.2962592
Show More Cited By

Index Terms

Assessing test-driven development at IBM

Recommendations

Realizing quality improvement through test driven development: results and experiences of four industrial teams

Test-driven development (TDD) is a software development practice that has been used sporadically for decades. With this practice, a software engineer cycles minute-by-minute between writing failing unit tests and writing implementation code to pass ...
Test-Driven Development: Concepts, Taxonomy, and Future Direction

Test-driven development creates software in very short iterations with minimal upfront design. Poised for widespread adoption TDD has become the focus of an increasing number of researchers and developers.
Learning Test-Driven Development by Counting Lines

Test-driven development is an agile development practice that changes every minute of developers' daily lives. That's a big change! How can you best train developers in such a pervasive practice? One method is to write tests for counting lines of code. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ICSE '03: Proceedings of the 25th International Conference on Software Engineering

May 2003

841 pages

ISBN:076951877X

General Chair:
Lori Clarke
University of Massachusetts
,
Program Chairs:
Laurie Dillon
Michigan State University
,
Walter Tichy
University of Karlsruhe, Germany

Publisher

IEEE Computer Society

United States

Publication History

Published: 03 May 2003

Check for updates

Qualifiers

Article

Conference

ICSE03

Sponsor:

SIGSOFT

ICSE03: 25th International Conference on Software Engineering

May 3 - 10, 2003

Oregon, Portland

Acceptance Rates

ICSE '03 Paper Acceptance Rate 42 of 324 submissions, 13%;

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
2,347
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)2

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kazerouni AShaffer CEdwards SServant FHawthorne EPérez-Quiñones MHeckman SZhang J(2019)Assessing Incremental Testing Practices and Their Impact on Project OutcomesProceedings of the 50th ACM Technical Symposium on Computer Science Education10.1145/3287324.3287366(407-413)Online publication date: 22-Feb-2019
https://dl.acm.org/doi/10.1145/3287324.3287366
Ju AFox APolycarpou IRead JAndreou PArmoni M(2018)TEAMSCOPE: measuring software engineering processes with teamwork telemetryProceedings of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education10.1145/3197091.3197107(123-128)Online publication date: 2-Jul-2018
https://dl.acm.org/doi/10.1145/3197091.3197107
Fucci DScanniello GRomano SShepperd MSigweni BUyaguari FTurhan BJuristo NOivo MGenero MJedlitschka AJørgensen MScanniello GSampath SCaivano DPort D(2016)An External Replication on the Effects of Test-driven Development Using a Multi-site Blind Analysis ApproachProceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/2961111.2962592(1-10)Online publication date: 8-Sep-2016
https://dl.acm.org/doi/10.1145/2961111.2962592
Choudhari JSuman U(2015)An Empirical Evaluation of Iterative Maintenance Life Cycle Using XPACM SIGSOFT Software Engineering Notes10.1145/2735399.273540640:2(1-14)Online publication date: 3-Apr-2015
https://dl.acm.org/doi/10.1145/2735399.2735406
Munir HWnuk KPetersen KMoayyed MShepperd MHall TMyrtveit I(2014)An experimental evaluation of test driven development vs. test-last development with industry professionalsProceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering10.1145/2601248.2601267(1-10)Online publication date: 13-May-2014
https://dl.acm.org/doi/10.1145/2601248.2601267
Fucci DJalote PBriand LHoek A(2014)Understanding the dynamics of test-driven developmentCompanion Proceedings of the 36th International Conference on Software Engineering10.1145/2591062.2591086(690-693)Online publication date: 31-May-2014
https://dl.acm.org/doi/10.1145/2591062.2591086
Munir HMoayyed MPetersen K(2014)Considering rigor and relevance when evaluating test driven developmentInformation and Software Technology10.1016/j.infsof.2014.01.00256:4(375-394)Online publication date: 1-Apr-2014
https://dl.acm.org/doi/10.1016/j.infsof.2014.01.002
Polikarpova NFuria CPei YWei YMeyer BNotkin DCheng BPohl K(2013)What good are strong specifications?Proceedings of the 2013 International Conference on Software Engineering10.5555/2486788.2486823(262-271)Online publication date: 18-May-2013
https://dl.acm.org/doi/10.5555/2486788.2486823
Ziftci CKrüger IShin SMaldonado J(2013)Test intentsProceedings of the 28th Annual ACM Symposium on Applied Computing10.1145/2480362.2480600(1272-1277)Online publication date: 18-Mar-2013
https://dl.acm.org/doi/10.1145/2480362.2480600
Lemos OFerrari FSilveira FGarcia AGlinz MMurphy GPezzè M(2012)Development of auxiliary functions: should you be agile? an empirical assessment of pair programming and test-first programmingProceedings of the 34th International Conference on Software Engineering10.5555/2337223.2337285(529-539)Online publication date: 2-Jun-2012
https://dl.acm.org/doi/10.5555/2337223.2337285
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Realizing quality improvement through test driven development: results and experiences of four industrial teams

Test-Driven Development: Concepts, Taxonomy, and Future Direction

Learning Test-Driven Development by Counting Lines

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations