research-article

Empirical and face validity of software maintenance defect models used at the jet propulsion laboratory

Authors:

William Taber,

Dan PortAuthors Info & Claims

ESEM '14: Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement

Article No.: 7, Pages 1 - 7

https://doi.org/10.1145/2652524.2652590

Published: 18 September 2014 Publication History

Get Access

Abstract

Context: At the Mission Design and Navigation Software Group at the Jet Propulsion Laboratory we make use of finite exponential based defect models to aid in maintenance planning and management for our widely used critical systems. However a number of pragmatic issues arise when applying defect models for a post-release system in continuous use. These include: how to utilize information from problem reports rather than testing to drive defect discovery and removal effort, practical model calibration, and alignment of model assumptions with our environment.

Goal: To show how we can develop confidence in the practical applicability of our models for obtaining stable maintenance funding.

Method: We describe the strong empirical and face validity we have investigated for our maintenance defect discovery and introduction models. We discuss the practical details of calibration and application within a functioning maintenance environment.

Results: We find that our models, despite their simplicity, appear quite valid.

Conclusions: The models are useful in justifying and obtaining stable maintenance funding.

References

[1]

Casella G, Berger R. Statistical Inference 2^nd Edition. Duxbury Press. 511 Forest Lodge Road, Pacific Grove, CA 93950, USA

Google Scholar

[2]

Garrison Q. Kenny. "Estimating defects in commercial software during operational use." IEEE 1993.

Google Scholar

[3]

J. D. Musa. "Validity of Execution-Time Theory of Software Reliability." IEEE Transactions of Reliability, Vol R-28, 1979. pp181--191. J. D. Musa, K. Okumoto

Crossref

Google Scholar

[4]

Jelinski, Z., and Moranda, P. "Software Reliability Research," Statistical Computer Performance Evaluation, Freiberger, W. Ed. Academic Press, New York, NY

Google Scholar

[5]

Kan S. Metrics and Models in Software Quality Engineering 2^nd Edition. Addison-Wesley, Boston MA, USA

Digital Library

Google Scholar

[6]

Li, P., Mary Shaw, and Jim Herbsleb. "Selecting a defect prediction model for maintenance resource planning and software insurance." EDSER-5 affiliated with ICSE (2003): p32--37.

Google Scholar

[7]

Li, Paul Luo, et al. Empirical evaluation of defect projection models for widely-deployed production software systems. Vol. 29. No. 6. ACM, 2004.

Digital Library

Google Scholar

[8]

Neufelder, A M. Ensuring Software Reliability. Marcel Decker, Inc. 270 Madison Avenue, New York, NY 10016, USA

Digital Library

Google Scholar

[9]

Savage, L. J. The Foundations of Statistics. Dover Publications, Inc. 180 Varick Street, New York, NY 10014, USA

Google Scholar

Cited By

View all

Camilli MRusso B(2022)Modeling Performance of Microservices Systems with Growth TheoryEmpirical Software Engineering10.1007/s10664-021-10088-027:2Online publication date: 11-Jan-2022
https://doi.org/10.1007/s10664-021-10088-0
González Martínez AWooton BKirshenbaum NKobayashi DLeigh J(2020)Exploring Collections of research publications with Human Steerable AIPractice and Experience in Advanced Research Computing 2020: Catch the Wave10.1145/3311790.3396646(339-348)Online publication date: 26-Jul-2020
https://dl.acm.org/doi/10.1145/3311790.3396646
Port DTaber BOivo MMéndez DMockus A(2018)An empirical study of process policies and metrics to manage productivity and quality for maintenance of critical software systems at the jet propulsion laboratoryProceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/3239235.3268925(1-10)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3239235.3268925
Show More Cited By

Index Terms

Empirical and face validity of software maintenance defect models used at the jet propulsion laboratory

Recommendations

Staffing Strategies for Maintenance of Critical Software Systems at the Jet Propulsion Laboratory
ESEM '16: Proceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement

Context: The Mission Design and Navigation Software Group at the Jet Propulsion Laboratory (JPL) maintains mission critical software systems. We have good empirical data and models for maintenance demand---when defects will occur, how many and how ...
An empirical study of process policies and metrics to manage productivity and quality for maintenance of critical software systems at the jet propulsion laboratory
ESEM '18: Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement

Context/ Background: The Mission Design and Navigation Software (MDN) Group at the Jet Propulsion Laboratory (JPL) develops and continuously maintains software systems critical for NASA deep space missions. Given limited budgets, staffing resources, and ...
Software Maintenance Process Model and Contrastive Analysis
ICIII '11: Proceedings of the 2011 International Conference on Information Management, Innovation Management and Industrial Engineering - Volume 03

Software maintenance is an important stage of software life cycle, according to the problems of software maintenance process model, research software maintenance process model, focus on software after delivery to retire between the software maintenance ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ESEM '14: Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement

September 2014

461 pages

ISBN:9781450327749

DOI:10.1145/2652524

General Chair:
Maurizio Morisio
Politecnico di Torino, Italy
,
Program Chairs:
Tore Dybå
Sintef, Norway
,
Marco Torchiano
Politecnico di Torino, Italy

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2014

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ESEM '14

Sponsor:

SIGSOFT

ESEM '14: 2014 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement

September 18 - 19, 2014

Torino, Italy

Acceptance Rates

ESEM '14 Paper Acceptance Rate 23 of 123 submissions, 19%;

Overall Acceptance Rate 130 of 594 submissions, 22%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
155
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Camilli MRusso B(2022)Modeling Performance of Microservices Systems with Growth TheoryEmpirical Software Engineering10.1007/s10664-021-10088-027:2Online publication date: 11-Jan-2022
https://doi.org/10.1007/s10664-021-10088-0
González Martínez AWooton BKirshenbaum NKobayashi DLeigh J(2020)Exploring Collections of research publications with Human Steerable AIPractice and Experience in Advanced Research Computing 2020: Catch the Wave10.1145/3311790.3396646(339-348)Online publication date: 26-Jul-2020
https://dl.acm.org/doi/10.1145/3311790.3396646
Port DTaber BOivo MMéndez DMockus A(2018)An empirical study of process policies and metrics to manage productivity and quality for maintenance of critical software systems at the jet propulsion laboratoryProceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/3239235.3268925(1-10)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3239235.3268925
Port DTaber B(2018)Actionable Analytics for Strategic Maintenance of Critical Software: An Industry Experience ReportIEEE Software10.1109/MS.2017.454105535:1(58-63)Online publication date: Jan-2018
https://doi.org/10.1109/MS.2017.4541055
Taber WPort DGenero MJedlitschka AJørgensen MScanniello GSampath SCaivano DPort D(2016)Staffing Strategies for Maintenance of Critical Software Systems at the Jet Propulsion LaboratoryProceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/2961111.2962640(1-6)Online publication date: 8-Sep-2016
https://dl.acm.org/doi/10.1145/2961111.2962640

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Staffing Strategies for Maintenance of Critical Software Systems at the Jet Propulsion Laboratory

An empirical study of process policies and metrics to manage productivity and quality for maintenance of critical software systems at the jet propulsion laboratory

Software Maintenance Process Model and Contrastive Analysis