research-article

An empirical study of bugs in build process

Authors:

Xiaoqiong Zhao,

Xin Xia,

Pavneet Singh Kochhar,

David Lo,

Shanping LiAuthors Info & Claims

SAC '14: Proceedings of the 29th Annual ACM Symposium on Applied Computing

Pages 1187 - 1189

https://doi.org/10.1145/2554850.2555142

Published: 24 March 2014 Publication History

Get Access

Abstract

Software build process translates source codes into executable programs, packages the programs, generates documents, and distributes products. In this paper, we perform an empirical study to characterize build process bugs. We analyze bugs in build process in 5 open-source systems under Apache namely CXF, Camel, Felix, Struts, and Tuscany. We compare build process bugs and other bugs across 3 different dimensions, i.e., bug severity, bug fix time, and the number of files modified to fix a bug. Our results show that the fraction of build process bugs which are above major severity level is lower than that of other bugs. However, the time effort required to fix a build process bug is around 2.03 times more than that of a non-build process bug, and the number of source files modified to fix a build process bug is around 2.34 times more than that modified for a non-build bug.

References

[1]

G. K. Kumfert and T. G. W. Epperly, "Software in the DOE: The Hidden Overhead of "The Build"," Tech. Rep., 2002.

Crossref

Google Scholar

[2]

T. F. Bissyandé, F. Thung, S. Wang, D. Lo, L. Jiang, and L. Réveillère, "Empirical evaluation of bug linking," in CSMR, 2013.

Digital Library

Google Scholar

[3]

K. Pearson, "On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that can be reasonably supposed to have arisen from random sampling," Philosophical Magazine, 1900.

Google Scholar

[4]

H. Zhang, L. Gong, and S. Versteeg, "Predicting bug-fixing time: an empirical study of commercial software projects," in ICSE, 2013.

Digital Library

Google Scholar

[5]

H. Hosseini, R. Nguyen, and M. W. Godfrey, "A market-based bug allocation mechanism using predictive bug lifetimes," in CSMR, 2012.

Digital Library

Google Scholar

[6]

H. B. Mann and D. R. Whitney, "On a test of whether one of two random variables is stochastically larger than the other," The Annals of Mathematical Statistics, 1947.

Google Scholar

[7]

C. B. Seaman, F. Shull, M. Regardie, D. Elbert, R. L. Feldmann, Y. Guo, and S. Godfrey, "Defect categorization: making use of a decade of widely varying historical data," in ESEM, 2008.

Digital Library

Google Scholar

[8]

Z. Li, L. Tan, X. Wang, S. Lu, Y. Zhou, and C. Zhai, "Have things changed now? An empirical study of bug characteristics in modern open source software," in ASID, 2006.

Digital Library

Google Scholar

[9]

K. Pan, S. Kim, and E. J. Whitehead Jr, "Toward an understanding of bug fix patterns," Empirical Software Engineering, 2009.

Digital Library

Google Scholar

[10]

S. Zaman, B. Adams, and A. E. Hassan, "Security versus performance bugs: a case study on firefox," in MSR, 2011.

Digital Library

Google Scholar

[11]

A. Chou, J. Yang, B. Chelf, S. Hallem, and D. Engler, "An empirical study of operating systems errors," in SOSP, 2001.

Digital Library

Google Scholar

[12]

F. Thung, S. Wang, D. Lo, and L. Jiang, "An empirical study of bugs in machine learning systems," in ISSRE, 2012.

Google Scholar

[13]

X. Xia, X. Zhou, D. Lo, and X. Zhao, "An empirical study of bugs in software build systems," in QSIC, 2013, pp. 200--203.

Digital Library

Google Scholar

Cited By

View all

Huang SWang XFilkov VRay BZhou M(2024)Build Issue Resolution from the Perspective of Non-ContributorsProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695304(2304-2308)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695304
Goyal ASardana N(2019)An empirical study of non-reproducible bugsInternational Journal of System Assurance Engineering and Management10.1007/s13198-019-00850-5Online publication date: 7-Sep-2019
https://doi.org/10.1007/s13198-019-00850-5
Kashiwa YIhara AOhira M(2019)What Are the Perception Gaps Between FLOSS Developers and SE Researchers?Open Source Systems10.1007/978-3-030-20883-7_5(44-57)Online publication date: 23-May-2019
https://doi.org/10.1007/978-3-030-20883-7_5
Show More Cited By

Index Terms

An empirical study of bugs in build process
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

An Empirical Study on Critical Blocking Bugs
ICPC '20: Proceedings of the 28th International Conference on Program Comprehension

Blocking bugs are a severe type of bugs that prevent other bugs from being fixed. As software becomes increasingly complex and large, blocking bugs occur in many large-scale software, especially in software ecosystems. Blocking bugs may have a high ...
An Empirical Study of Bugs in Software Build Systems
QSIC '13: Proceedings of the 2013 13th International Conference on Quality Software

Build system converts source code, libraries and other data into executable programs by orchestrating the execution of compilers and other tools. The whole building process is managed by a software build system, such as Make, Ant, CMake, Maven, Scons, ...
An empirical study of dormant bugs
MSR 2014: Proceedings of the 11th Working Conference on Mining Software Repositories

Over the past decade, several research efforts have studied the quality of software systems by looking at post-release bugs. However, these studies do not account for bugs that remain dormant (i.e., introduced in a version of the software system, but ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

SAC '14: Proceedings of the 29th Annual ACM Symposium on Applied Computing

March 2014

1890 pages

ISBN:9781450324694

DOI:10.1145/2554850

Conference Chairs:
Yookun Cho
Seoul National University, Korea
,
Sung Y. Shin
South Dakota State University
,
Program Chairs:
Sangwook Kim
Kyungpook National University, Korea
,
Chih-Cheng Hung
Southern Polytechnic State University
,
Jiman Hong
Soongsil University, South Korea

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 March 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Key Technology R&D Program of the Ministry of Science and Technology of China
National Natural Science Foundation of China

Conference

SAC 2014

Sponsor:

SIGAPP

SAC 2014: Symposium on Applied Computing

March 24 - 28, 2014

Gyeongju, Republic of Korea

Acceptance Rates

SAC '14 Paper Acceptance Rate 218 of 939 submissions, 23%;

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Upcoming Conference

SAC '25

Sponsor:
sigapp

The 40th ACM/SIGAPP Symposium on Applied Computing

March 31 - April 4, 2025

Catania , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
181
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Huang SWang XFilkov VRay BZhou M(2024)Build Issue Resolution from the Perspective of Non-ContributorsProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695304(2304-2308)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695304
Goyal ASardana N(2019)An empirical study of non-reproducible bugsInternational Journal of System Assurance Engineering and Management10.1007/s13198-019-00850-5Online publication date: 7-Sep-2019
https://doi.org/10.1007/s13198-019-00850-5
Kashiwa YIhara AOhira M(2019)What Are the Perception Gaps Between FLOSS Developers and SE Researchers?Open Source Systems10.1007/978-3-030-20883-7_5(44-57)Online publication date: 23-May-2019
https://doi.org/10.1007/978-3-030-20883-7_5
Wan ZLo DXia XCai LGonzalez-Barahona JHindle ATan L(2017)Bug characteristics in blockchain systemsProceedings of the 14th International Conference on Mining Software Repositories10.1109/MSR.2017.59(413-424)Online publication date: 20-May-2017
https://dl.acm.org/doi/10.1109/MSR.2017.59
Xia XLo DWang XZhou BCho YShin SKim SHung CHong J(2014)Build system analysis with link predictionProceedings of the 29th Annual ACM Symposium on Applied Computing10.1145/2554850.2555134(1184-1186)Online publication date: 24-Mar-2014
https://dl.acm.org/doi/10.1145/2554850.2555134
Zhou BXia XLo DWang X(2014)Build PredictorProceedings of the 2014 IEEE 38th Annual Computer Software and Applications Conference10.1109/COMPSAC.2014.12(53-58)Online publication date: 21-Jul-2014
https://dl.acm.org/doi/10.1109/COMPSAC.2014.12

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

An Empirical Study on Critical Blocking Bugs

An Empirical Study of Bugs in Software Build Systems

An empirical study of dormant bugs