More Web Proxy on the site http://driver.im/

research-article

Mining Questions Asked about Continuous Software Engineering: A Case Study of Stack Overflow

Authors:

Mansooreh Zahedi,

Roshan Namal Rajapakse,

Muhammad Ali BabarAuthors Info & Claims

EASE '20: Proceedings of the 24th International Conference on Evaluation and Assessment in Software Engineering

Pages 41 - 50

https://doi.org/10.1145/3383219.3383224

Published: 17 April 2020 Publication History

Abstract

Context: With the growing popularity of rapid software delivery and deployment, the methods, practices and technologies of Continuous Software Engineering (CSE) are evolving steadily. This creates the need for understanding the recent trends of the technologies, practitioners' challenges and views in this domain. Objective: In this paper, we present an empirical study aimed at exploring CSE from the practitioners' perspective by mining discussions from Q&A websites. Method: We have analyzed 12,989 questions and answers posted on Stack Overflow. Topic modelling is conducted to derive the dominant topics in this domain. Further, a qualitative analysis was conducted to identify the key challenges discussed. Findings: Whilst the trend of posted questions is sharply increasing, the questions are becoming more specific to technologies and more difficult to attract answers. We identified 32 topics of discussions, among which "Error messages in Continuous Integration/Deployment" and "Continuous Integration concepts" are the most dominant. We also present the most challenging areas in this domain from the practitioners' perspectives.

References

[1]

Kartik Bajaj, Karthik Pattabiraman, and Ali Mesbah. 2014. Mining questions asked by web developers. In Proceedings of the 11th Working Conference on Mining Software Repositories. ACM, 112--121.

Digital Library

[2]

Anton Barua, Stephen W Thomas, and Ahmed E Hassan. 2014. What are developers talking about? an analysis of topics and trends in stack overflow. Empirical Software Engineering 19, 3 (2014), 619--654.

Digital Library

[3]

Kent Beck and Erich Gamma. 2000. Extreme programming explained: embrace change. addison-wesley professional.

[4]

David M Blei, Andrew Y Ng, and Michael I Jordan. 2003. Latent dirichlet allocation. Journal of machine Learning research 3, Jan (2003), 993--1022.

Digital Library

[5]

Jan Bosch. 2014. Continuous Software Engineering: An Introduction. Springer International Publishing, Cham, 3--13. https://doi.org/10.1007/978-3-319-11283-1_1

[6]

Necco Ceresani. 2016. The Periodic Table of DevOps Tools v.2 Is Here. https://blog.xebialabs.com/2016/06/14/periodic-table-devops-tools-v-2/

[7]

Tse-Hsun Chen, Stephen W Thomas, and Ahmed E Hassan. 2016. A survey on the use of topic models when mining software repositories. Empirical Software Engineering 21, 5 (2016), 1843--1919.

Digital Library

[8]

Daniela S Cruzes and Tore Dyba. 2011. Recommended steps for thematic synthesis in software engineering. In 2011 international symposium on empirical software engineering and measurement. IEEE, 275--284.

Digital Library

[9]

Brian Fitzgerald and Klaas-Jan Stol. 2014. Continuous software engineering and beyond: trends and challenges. In Proceedings of the 1st International Workshop on Rapid Continuous Software Engineering. ACM, 1--9.

Digital Library

[10]

Brian Fitzgerald and Klaas-Jan Stol. 2017. Continuous software engineering: A roadmap and agenda. Journal of Systems and Software 123 (2017), 176--189.

[11]

Thomas L. Griffiths and Mark Steyvers. 2004. Finding scientific topics. Proceedings of the National Academy of Sciences of the United States of America 101, SUPPL. 1 (2004), 5228--5235. https://doi.org/10.1073/pnas.0307752101

[12]

Jez Humble and David Farley. 2010. Continuous delivery: reliable software releases through build, test, and deployment automation. Pearson Education.

[13]

Carina Jacobi, Wouter Van Atteveldt, and Kasper Welbers. 2016. Quantitative analysis of large amounts of journalistic texts using topic modelling. Digital Journalism 4, 1 (2016), 89--106. https://doi.org/10.1080/21670811.2015.1093271

[14]

Eero Laukkanen, Juha Itkonen, and Casper Lassenius. 2017. Problems, causes and solutions when adopting continuous delivery---A systematic literature review. Information and Software Technology 82 (2017), 55--79. https://doi.org/10.1016/j.infsof.2016.10.001

[15]

Leonardo Leite, Carla Rocha, Fabio Kon, Dejan Milojicic, and Paulo Meirelles. 2019. A Survey of DevOps Concepts and Challenges. ACM Comput. Surv. 52, 6, Article 127 (Nov. 2019), 35 pages. https://doi.org/10.1145/3359981

Digital Library

[16]

Lucy Ellen Lwakatare, Terhi Kilamo, Teemu Karvonen, Tanja Sauvola, Ville Heikkilä, Juha Itkonen, Pasi Kuvaja, Tommi Mikkonen, Markku Oivo, and Casper Lassenius. 2019. DevOps in practice: A multiple case study of five companies. Information and Software Technology 114 (2019), 217--230. https://doi.org/10.1016/j.infsof.2019.06.010

Digital Library

[17]

Andrew Kachites McCallum. 2002. MALLET: A Machine Learning for Language Toolkit. http://mallet.cs.umass.edu

[18]

David Mimno, Hanna M. Wallach, Edmund Talley, Miriam Leenders, and Andrew McCallum. 2011. Optimizing semantic coherence in topic models. EMNLP 2011 - Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference 2 (2011), 262--272.

[19]

Gustavo Pinto, Fernando Castor, and Yu David Liu. 2014. Mining questions about software energy consumption. In Proceedings of the 11th Working Conference on Mining Software Repositories. ACM, 22--31.

Digital Library

[20]

Micheal F Porter. 2001. Snowball: A language for stemming algorithms. http://snowball.tartarus.org/texts/introduction.html

[21]

Pilar Rodríguez, Alireza Haghighatkhah, Lucy Ellen Lwakatare, Susanna Teppola, Tanja Suomalainen, Juho Eskeli, Teemu Karvonen, Pasi Kuvaja, June M. Verner, and Markku Oivo. 2017. Continuous deployment of software intensive products and services: A systematic mapping study. Journal of Systems and Software 123 (2017), 263--291. https://doi.org/10.1016/j.jss.2015.12.015

[22]

Christoffer Rosen and Emad Shihab. 2016. What are mobile developers asking about? a large scale study using stack overflow. Empirical Software Engineering 21, 3 (2016), 1192--1223.

Digital Library

[23]

Alexandra Schofield and David Mimno. 2016. Comparing Apples to Apple: The Effects of Stemmers on Topic Models. Transactions of the Association for Computational Linguistics 4 (2016), 287--300. https://doi.org/10.1162/tacl_a_00099

[24]

Mojtaba Shahin, Muhammad Ali Babar, Mansooreh Zahedi, and Liming Zhu. 2017. Beyond Continuous Delivery: An Empirical Investigation of Continuous Deployment Challenges. International Symposium on Empirical Software Engineering and Measurement 2017-November (2017), 111--120. https://doi.org/10.1109/ESEM.2017.18

Digital Library

[25]

Mojtaba Shahin, Muhammad Ali Babar, and Liming Zhu. 2017. Continuous integration, delivery and deployment: a systematic review on approaches, tools, challenges and practices. IEEE Access 5 (2017), 3909--3943.

[26]

Julia Silge and David Robinson. 2017. Text Mining with R: A Tidy Approach. O'Reilly Media.

[27]

Christoph Treude, Ohad Barzilay, and Margaret Anne Storey. 2011. How do programmers ask and answer questions on the web? (NIER track). Proceedings - International Conference on Software Engineering (2011), 804--807. https://doi.org/10.1145/1985793.1985907

Digital Library

[28]

Xin-Li Yang, David Lo, Xin Xia, Zhi-Yuan Wan, and Jian-Ling Sun. 2016. What security questions do developers ask? a large-scale study of stack overflow posts. Journal of Computer Science and Technology 31, 5 (2016), 910--924.

[29]

Jie Zou, Ling Xu, Mengning Yang, Xiaohong Zhang, and Dan Yang. 2017. Towards comprehending the non-functional requirements through Developers' eyes: An exploration of Stack Overflow using topic analysis. Information and Software Technology 84 (2017), 19--32.

Digital Library

Cited By

Morovati MTambon FTaraghi MNikanjam AKhomh F(2024)Common challenges of deep reinforcement learning applications development: an empirical studyEmpirical Software Engineering10.1007/s10664-024-10500-529:4Online publication date: 14-Jun-2024
https://doi.org/10.1007/s10664-024-10500-5
Georgiou KCharmanas KPapageorgiadis KMittas NChristidis GAngelis L(2023)A data-driven framework for knowledge exchange analysis of development issues in medical applications: A case study of COVID-192023 49th Euromicro Conference on Software Engineering and Advanced Applications (SEAA)10.1109/SEAA60479.2023.00065(386-393)Online publication date: 6-Sep-2023
https://doi.org/10.1109/SEAA60479.2023.00065
Al Shoaibi DMkaouer M(2023)Understanding Software Performance Challenges an Empirical Study on Stack Overflow2023 International Conference on Code Quality (ICCQ)10.1109/ICCQ57276.2023.10114662(1-15)Online publication date: 22-Apr-2023
https://doi.org/10.1109/ICCQ57276.2023.10114662
Show More Cited By

Index Terms

Mining Questions Asked about Continuous Software Engineering: A Case Study of Stack Overflow
1. General and reference
  1. Cross-computing tools and techniques
    1. Empirical studies
2. Software and its engineering
  1. Software creation and management
    1. Software development process management

Recommendations

Continuous deployment in software-intensive system-of-systems
Abstract Context:
While continuous deployment is popular among web-based software development organizations, adopting continuous deployment in software-intensive system-of-systems is more challenging. On top of the challenges arising ...
Highlights
- New software field testing and validation activities become continuous.
- ...
A case analysis of enabling continuous software deployment through knowledge management

Continuous software engineering aims to accelerate software development by automating the whole software development process. Knowledge management is a cornerstone for continuous integration between software development and its operational deployment, ...
Practitioners' eye on continuous software engineering: an interview study
ICSSP '18: Proceedings of the 2018 International Conference on Software and System Process

Continuous software engineering (CSE) emerged as a process that is increasingly applied by practitioners. However, different perceptions of CSE among practitioners might impede its adoption in industry. We aim to support practitioners by giving a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

EASE '20: Proceedings of the 24th International Conference on Evaluation and Assessment in Software Engineering

April 2020

544 pages

ISBN:9781450377317

DOI:10.1145/3383219

General Chairs:
Jingyue Li
Norwegian University of Science and Technology, Norway
,
Letizia Jaccheri
Norwegian University of Science and Technology, Norway
,
Program Chairs:
Torgeir Dingsøyr
SINTEF Digital and Norwegian University of Science and Technology, Norway
,
Ruzanna Chitchyan
University of Bristol, UK

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

NTNU: Norwegian University of Science and Technology

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 April 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

EASE '20

EASE '20: Evaluation and Assessment in Software Engineering

April 15 - 17, 2020

Trondheim, Norway

Acceptance Rates

Overall Acceptance Rate 71 of 232 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
621
Total Downloads

Downloads (Last 12 months)57
Downloads (Last 6 weeks)5

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Morovati MTambon FTaraghi MNikanjam AKhomh F(2024)Common challenges of deep reinforcement learning applications development: an empirical studyEmpirical Software Engineering10.1007/s10664-024-10500-529:4Online publication date: 14-Jun-2024
https://doi.org/10.1007/s10664-024-10500-5
Georgiou KCharmanas KPapageorgiadis KMittas NChristidis GAngelis L(2023)A data-driven framework for knowledge exchange analysis of development issues in medical applications: A case study of COVID-192023 49th Euromicro Conference on Software Engineering and Advanced Applications (SEAA)10.1109/SEAA60479.2023.00065(386-393)Online publication date: 6-Sep-2023
https://doi.org/10.1109/SEAA60479.2023.00065
Al Shoaibi DMkaouer M(2023)Understanding Software Performance Challenges an Empirical Study on Stack Overflow2023 International Conference on Code Quality (ICCQ)10.1109/ICCQ57276.2023.10114662(1-15)Online publication date: 22-Apr-2023
https://doi.org/10.1109/ICCQ57276.2023.10114662
Tanzil MSarker MUddin GIqbal A(2023)A mixed method study of DevOps challengesInformation and Software Technology10.1016/j.infsof.2023.107244161(107244)Online publication date: Sep-2023
https://doi.org/10.1016/j.infsof.2023.107244
Khan HAfsar WNazir SNoor AKundi MMaashi MAlshahrani H(2023)Revolutionizing software developmental processes by utilizing continuous software approachesThe Journal of Supercomputing10.1007/s11227-023-05818-880:7(9579-9608)Online publication date: 12-Dec-2023
https://doi.org/10.1007/s11227-023-05818-8
Lombardi FFanton A(2023)From DevOps to DevSecOps is not enough. CyberDevOps: an extreme shifting-left architecture to bring cybersecurity within software security lifecycle pipelineSoftware Quality Journal10.1007/s11219-023-09619-331:2(619-654)Online publication date: 26-Apr-2023
https://doi.org/10.1007/s11219-023-09619-3
Khan AKhan JAkbar MZhou PFahmideh M(2023)Insights into software development approaches: mining Q &A repositoriesEmpirical Software Engineering10.1007/s10664-023-10417-529:1Online publication date: 23-Nov-2023
https://doi.org/10.1007/s10664-023-10417-5
Papageorgiadis KGeorgiou KCharmanas KMittas NAngelis L(2022)COVID-Vis: Visualizing knowledge exchange on scientific software development in the COVID-19 eraProceedings of the 26th Pan-Hellenic Conference on Informatics10.1145/3575879.3576019(367-372)Online publication date: 25-Nov-2022
https://dl.acm.org/doi/10.1145/3575879.3576019
Rajapakse RZahedi MBabar MShen H(2022)Challenges and solutions when adopting DevSecOpsInformation and Software Technology10.1016/j.infsof.2021.106700141:COnline publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1016/j.infsof.2021.106700
Luo YLiang PWang CShahin MZhan JLanubile F(2021)Characteristics and Challenges of Low-Code DevelopmentProceedings of the 15th ACM / IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)10.1145/3475716.3475782(1-11)Online publication date: 11-Oct-2021
https://dl.acm.org/doi/10.1145/3475716.3475782
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents