More Web Proxy on the site http://driver.im/

research-article

A DevOps approach to integration of software components in an EU research project

Authors:

Mark Stillwell,

Jose G. F. CoutinhoAuthors Info & Claims

QUDOS 2015: Proceedings of the 1st International Workshop on Quality-Aware DevOps

Pages 1 - 6

https://doi.org/10.1145/2804371.2804372

Published: 01 September 2015 Publication History

Abstract

We present a description of the development and deployment infrastructure being created to support the integration effort of HARNESS, an EU FP7 project. HARNESS is a multi-partner research project intended to bring the power of heterogeneous resources to the cloud. It consists of a number of different services and technologies that interact with the OpenStack cloud computing platform at various levels. Many of these components are being developed independently by different teams at different locations across Europe, and keeping the work fully integrated is a challenge. We use a combination of Vagrant based virtual machines, Docker containers, and Ansible playbooks to provide a consistent and up-to-date environment to each developer. The same playbooks used to configure local virtual machines are also used to manage a static testbed with heterogeneous compute and storage devices, and to automate ephemeral larger-scale deployments to Grid'5000. Access to internal projects is managed by GitLab, and automated testing of services within Docker-based environments and integrated deployments within virtual-machines is provided by Buildbot.

References

[1]

Ansible: DevOps made simple. http://ansible.com.

[2]

Buildbot: The continuous integration framework. http://buildbot.net.

[3]

Chef: Automation for web-scale IT. http://chef.io.

[4]

ConPaaS Project. http://www.conpaas.eu/.

[5]

Docker. http://docker.io.

[6]

European grid infrastructure federated cloud. http://www.egi.eu/infrastructure/cloud/.

[7]

FP7 HARNESS project. http://www.harness-project.eu/.

[8]

Jenkins: An extensible open source continuous integration server. http://jenkins-ci.org.

[9]

Maxeler Technologies. http://www.maxeler.com.

[10]

OpenStack: Open source software for creating private and public clouds. http://openstack.org.

[11]

Puppet Labs. http://puppetlabs.com.

[12]

SaltStack. http://saltstack.com.

[13]

Vagrant: Development environments made easy. http://vagrantup.com.

[14]

European Commission: Software technologies, the missing key enabling technology, 2012. http://cordis.europa.eu/ fp7/ict/docs/istag-soft-tech-wgreport2012.pdf.

[15]

EPSRC: Software as an infrastructure, 2015. https://www.epsrc.ac.uk/newsevents/pubs/ software-as-an-infrastructure/.

[16]

D. Balouek et al. Adding Virtualization Capabilities to the Grid’5000 Testbed. In Cloud Computing and Services Science, volume 367, pages 3–20. 2013.

[17]

A. Bubeck et al. Implementing Best Practices for Systems Integration and Distributed Software Development in Service Robotics. In IEEE/SICE Inter. Symp. on System Integration (SII), pages 609–614, Dec 2012.

[18]

M. Fowler. Microservices. http: //martinfowler.com/articles/microservices.html.

[19]

D. Groen et al. Software Development Practices in Academia: A Case Study Comparison. CoRR, abs/1506.05272, 2015.

[20]

R. Harrison. How to avoid Puppet dependency nightmares with defines. http://www.webcitation.org/6a1doDLla.

[21]

E. O’Neill et al. Cross resource optimisation of database functionality across heterogeneous processors. In Proc. IEEE on Parallel and Dist. Processing with Applications, 2014.

Digital Library

[22]

O. Pell et al. Maximum Performance Computing with Dataflow Engines. In High-Performance Computing Using FPGAs, pages 747–774. Springer, 2013.

[23]

F. Schintke. XtreemFS & Scalaris. Science & Technology, (6):54 –& Technology, (6):54 –– 55, 2013.

[24]

M. G. Xavier et al. Performance Evaluation of Container-based Virtualization for High Performance Computing Environments. In Proc. of Euromicro Inter. Conf. on Parallel, Distributed and Network-Based Processing (PDP), pages 233–240, 2013.

Digital Library

Cited By

Pando BSilva ADávila A(2024)DevOps Adoption: A Tertiary StudyNew Perspectives in Software Engineering10.1007/978-3-031-50590-4_3(39-52)Online publication date: 21-Feb-2024
https://doi.org/10.1007/978-3-031-50590-4_3
Amaro RPereira Rda Silva M(2023)Capabilities and Practices in DevOps: A Multivocal Literature ReviewIEEE Transactions on Software Engineering10.1109/TSE.2022.316662649:2(883-901)Online publication date: 1-Feb-2023
https://doi.org/10.1109/TSE.2022.3166626
Ilin D(2022)Framework for experimental evaluation of software solutions in a virtual environmentRussian Technological Journal10.32362/2500-316X-2022-10-5-16-2710:5(16-27)Online publication date: 20-Oct-2022
https://doi.org/10.32362/2500-316X-2022-10-5-16-27
Show More Cited By

Index Terms

A DevOps approach to integration of software components in an EU research project
1. Social and professional topics
  1. Professional topics
    1. Management of computing and information systems
      1. Project and people management
      2. Software management
        Software maintenance
2. Software and its engineering
  1. Software creation and management
  2. Software notations and tools
    1. Software configuration management and version control systems

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

QUDOS 2015: Proceedings of the 1st International Workshop on Quality-Aware DevOps

September 2015

32 pages

ISBN:9781450338172

DOI:10.1145/2804371

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

EU FP7

Conference

ESEC/FSE'15

Sponsor:

SIGSOFT

ESEC/FSE'15: Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering

September 1, 2015

Bergamo, Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
921
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Pando BSilva ADávila A(2024)DevOps Adoption: A Tertiary StudyNew Perspectives in Software Engineering10.1007/978-3-031-50590-4_3(39-52)Online publication date: 21-Feb-2024
https://doi.org/10.1007/978-3-031-50590-4_3
Amaro RPereira Rda Silva M(2023)Capabilities and Practices in DevOps: A Multivocal Literature ReviewIEEE Transactions on Software Engineering10.1109/TSE.2022.316662649:2(883-901)Online publication date: 1-Feb-2023
https://doi.org/10.1109/TSE.2022.3166626
Ilin D(2022)Framework for experimental evaluation of software solutions in a virtual environmentRussian Technological Journal10.32362/2500-316X-2022-10-5-16-2710:5(16-27)Online publication date: 20-Oct-2022
https://doi.org/10.32362/2500-316X-2022-10-5-16-27
Pando BDávila A(2022)Software Testing in the DevOps Context: A Systematic Mapping StudyProgramming and Computer Software10.1134/S036176882208017548:8(658-684)Online publication date: 21-Dec-2022
https://doi.org/10.1134/S0361768822080175
Morais FSoares NRibeiro RAlves MRocha PLima AMachado R(2022)An Interoperable Cloud Platform for the Garment IndustryIntelligent Systems and Applications10.1007/978-3-031-16075-2_32(457-477)Online publication date: 1-Sep-2022
https://doi.org/10.1007/978-3-031-16075-2_32
Gokarna MSingh R(2021)DevOps: A Historical Review and Future Works2021 International Conference on Computing, Communication, and Intelligent Systems (ICCCIS)10.1109/ICCCIS51004.2021.9397235(366-371)Online publication date: 19-Feb-2021
https://doi.org/10.1109/ICCCIS51004.2021.9397235
Ojo-Gonzalez KProsper-Heredia RDominguez-Quintero LVargas-Lombardo M(2021)A Model DevOps Framework for SaaS in the CloudAdvances and Applications in Computer Science, Electronics and Industrial Engineering10.1007/978-981-33-4565-2_3(37-51)Online publication date: 20-Mar-2021
https://doi.org/10.1007/978-981-33-4565-2_3
Srivastava AMehrotra DKapur PAggarwal A(2021)A Literature Review of Critical Success Factors in Agile Testing Method of Software DevelopmentRecent Innovations in Computing10.1007/978-981-15-8297-4_69(859-870)Online publication date: 13-Jan-2021
https://doi.org/10.1007/978-981-15-8297-4_69
Waseem MLiang PShahin M(2020)A Systematic Mapping Study on Microservices Architecture in DevOpsJournal of Systems and Software10.1016/j.jss.2020.110798(110798)Online publication date: Aug-2020
https://doi.org/10.1016/j.jss.2020.110798
Abidi LAzzag HBenbernou SBentounsi MCérin CDuong TGarteiser PLebbah MOuziri MSahri SSmadja M(2019)A Big Data Platform for Enhancing Life Imaging ActivitiesUtilizing Big Data Paradigms for Business Intelligence10.4018/978-1-5225-4963-5.ch002(39-71)Online publication date: 2019
https://doi.org/10.4018/978-1-5225-4963-5.ch002
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten