More Web Proxy on the site http://driver.im/

research-article

Continuous A/B Testing in Containers

Authors:

Ádám Révész,

Norbert PatakiAuthors Info & Claims

ICGDA '19: Proceedings of the 2019 2nd International Conference on Geoinformatics and Data Analysis

Pages 11 - 14

https://doi.org/10.1145/3318236.3318254

Published: 15 March 2019 Publication History

Abstract

Software version ranking plays an important role in improved user experience and software quality. A/B testing is a technique to distinguish between the popularity and usability of two quite similar versions (A and B) of a product, marketing strategy, search ad, etc. It is a kind of two-sample hypothesis testing, used in the field of statistics. This controlled experiment can evaluate user engagement or satisfaction with a new service, feature, or product. A/B testing is typically used in evaluation of user-experience design in software technology. DevOps is an emerging software methodology in which the development and operations are not independent processes, they affect each other. DevOps emphasizes the usage of virtualization technologies (e.g. containers). Docker is widely-used technology for containerization. In this paper, we deal with a new approach for regular A/B testing via Docker containers. Our solution provides an API that can be available from many DevOps tools. This approach is DevOps-style A/B testing because after the evaluation the better version remains in production.

References

[1]

Y. Xu, N. Chen, A. Fernandez, O. Sinno, and A. Bhasin,"From Infrastructure to Culture: A/B Testing Challenges in Large Scale Social Networks," Proc. of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2015, pp. 2227--2236.

Digital Library

[2]

M. Storey, C. Treude, A. van Deursen, and L. Cheng, "The Impact of Social Media on Software Engineering Practices and Tools," Proc. of the FSE/SDP Workshop on Future of Software Engineering Research, 2010, pp. 359--364.

Digital Library

[3]

R. Kohavi, R. Longbotham, D. Sommerfield, and R. M. Henne, "Controlled experiments on the web: survey and practical guide," Data Mining and Knowledge Discovery Vol. 18, 1, 2009, pp. 140--181.

Digital Library

[4]

S. Soltesz, H. Pötzl, M. E. Fiuczynski, A. Bavier, and L. Peterson, "Container-based Operating System Virtualization: A Scalable, High-performance Alternative to Hypervisors," SIGOPS Oper. Syst. Rev. Vol. 41, 3, 2007, pp. 275--287.

Digital Library

[5]

D. Bernstein, "Containers and Cloud: From LXC to Docker to Kubernetes," IEEE Cloud Computing, Vol. 1, 3, 2014, pp. 81--84.

[6]

D. Merkel, "Lightweight Linux Containers for Consistent Development and Deployment", Linux Journal, 239, 2014.

Digital Library

[7]

D. Vohra, "Using an HA Master with OpenShift", Kubernetes Management Design Patterns, 2017, pp. 335--353.

[8]

A. Schaefer, M. Reichenbach, and D. Fey,"Continuous Integration and Automation for DevOps," IAENG Transactions on Engineering Technologies: Special Editionof the World Congress on Engineering and Computer Science, 2011, pp. 345--358.

[9]

J. Roche, "Adopting DevOps Practices in Quality Assurance." Commun. ACM 56, 11., 2013, pp. 38--43.

Digital Library

[10]

D. Cukier, "DevOps Patterns to Scale Web Applications Using Cloud Services," Proc. of the 2013 Companion Publication for Conference on Systems, Programming, & Applications: Software for Humanity (Indianapolis, Indiana, USA), SPLASH'13. ACM, New York, NY, 2013, pp. 143--152.

Digital Library

[11]

L. E. Lwakatare, P. Kuvaja, and M. Oivo, "Dimensions of DevOps," Proc. of Agile Processes in Software Engineering and Extreme Programming: 16th International Conference (Helsinki, Finland, May 25-29, 2015), 2015, pp. 212--217.

[12]

Á. Révész, and N. Pataki, "Containerized A/B Testing," Proc. of the Sixth Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications (Belgrade, Serbia, September 11-13, 2017) SQAMIA'17, 2017, pp. 14(1)-14(8).

[13]

T. Prakash, M. Kakkar, and K. Patel, "Geo-identification of web users through logs using ELK stack," Proc. of 6th International Conference -- Cloud System and Big Data Engineering, 2016, pp. 606--610.

[14]

T. Oberle, and Cs. Szabó, "An Architectural Prototype for Testware as a Service," Proc. of 2015 IEEE 13th International Symposium on Applied Machine Intelligence and Informatics (SAMI), 2015, pp. 15--19

[15]

S. Dastgheib, T. Whetzel, A. Zaveri, C. Afrasiabi, P. Assis, P. Avillach, K. Jagodnik, G. Korodi, M. Pilarczyk, J. de Pons, S. Schrer, R. Terryn, R. Verborgh, C. Wu, C., and M. Dumontier, "The SmartAPI Ecosystem for Making Web APIs FAIR", Proc. of the ISWC 2017 Posters & Demonstrations and Industry Tracks co-located with 16th International Semantic Web Conference, 2017.

[16]

Á. Révész, and N. Pataki, "Integration Heaven of Nanoservices," Proc. of the 21th International Multi-Conference INFORMATION SOCIETY IS'2018, Volume G: Collaboration, Software and Services in Information Society, 2018, pp. 43--46.

Cited By

Rafi SAkbar MYu WAlsanad AGumaei ASarwar M(2022)Exploration of DevOps testing process capabilitiesApplied Soft Computing10.1016/j.asoc.2021.108377116:COnline publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1016/j.asoc.2021.108377
Révész ÁPataki N(2022)A/B Testing via Continuous Integration and Continuous DeliveryGeoinformatics and Data Analysis10.1007/978-3-031-08017-3_15(165-174)Online publication date: 10-Jun-2022
https://doi.org/10.1007/978-3-031-08017-3_15
Koskinen MMikkonen TAbrahamsson P(2019)Containers in Software Development: A Systematic Mapping StudyProduct-Focused Software Process Improvement10.1007/978-3-030-35333-9_13(176-191)Online publication date: 18-Nov-2019
https://doi.org/10.1007/978-3-030-35333-9_13

Index Terms

Continuous A/B Testing in Containers
1. Software and its engineering
  1. Software creation and management
    1. Designing software
      1. Software design engineering
  2. Software notations and tools
    1. Software configuration management and version control systems

Recommendations

Network Quality of Service in Docker Containers
CLUSTER '15: Proceedings of the 2015 IEEE International Conference on Cluster Computing

This poster presents an extension to the currently limited Docker's networks. Specifically, to guarantee quality of service (QoS) on the network, our extension allows users to assign priorities to Docker's containers and configures the network to ...
A Systematic Literature Review on Maintenance of Software Containers
Nowadays, cloud computing is gaining tremendous attention to deliver information via the internet. Virtualization plays a major role in cloud computing as it deploys multiple virtual machines on the same physical machine and thus results in improving ...
Patterns of software development with containers
PLoP '18: Proceedings of the 25th Conference on Pattern Languages of Programs

This pattern language is concerned with the problems inherent in building and delivering software using containers, particularly those issues that arise during the process of mapping Docker images and containers into the stages of a software development ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICGDA '19: Proceedings of the 2019 2nd International Conference on Geoinformatics and Data Analysis

March 2019

156 pages

ISBN:9781450362450

DOI:10.1145/3318236

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Department of Informatics, University of Oslo

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 March 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICGDA 2019

ICGDA 2019: 2019 2nd International Conference on Geoinformatics and Data Analysis & 2019 2nd International Conference on Software and Services Engineering

March 15 - 17, 2019

Prague, Czech Republic

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
252
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rafi SAkbar MYu WAlsanad AGumaei ASarwar M(2022)Exploration of DevOps testing process capabilitiesApplied Soft Computing10.1016/j.asoc.2021.108377116:COnline publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1016/j.asoc.2021.108377
Révész ÁPataki N(2022)A/B Testing via Continuous Integration and Continuous DeliveryGeoinformatics and Data Analysis10.1007/978-3-031-08017-3_15(165-174)Online publication date: 10-Jun-2022
https://doi.org/10.1007/978-3-031-08017-3_15
Koskinen MMikkonen TAbrahamsson P(2019)Containers in Software Development: A Systematic Mapping StudyProduct-Focused Software Process Improvement10.1007/978-3-030-35333-9_13(176-191)Online publication date: 18-Nov-2019
https://doi.org/10.1007/978-3-030-35333-9_13

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents