research-article

Optimizing the performance of optimization in the cloud environment–An intelligent auto-scaling approach

Authors:

Visnja Simic,

Boban Stojanovic,

Milos IvanovicAuthors Info & Claims

Volume 101, Issue C

Pages 909 - 920

https://doi.org/10.1016/j.future.2019.07.042

Published: 01 December 2019 Publication History

Abstract

The cloud computing paradigm has gained wide acceptance in the scientific community, taking a significant share from fields previously reserved exclusively for High Performance Computing (HPC). On-demand access to a large amount of computing resources provided by Cloud makes it ideal for executing large-scale optimizations using evolutionary algorithms without the need for owning any computing infrastructure. In this regard, we extended WoBinGO, an existing parallel software framework for genetic algorithm based optimization, to be used in Cloud. With these extensions, the framework is capable of elastically and frugally utilizing the underlying cloud computing infrastructure for performing computationally expensive fitness evaluations.

We studied two issues that are pertinent when dealing with large-scale optimization in the elastic cloud environment: the computing instance launching overhead and the price of engaging Cloud for solving optimization problems, in terms of the instances’ cumulative uptime. To explain the usability limits of WoBinGO framework running in the IaaS environment, a comprehensive analysis of the framework’s performance was given.

Optimization of both total optimization time and total cumulative uptime, leads to minimizing the cost of cloud resources utilization. In this way, we are proposing an intelligent decision support engine based on artificial neural networks and metaheuristics to provide the user with an assessment of the framework’s behavior on the underlying infrastructure in terms of optimization duration and the cost of resource consumption. According to a given assessment, the user can decide upon faster delivery of results or lower infrastructure costs.

The proposed software framework has been used to solve a complex real-world optimization problem of a subsurface rock mass model calibration. The results obtained from the private OpenStack deployment show that by using the proposed decision support engine, significant savings can be achieved in both optimization time and optimization cost.

Highlights

•

A software framework for large-scale optimization using parallel GA over cloud resources.

•

Auto-scaling in the application layer for user QoS including cost and performance.

•

ML surrogate model for predicting a delivery time and an execution cost.

•

An intelligent decision support engine optimizes cost/performance ratio.

•

Recommends optimal VM instance’s parameters for the best efficiency.

References

[1]

Keahey K., Raicu I., Chard K., Nicolae B., Guest editors introduction: Special issue on scientific cloud computing, IEEE Trans. Cloud Comput. 4 (1) (2016) 4–5.

Abstract

Highlights

References

Cited By

Index Terms

Recommendations

Efficient evolutionary optimization using predictive auto-scaling in containerized environment

Efficient resource allocation for optimizing objectives of cloud users, IaaS provider and SaaS provider in cloud environment

Cloud Resource Demand Prediction using Machine Learning in the Context of QoS Parameters

Comments

Information

Published In

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations