More Web Proxy on the site http://driver.im/

research-article

Application Performance Management: State of the Art and Challenges for the Future

Authors:

Christoph Heger,

André van Hoorn,

Dušan OkanovićAuthors Info & Claims

ICPE '17: Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering

Pages 429 - 432

https://doi.org/10.1145/3030207.3053674

Published: 17 April 2017 Publication History

Abstract

The performance of application systems has a direct impact on business metrics. For example, companies lose customers and revenue in case of poor performance such as high response times. Application performance management (APM) aims to provide the required processes and tools to have a continuous and up-to-date picture of relevant performance measures during operations, as well as to support the detection and resolution of performance-related incidents.

In this tutorial paper, we provide an overview of the state of the art in APM in industrial practice and academic research, highlight current challenges, and outline future research directions.

References

[1]

OpenTracing: A vendor-neutral open standard for distributed tracing. http://opentracing.io/, 2016.

[2]

T. M. Ahmed, C.-P. Bezemer, T.-H. Chen, A. E. Hassan, and W. Shang. Studying the effectiveness of application performance management (APM) tools for detecting performance regressions for web applications: An experience report. In Proc. 13th Int. Conf. on Mining Software Repositories (MSR'16), pages 1--12, 2016.

Digital Library

[3]

G. Ammons, T. Ball, and J. R. Larus. Exploiting hardware performance counters with flow and context sensitive profiling. In Proc. ACM SIGPLAN'97 Conf. on Programming Language Design and Implementation (PLDI'97), pages 85--96, 1997.

Digital Library

[4]

B. Cutler. Firefox and page load speed (part I). https://blog.mozilla.org/metrics/2010/03/31/firefox-page-load-speed-part-i/, 2010.

[5]

C. Haight and F. D. Silva. Gartner's magic quadrant for application performance monitoring suites, 2016.

[6]

C. Heger, A. van Hoorn, D. Okanović, S. Siegl, and A. Wert. Expert-guided automatic diagnosis of performance problems in enterprise applications. In Proc. 12th Europ. Dependable Computing Conf. (EDCC'16). IEEE, 2016.

[7]

Y. Kouki and T. Ledoux. CSLA: A Language for improving Cloud SLA Management. In Proc. Int. Conf. on Cloud Computing and Services Science (CLOSER 2012), pages 586--591, 2012.

[8]

J. Liddle. Amazon Found Every 100ms of Latency Cost Them 1% in sales. http://blog.gigaspaces.com/amazon-found-every-100ms-of-latency-cost-them-1-in-sales/, 2008.

[9]

G. Linden. Marissa Mayer at Web 2.0. http://glinden.blogspot.de/2006/11/marissa-mayer-at-web-20.html, 2006.

[10]

T. Lorido-Botran, J. Miguel-Alonso, and J. A. Lozano. A review of auto-scaling techniques for elastic applications in cloud environments. Journal of Grid Computing, 12(4):559--592, 2014.

Digital Library

[11]

D. Okanovic, A. van Hoorn, C. Heger, A. Wert, and S. Siegl. Towards performance tooling interoperability: An open format for representing execution traces. In Proc. 13th Europ. Workshop on Computer Performance Engineering EPEW'16, pages 94--108, 2016.

[12]

T. Parsons and J. Murphy. Detecting performance antipatterns in component based enterprise systems. Journal of Object Technology, 7(3):55--91, 2008.

[13]

T. Pitakrat, D. Okanovic, A. van Hoorn, and L. Grunske. An architecture-aware approach to hierarchical online failure prediction. In 12th Int. ACM SIGSOFT Conf. on Quality of Soft. Architectures, pages 60--69, 2016.

[14]

T. Rabl, S. Gómez-Villamor, M. Sadoghi, V. Muntés-Mulero, H.-A. Jacobsen, and S. Mankovskii. Solving big data challenges for enterprise application performance management. Proc. VLDB Endow., 5(12):1724--1735, 2012.

Digital Library

[15]

C. U. Smith and L. G. Williams. Software performance antipatterns. In Proc. 2nd Int. Workshop on Software and Performance (WOSP '00), pages 127--136, 2000.

Digital Library

[16]

A. van Hoorn and S. Siegl. Application performance management (APM): Continuous monitoring of application performance (OBJEKTspektrum poster, in german). https://www.sigs-datacom.de/wissen/fachposter/.

[17]

A. van Hoorn, J. Waller, and W. Hasselbring. Kieker: A framework for application perfo'12), pages 247--248, 2012.

Digital Library

[18]

J. Walter, A. van Hoorn, H. Koziolek, D. Okanovic, and S. Kounev. Asking "what"?, automating the "how"?: The vision of declarative performance engineering. In Proc. 7th ACM/SPEC on Int. Conf. on Perf. Eng., ICPE'16, pages 91--94, 2016.

Digital Library

Cited By

Sarda KNamrud ZRouf RAhuja HRasolroveicy MLitoiu MShwartz LWatts IOnut IShirani POnut IOnut IBranco P(2023)ADARMA Auto-Detection and Auto-Remediation of Microservice Anomalies by Leveraging Large Language ModelsProceedings of the 33rd Annual International Conference on Computer Science and Software Engineering10.5555/3615924.3615949(200-205)Online publication date: 11-Sep-2023
https://dl.acm.org/doi/10.5555/3615924.3615949
Frank SBrott JKesim DHolz HEschhold Mvan Hoorn AVieira MCardellini VDi Marco ATuma P(2023)dqualizer: Domain-Centric Runtime Quality Analysis of Business-Critical Application SystemsCompanion of the 2023 ACM/SPEC International Conference on Performance Engineering10.1145/3578245.3584853(397-404)Online publication date: 15-Apr-2023
https://dl.acm.org/doi/10.1145/3578245.3584853
Steen RHaug OPatriarca R(2023)Business continuity and resilience management: A conceptual frameworkJournal of Contingencies and Crisis Management10.1111/1468-5973.1250132:1Online publication date: 5-Sep-2023
https://doi.org/10.1111/1468-5973.12501
Show More Cited By

Index Terms

Application Performance Management: State of the Art and Challenges for the Future
1. General and reference
  1. Cross-computing tools and techniques
    1. Metrics
2. Software and its engineering
  1. Software creation and management
    1. Software post-development issues
      1. Maintaining software
  2. Software organization and properties
    1. Extra-functional properties
      1. Software performance

Recommendations

Using Dynatrace Monitoring Data for Generating Performance Models of Java EE Applications
ICPE '15: Proceedings of the 6th ACM/SPEC International Conference on Performance Engineering

Performance models assist capacity management and planning for large-scale enterprise applications by predicting their performance for different workloads and hardware environments. Manually creating these models often outweighs their benefits. ...
Web Application Performance Modeling Using Layered Queueing Networks

In this paper, a Layered Queueing Network (LQN) performance model is used for studying an Apache-PHP web application with PostgreSQL backend-database. Performance evaluation is done by obtaining load test measurements and by solving the LQN model. Model ...
Software performance in the real world: personal lessons from the performance trauma team
WOSP '07: Proceedings of the 6th international workshop on Software and performance

In the nine years that we have been involved in software performance engineering (SPE) and performance testing engagements we have learned several things. Across numerous eCommerce applications and an enterprise CRM product suite, our knowledge base ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICPE '17: Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering

April 2017

450 pages

ISBN:9781450344043

DOI:10.1145/3030207

General Chairs:
Walter Binder
Università della Svizzera Italiana, Switzerland
,
Vittorio Cortellessa
Università dell'Aquila, Italy
,
Program Chairs:
Anne Koziolek
Karlsruhe Institute of Technology, Germany
,
Evgenia Smirni
College of William & Mary, USA
,
Meikel Poess
Oracle Corporation, USA

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMETRICS: ACM Special Interest Group on Measurement and Evaluation
SIGSOFT: ACM Special Interest Group on Software Engineering
SPEC: SPEC Research Group

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 April 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

German Federal Ministry of Education and Research

Conference

ICPE '17

Sponsor:

ICPE '17: ACM/SPEC International Conference on Performance Engineering

April 22 - 26, 2017

L'Aquila, Italy

Acceptance Rates

ICPE '17 Paper Acceptance Rate 27 of 83 submissions, 33%;

Overall Acceptance Rate 252 of 851 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
1,002
Total Downloads

Downloads (Last 12 months)109
Downloads (Last 6 weeks)10

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sarda KNamrud ZRouf RAhuja HRasolroveicy MLitoiu MShwartz LWatts IOnut IShirani POnut IOnut IBranco P(2023)ADARMA Auto-Detection and Auto-Remediation of Microservice Anomalies by Leveraging Large Language ModelsProceedings of the 33rd Annual International Conference on Computer Science and Software Engineering10.5555/3615924.3615949(200-205)Online publication date: 11-Sep-2023
https://dl.acm.org/doi/10.5555/3615924.3615949
Frank SBrott JKesim DHolz HEschhold Mvan Hoorn AVieira MCardellini VDi Marco ATuma P(2023)dqualizer: Domain-Centric Runtime Quality Analysis of Business-Critical Application SystemsCompanion of the 2023 ACM/SPEC International Conference on Performance Engineering10.1145/3578245.3584853(397-404)Online publication date: 15-Apr-2023
https://dl.acm.org/doi/10.1145/3578245.3584853
Steen RHaug OPatriarca R(2023)Business continuity and resilience management: A conceptual frameworkJournal of Contingencies and Crisis Management10.1111/1468-5973.1250132:1Online publication date: 5-Sep-2023
https://doi.org/10.1111/1468-5973.12501
Avritzer ACamilli MJanes ARusso BTrubiani Cvan Hoorn A(2023)Continuous Dependability Assessment of Microservice SystemsSoftware Architecture. ECSA 2022 Tracks and Workshops10.1007/978-3-031-36889-9_11(138-147)Online publication date: 16-Jul-2023
https://doi.org/10.1007/978-3-031-36889-9_11
Beck SFrank SHakamian Avan Hoorn AFeng DBecker SHerbst NLeitner P(2022)How is Transient Behavior Addressed in Practice?Companion of the 2022 ACM/SPEC International Conference on Performance Engineering10.1145/3491204.3527483(105-112)Online publication date: 14-Jul-2022
https://dl.acm.org/doi/10.1145/3491204.3527483
Tang YWang HZhan XLuo XZhou YZhou HYan QSui YKeung J(2022)A Systematical Study on Application Performance Management Libraries for AppsIEEE Transactions on Software Engineering10.1109/TSE.2021.307765448:8(3044-3065)Online publication date: 1-Aug-2022
https://doi.org/10.1109/TSE.2021.3077654
Maulana FFakhrurroja HLubis M(2022)Business Process Management and Service-Oriented Architecture Implementation for Root Cause Identification on Monitoring Tools at XYZ Company2022 2nd International Conference on Electronic and Electrical Engineering and Intelligent System (ICE3IS)10.1109/ICE3IS56585.2022.10010076(316-321)Online publication date: 4-Nov-2022
https://doi.org/10.1109/ICE3IS56585.2022.10010076
Avritzer ABritto RTrubiani CCamilli MJanes ARusso Bvan Hoorn AHeinrich RRapp MHenß JChalawadi R(2022)Scalability testing automation using multivariate characterization and detection of software performance antipatternsJournal of Systems and Software10.1016/j.jss.2022.111446(111446)Online publication date: Jul-2022
https://doi.org/10.1016/j.jss.2022.111446
Ehrensperger RSauerwein CBreu R(2021)Rethinking Information Technology Governance for Digital Business Ecosystems2021 IEEE 25th International Enterprise Distributed Object Computing Conference (EDOC)10.1109/EDOC52215.2021.00011(1-10)Online publication date: Oct-2021
https://doi.org/10.1109/EDOC52215.2021.00011
Cabrera OOriol MFranch XMarco J(2021)A context-aware monitoring architecture for supporting system adaptation and reconfigurationComputing10.1007/s00607-021-00923-zOnline publication date: 1-Mar-2021
https://doi.org/10.1007/s00607-021-00923-z
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents