keynote

Understanding and Improving Software Performance at MongoDB

Author:

David DalyAuthors Info & Claims

ICPE '23 Companion: Companion of the 2023 ACM/SPEC International Conference on Performance Engineering

Page 307

https://doi.org/10.1145/3578245.3584855

Published: 15 April 2023 Publication History

Get Access

Abstract

It is important for developers to understand the performance of a software project as they develop new features, fix bugs, and try to generally improve the product. At MongoDB we have invested in building a performance infrastructure to support our developers. The infrastructure automates the provisioning of systems under test, the running of performance tests against those systems, collecting many metrics from the tests and system under test, and making sense of all the results.

Our performance infrastructure and processes are continually changing. As the system has become more powerful we have used it more and more: adding new tests, new configurations, and new measurements. Tools and processes that work on one scale of use start to break down at higher scales and we must adapt and update. If we do a good job, we keep pace with the rising constraints. If we do a great job, we make the system fundamentally better even as we scale the system.

In this talk we describe our performance testing environment at MongoDB and its evolution over time. The core of our environment is a focus on automating everything, integrating into our continuous integration (CI) system (Evergreen), controlling as many factors as possible, and making everything as repeatable and consistent as possible. After describing that core, we will discuss the scaling challenges we have faced, before relating what we have done to address those scaling challenges and improve the system overall.

Index Terms

Understanding and Improving Software Performance at MongoDB
1. Information systems
  1. Data management systems
    1. Database administration
      1. Database performance evaluation
2. Software and its engineering
  1. Software creation and management
    1. Software development process management
      1. Software development methods
  2. Software organization and properties
    1. Extra-functional properties
      1. Software performance

Recommendations

Levelling up Performance and Performance Skills at MongoDB
ICPE '23 Companion: Companion of the 2023 ACM/SPEC International Conference on Performance Engineering

MongoDB has invested in developing a performance infrastructure and a corresponding performance culture. All development engineers are expected to improve MongoDB performance, through adding performance tests, optimizing code, and fixing performance ...
Creating a Virtuous Cycle in Performance Testing at MongoDB
ICPE '21: Proceedings of the ACM/SPEC International Conference on Performance Engineering

It is important to detect changes in software performance during development in order to avoid performance decreasing release to release or dealing with costly delays at release time. Performance testing is part of the development process at MongoDB, ...
Performance Engineering and Database Development at MongoDB
ICPE '21: Companion of the ACM/SPEC International Conference on Performance Engineering

Performance and the related properties of stability and resilience are essential to MongoDB. We have invested heavily in these areas: involving all development engineers in aspects of performance, building a team of specialized performance engineers to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ICPE '23 Companion: Companion of the 2023 ACM/SPEC International Conference on Performance Engineering

April 2023

421 pages

ISBN:9798400700729

DOI:10.1145/3578245

General Chairs:
Marco Vieira
University of Coimbra, Portugal
,
Valeria Cardellini
University of Rome Tor Vergata, Italy
,
Program Chairs:
Antinisca Di Marco
University of L'Aquila, Italy
,
Petr Tuma
Charles University, Czechia

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 April 2023

Check for updates

Author Tags

Qualifiers

Keynote

Conference

ICPE '23

Sponsor:

ICPE '23: ACM/SPEC International Conference on Performance Engineering

April 15 - 19, 2023

Coimbra, Portugal

Acceptance Rates

Overall Acceptance Rate 252 of 851 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
64
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)3

Reflects downloads up to 18 Dec 2024

Other Metrics

View Author Metrics

Citations

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Index Terms

Recommendations

Levelling up Performance and Performance Skills at MongoDB

Creating a Virtuous Cycle in Performance Testing at MongoDB

Performance Engineering and Database Development at MongoDB