Abstract
In this paper, we present our 4-year experience of creating, evolving, and validating an automated software architecture measurement system within Huawei. This system is centered around a comprehensive scale called the Standard Architecture Index (SAI), which is composed of a number of measures, each reflecting a recurring architecture problem. Development teams use this as a guide to figure out how to achieve a better score by addressing the underlying problems. The measurement practice thus motivates desired behaviors and outcomes. In this paper, we present our experience of creating and validating SAI 1.0 and 2.0, which has been adopted as the enterprise-wide standard, and our directions towards SAI 3.0. We will describe how we got the development teams to accept and apply SAI through pilot studies, constantly adjusting the formula based on feedback, and correlating SAI scores with productivity measures. Our experience shows that it is critical to guide development teams to focus on the underlying problems behind each measure within SAI, rather than on the score itself. It is also critical to introduce state-of-the-art technologies to the development teams. In doing so they can leverage these technologies to pinpoint and quantify architecture problems so that better SAI scores can be achieved, along with better quality and productivity.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Baldwin, C.Y., Clark, K.B.: Design Rules, Vol. 1: The Power of Modularity. MIT Press, Cambridge (2000)
Bass, L., Clements, P., Kazman, R.: Software Architecture in Practice, 3rd edn. Addison-Wesley, Boston (2012)
Bouwers, E., Correia, J.P., van Deursen, A., Visser, J.: Quantifying the analyzability of software architectures. In: 2011 Ninth Working IEEE/IFIP Conference on Software Architecture, pp. 83–92, June 2011
Bouwers, E., van Deursen, A., Visser, J.: Dependency profiles for software architecture evaluations, September 2011
Bouwers, E., van Deursen, A., Visser, J.: Evaluating usefulness of software metrics: an industrial experience report. In: 2013 35th International Conference on Software Engineering (ICSE), pp. 921–930, May 2013
Chidamber, S.R., Kemerer, C.F.: A metrics suite for object oriented design. IEEE Trans. Softw. Eng. 20(6), 476–493 (1994)
Coleman, D., Oman, P., Ash, D., Lowther, B.: Using metrics to evaluate software system maintainability. Computer 27, 44–49 (1994)
e Abreu, F.B.: The mood metrics set. In: Proceedings of ECOOP 1995 Workshop on Metrics (1995)
Fowler, M.: AntiPatterns: Refactoring Software, Architectures, and Projects in Crisis. Addison-Wesley, Boston (1989)
Fowler, M.: Refactoring: Improving the Design of Existing Code. Addison-Wesley, Boston (1999)
Carriere, J., Kazman, R., Ozkaya, I.: A cost-benefit framework for making architectural decisions in a business context. In: Proceedings of the 32nd International Conference on Software Engineering (ICSE 32), (Capetown, South Africa), May 2010
Kazman, R., et al.: A case study in locating the architectural roots of technical debt. In: Proceedings of 37th International Conference on Software Engineering (2015)
Lorenz, M., Kidd, J.: Object-Oriented Software Metrics. Prentice Hall, Upper Saddle River (1994)
MacCormack, A., Rusnak, J., Baldwin, C.Y.: Exploring the structure of complex software designs: an empirical study of open source and proprietary code. Manag. Sci. 52(7), 1015–1030 (2006)
McCabe, T.J.: A complexity measure. IEEE Trans. Softw. Eng. 2(4), 308–320 (1976)
Mo, R., Cai, Y., Kazman, R., Xiao, L., Feng, Q.: Decoupling level: a new metric for architectural maintenance complexity. In: Proceedings of the 38th International Conference on Software Engineering, pp. 499–510. ACM (2016)
Schulte, L., Sajnani, H., Czerwonka, J.: Active files as a measure of software maintainability. In: Companion Proceedings of the 36th International Conference on Software Engineering, ICSE Companion 2014, pp. 34–43. ACM, New York (2014)
Schwanke, R., Xiao, L., Cai, Y.: Measuring architecture quality by structure plus history analysis. In: Proceedings of 35th International Conference on Software Engineering, pp. 891–900, May 2013
Sethi, K., Cai, Y., Wong, S., Garcia, A., Sant’Anna, C.: From retrospect to prospect: assessing modularity and stability from software architecture. In: Proceedings of the Joint 8th Working IEEE/IFIP International Conference on Software Architecture and 3rd European Conference on Software Architecture, pp. 269–272, September 2009
Sjøberg, D.I., Anda, B., Mockus, A.: Questioning software maintenance metrics: a comparative case study. In: Proceedings of the ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2012, pp. 107–110. ACM, New York (2012)
Wong, S., Cai, Y.: Improving the efficiency of dependency analysis in logical models. In: Proceedings of the 24th IEEE/ACM International Conference on Automated Software Engineering, pp. 173–184, November 2009
Wong, S., Cai, Y., Kim, M., Dalton, M.: Detecting software modularity violations. In: Proceedings of the 33rd International Conference on Software Engineering, pp. 411–420, May 2011
Wong, S., Cai, Y., Valetto, G., Simeonov, G., Sethi, K.: Design rule hierarchies and parallelism in software development tasks. In: Proceedings of 24th IEEE/ACM International Conference on Automated Software Engineering, pp. 197–208, November 2009
Xiao, L., Cai, Y., Kazman, R.: Design rule spaces: a new form of architecture insight. In: Proceedings of 36th International Conference on Software Engineering (2014)
Xiao, L., Cai, Y., Kazman, R., Mo, R., Feng, Q.: Identifying and quantifying architectural debt. In: Proceedings of 38th International Conference on Software Engineering (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Wu, W. et al. (2018). Software Architecture Measurement—Experiences from a Multinational Company. In: Cuesta, C., Garlan, D., Pérez, J. (eds) Software Architecture. ECSA 2018. Lecture Notes in Computer Science(), vol 11048. Springer, Cham. https://doi.org/10.1007/978-3-030-00761-4_20
Download citation
DOI: https://doi.org/10.1007/978-3-030-00761-4_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-00760-7
Online ISBN: 978-3-030-00761-4
eBook Packages: Computer ScienceComputer Science (R0)