GAMETE: general adaptable metric execution tool and environment (WIP)

In this paper we introduce the General Adaptable Metric Execution Tool and Environment (GAMETE) to aid the design, measurement, and analysis of cyber-physical systems (CPSs). GAMETE is a general and extensible environment for evaluating and computing metrics associated with the performance and complexity of CPS designs. GAMETE supports a wide array of metrics that it generates over simulation and experimental output data from CPSs. Key features of GAMETE are its 1) execution environment to host the simulations of CPS models, 2) unified data representation to host simulation and experimental data from CPSs, 3) dynamic metric library that supports the semi-automated evaluation of a wide range of metrics, and 4) standards-based integration with design toolchains. The contribution of this paper is the presentation of a reference architecture for batch metric computation and a case-study where GAMETE helped to quantitatively evaluate the performance of a CPS.