Abstract
This paper presents an EM algorithm for fitting traces with Markovian arrival processes (MAPs). The proposed algorithm operates on a special subclass of MAPs. This special structure enables the efficient implementation of the EM algorithm; it is more orders of magnitudes faster than methods operating on the general MAP class while providing similar or better likelihood values. An other important feature of the algorithm is that it is able to fit multi-class traces with marked Markovian arrival processes as well. Several numerical examples demonstrate the efficiency of the procedure.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Anderson, T.W., Goodman, L.A.: Statistical inference about Markov chains. The Annals of Mathematical Statistics, 89–110 (1957)
Asmussen, S., Nerman, O., Olsson, M.: Fitting phase-type distributions via the EM algorithm. Scandinavian Journal of Statistics, 419–441 (1996)
Bause, F., Horváth, G.: Fitting Markovian Arrival Processes by Incorporating Correlation into Phase Type Renewal Processes. In: 2010 Seventh International Conference on the Quantitative Evaluation of Systems (QEST), pp. 97–106. IEEE (2010)
Breuer, L.: An EM algorithm for batch Markovian arrival processes and its comparison to a simpler estimation procedure. Annals of Operations Research 112(1-4), 123–138 (2002)
Buchholz, P.: An EM-algorithm for MAP fitting from real traffic data. In: Kemper, P., Sanders, W.H. (eds.) TOOLS 2003. LNCS, vol. 2794, pp. 218–236. Springer, Heidelberg (2003)
Buchholz, P., Kemper, P., Kriege, J.: Multi-class Markovian arrival processes and their parameter fitting. Performance Evaluation 67(11), 1092–1106 (2010)
Buchholz, P., Kriege, J.: A heuristic approach for fitting MAPs to moments and joint moments. In: Sixth International Conference on the Quantitative Evaluation of Systems, QEST 2009, pp. 53–62. IEEE (2009)
Casale, G., Zhang, E.Z., Smirni, E.: KPC-toolbox: Simple yet effective trace fitting using Markovian arrival processes. In: Fifth International Conference on Quantitative Evaluation of Systems, QEST 2008, pp. 83–92. IEEE (2008)
Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B (Methodological), 1–38 (1977)
El Abdouni Khayari, R., Sadre, R., Haverkort, B.R.: Fitting world-wide web request traces with the EM-algorithm. Performance Evaluation 52(2), 175–191 (2003)
He, Q., Neuts, M.F.: Markov chains with marked transitions. Stochastic Processes and their Applications 74, 37–52 (1998)
Horváth, A., Horváth, G., Telek, M.: A traffic based decomposition of two-class queueing networks with priority service. Computer Networks 53(8), 1235–1248 (2009)
Horváth, G., Buchholz, P., Telek, M.: A MAP fitting approach with independent approximation of the inter-arrival time distribution and the lag correlation. In: Second International Conference on the Quantitative Evaluation of Systems, pp. 124–133. IEEE (2005)
Klemm, A., Lindemann, C., Lohmann, M.: Modeling IP traffic using the batch Markovian arrival process. Performance Evaluation 54(2), 149–173 (2003)
Latouche, G., Ramaswami, V.: Introduction to matrix analytic methods in stochastic modeling. Society for Industrial and Applied Mathematics, vol. 5 (1987)
Okamura, H., Dohi, T.: Faster maximum likelihood estimation algorithms for Markovian arrival processes. In: Sixth International Conference on the Quantitative Evaluation of Systems, QEST 2009, pp. 73–82. IEEE (2009)
Okamura, H., Dohi, T., Trivedi, K.S.: A refined EM algorithm for PH distributions. Performance Evaluation 68(10), 938–954 (2011)
Rydén, T.: An EM algorithm for estimation in Markov-modulated Poisson processes. Computational Statistics & Data Analysis 21(4), 431–447 (1996)
Telek, M., Horváth, G.: A minimal representation of Markov arrival processes and a moments matching method. Performance Evaluation 64(9), 1153–1168 (2007)
Thummler, A., Buchholz, P., Telek, M.: A novel approach for phase-type fitting with the EM algorithm. IEEE Transactions on Dependable and Secure Computing 3(3), 245–258 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Horváth, G., Okamura, H. (2013). A Fast EM Algorithm for Fitting Marked Markovian Arrival Processes with a New Special Structure. In: Balsamo, M.S., Knottenbelt, W.J., Marin, A. (eds) Computer Performance Engineering. EPEW 2013. Lecture Notes in Computer Science, vol 8168. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40725-3_10
Download citation
DOI: https://doi.org/10.1007/978-3-642-40725-3_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40724-6
Online ISBN: 978-3-642-40725-3
eBook Packages: Computer ScienceComputer Science (R0)