Abstract
Repetition measurements from different sources often occur in data analysis which need to be model and keep track of the original sources. Moreover, data are usually collected as finite vectors which need to be considered as a sample from some certain continuous signal. Actually, these collected finite vectors can be effectively modeled by the mixture of Gaussian processes (MGP) and the key problem is how to make model selection on a given dataset. In fact, model selection prediction of MGP has been investigated by the RJMCMC method. However, the split and merge formula of the RJMCMC method are designed only for the univariables in the past. In this paper, we extend the split and merge formula to the situation of the multivariables. Moreover, we add a Metropolis-Hastings update rule after the RJMCMC process to speed up the convergence. It is demonstrated by simulation experiments that our improved RJMCMC method is feasible and effective.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Shi, J.Q., Murray-Smith, R., Titterington, D.M.: Hierarchical Gaussian process mixtures for regression. Stat. Comput. 15(1), 31–41 (2005)
Shi, J.Q., Wang, B.: Curve prediction and clustering with mixtures of Gaussian process functional regression models. Stat. Comput. 18(3), 267–283 (2008)
Green, P.J.: Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82(4), 711–732 (1995)
Andrieu, C., Freitas, N.D., Doucet, A.: Robust full Bayesian learning for radial basis networks. Neural Comput. 13(10), 2359–2407 (2001)
Qiang, Z., Ma, J.: Automatic model selection of the mixtures of Gaussian processes for regression. In: Hu, X., Xia, Y., Zhang, Y., Zhao, D. (eds.) ISNN 2015. LNCS, vol. 9377, pp. 335–344. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25393-0_37
Marin, J.M., Robert, C.P.: Bayesian Core: A Practical Approach to Computational Bayesian Statistics. Springer Texts in Statistics. Springer Science & Business Media, New York (2007). https://doi.org/10.1007/978-0-387-38983-7
Marin, J.M., Robert, C.P.: Bayesian Essentials with R. Springer, New York (2014). https://doi.org/10.1007/978-1-4614-8687-9
Wu, D., Chen, Z., Ma, J.: An MCMC based EM algorithm for mixtures of Gaussian processes. In: Hu, X., Xia, Y., Zhang, Y., Zhao, D. (eds.) ISNN 2015. LNCS, vol. 9377, pp. 327–334. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25393-0_36
Wu, D., Ma, J.: A two-layer mixture model of Gaussian process functional regressions and its MCMC EM algorithm. IEEE Trans. Neural Netw. Learn. Syst. (2018)
Qiang, Z., Luo, J., Ma, J.: Curve clustering via the split learning of mixtures of Gaussian processes. In: 2016 IEEE 13th International Conference on Signal Processing (ICSP), 1089–1094 (2016)
Acknowledgment
This work is supported by the Natural Science Foundation of China for Grant 61171138.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 IFIP International Federation for Information Processing
About this paper
Cite this paper
Qiang, Z., Ma, J. (2018). Model Selection Prediction for the Mixture of Gaussian Processes with RJMCMC. In: Shi, Z., Pennartz, C., Huang, T. (eds) Intelligence Science II. ICIS 2018. IFIP Advances in Information and Communication Technology, vol 539. Springer, Cham. https://doi.org/10.1007/978-3-030-01313-4_33
Download citation
DOI: https://doi.org/10.1007/978-3-030-01313-4_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-01312-7
Online ISBN: 978-3-030-01313-4
eBook Packages: Computer ScienceComputer Science (R0)