Abstract
Using a hidden Markov model (HMM) that describes the position of a damped stochastic harmonic oscillator as a stimulus input to a data processing system, we consider the optimal response of the system when it is targeted to predict the coming stimulus at a time shift later. We quantify the predictive behavior of the system by calculating the mutual information (MI) between the response and the stimulus of the system. For a passive sensor, the MI typically peaks at a negative time shift considering the processing delay of the system. Using an iterative approach of maximum likelihood for the predictive response, we show that the MI can peak at a positive time shift, which signifies the functional behavior of active prediction. We find the phenomena of active prediction in bullfrog retinas capable of producing omitted stimulus response under periodic pulse stimuli, by subjecting the retina to the same HMM signals encoded in the pulse interval. We confirm that active prediction requires some hidden information to be recovered and utilized from the observation of past stimulus by replacing the HMM with a Ornstein–Uhlenbeck process, which is strictly Markovian, and showing that no active prediction can be observed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Saigusa, T., Tero, A., Nakagaki, T., Kuramoto, Y.: Amoebae anticipate periodic events. Phys. Rev. Lett. 100(1), 018101 (2008)
Schwartz, G., Harris, R., Shrom, D., Berry, M.J.: Detection and prediction of periodic patterns by the retina. Nat. Neurosci. 10(5), 552–554 (2007)
Yang, Y.J., Chen, C.C., Lai, P.Y., Chan, C.K.: Adaptive synchronization and anticipatory dynamical systems. Phys. Rev. E 92(3), 030701 (2015)
Bialek, W., Tishby, N.: Predictive information (1999). arXiv:cond-mat/9902341
Rubin, J., Ulanovsky, N., Nelken, I., Tishby, N.: The representation of prediction error in auditory cortex. PLoS Comput. Biol. 12(8), e1005058 (2016)
Palmer, S.E., Marre, O., Berry, M.J., Bialek, W.: Predictive information in a sensory population. Proc. Natl. Acad. Sci. 112(22), 6908–6913 (2015)
Chen, K.S., Chen, C.C., Chan, C.K.: Characterization of predictive behavior of a retina by mutual information. Front. Comput. Neurosci. 11, 66 (2017)
Uhlenbeck, G.E., Ornstein, L.S.: On the theory of the brownian motion. Phys. Rev. 36(5), 823–841 (1930)
Schwartz, G., Berry, M.J.: Sophisticated temporal pattern recognition in retinal ganglion cells. J. Neurophysiol. 99(4), 1787–1798 (2008)
Tishby, N., Pereira, F.C., Bialek, W.: The information bottleneck method (2000). arXiv:physics/0004057
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Chen, CC., Chen, K.S., Chan, C.K. (2017). Active Prediction in Dynamical Systems. In: Liu, D., Xie, S., Li, Y., Zhao, D., El-Alfy, ES. (eds) Neural Information Processing. ICONIP 2017. Lecture Notes in Computer Science(), vol 10637. Springer, Cham. https://doi.org/10.1007/978-3-319-70093-9_67
Download citation
DOI: https://doi.org/10.1007/978-3-319-70093-9_67
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-70092-2
Online ISBN: 978-3-319-70093-9
eBook Packages: Computer ScienceComputer Science (R0)