Search Results (5)

Learning is a fundamental property of intelligent systems, observed across biological organisms and engineered systems. While modern intelligent systems typically rely on gradient descent for learning, the need for exact gradients and complex information flow makes its implementation in biological and neuromorphic systems challenging. This has motivated the exploration of alternative learning mechanisms that can operate locally and do not rely on exact gradients. In this work, we introduce a novel approach that leverages noise in the parameters of the system and global reinforcement signals. Using an Ornstein–Uhlenbeck process with adaptive dynamics, our method balances exploration and exploitation during learning, driven by deviations from error predictions, akin to reward prediction error. Operating in continuous time, Ornstein–Uhlenbeck adaptation (OUA) is proposed as a general mechanism for learning in dynamic, time-evolving environments. We validate our approach across a range of different tasks, including supervised learning and reinforcement learning in feedforward and recurrent systems. Additionally, we demonstrate that it can perform meta-learning, adjusting hyper-parameters autonomously. Our results indicate that OUA provides a promising alternative to traditional gradient-based methods, with potential applications in neuromorphic computing. It also hints at a possible mechanism for noise-driven learning in the brain, where stochastic neurotransmitter release may guide synaptic adjustments. Full article

The closed-loop control of pathological brain activity is a challenging task. In this study, we investigated the sensitivity of continuous epileptiform short discharge generation to electrical stimulation applied at different phases between the discharges using an in vitro 4-AP-based model of epilepsy in rat hippocampal slices. As a measure of stimulation effectiveness, we introduced a sensitivity function, which we then measured in experiments and analyzed with different biophysical and abstract mathematical models, namely, (i) the two-order subsystem of our previous Epileptor-2 model, describing short discharge generation governed by synaptic resource dynamics; (ii) a similar model governed by shunting conductance dynamics (Epileptor-2B); (iii) the stochastic leaky integrate-and-fire (LIF)-like model applied for the network; (iv) the LIF model with potassium M-channels (LIF+KM), belonging to Class II of excitability; and (v) the Epileptor-2B model with after-spike depolarization. A semi-analytic method was proposed for calculating the interspike interval (ISI) distribution and the sensitivity function in LIF and LIF+KM models, which provided parametric analysis. Sensitivity was found to increase with phase for all models except the last one. The Epileptor-2B model is favored over other models for subthreshold oscillations in the presence of large noise, based on the comparison of ISI statistics and sensitivity functions with experimental data. This study also emphasizes the stochastic nature of epileptiform discharge generation and the greater effectiveness of closed-loop stimulation in later phases of ISIs. Full article

We developed a mathematical model to simulate the dynamics of background synaptic noise in non-neuronal cells. By employing the stochastic Ornstein–Uhlenbeck process, we represented excitatory synaptic conductance and integrated it into a whole-cell model to generate spontaneous and evoke cellular electrical activities. This single-cell model encompasses numerous biophysically detailed ion channels, depicted by a set of ordinary differential equations in Hodgkin–Huxley and Markov formalisms. Consequently, this approach effectively induced irregular spontaneous depolarizations (SDs) and spontaneous action potentials (sAPs), resembling electrical activity observed in vitro. The input resistance decreased significantly, while the firing rate of spontaneous action potentials increased. Moreover, alterations in the ability to reach the action potential threshold were observed. Background synaptic activity can modify the input/output characteristics of non-neuronal excitatory cells. Hence, suppressing these baseline activities could aid in identifying new pharmaceutical targets for various clinical diseases. Full article

Bio-inspired models based on the lobula giant movement detector (LGMD) in the locust’s visual brain have received extensive attention and application for collision perception in various scenarios. These models offer advantages such as low power consumption and high computational efficiency in visual processing. However, current LGMD-based computational models, typically organized as four-layered neural networks, often encounter challenges related to noisy signals, particularly in complex dynamic environments. Biological studies have unveiled the intrinsic stochastic nature of synaptic transmission, which can aid neural computation in mitigating noise. In alignment with these biological findings, this paper introduces a probabilistic LGMD (Prob-LGMD) model that incorporates a probability into the synaptic connections between multiple layers, thereby capturing the uncertainty in signal transmission, interaction, and integration among neurons. Comparative testing of the proposed Prob-LGMD model and two conventional LGMD models was conducted using a range of visual stimuli, including indoor structured scenes and complex outdoor scenes, all subject to artificial noise. Additionally, the model’s performance was compared to standard engineering noise-filtering methods. The results clearly demonstrate that the proposed model outperforms all comparative methods, exhibiting a significant improvement in noise tolerance. This study showcases a straightforward yet effective approach to enhance collision perception in noisy environments. Full article

As the third-generation neural network, the spiking neural network (SNN) has become one of the most promising neuromorphic computing paradigms to mimic brain neural networks over the past decade. The SNN shows many advantages in performing classification and recognition tasks in the artificial intelligence field. In the SNN, the communication between the pre-synapse neuron (PRE) and the post-synapse neuron (POST) is conducted by the synapse. The corresponding synaptic weights are dependent on both the spiking patterns of the PRE and the POST, which are updated by spike-timing-dependent plasticity (STDP) rules. The emergence and growing maturity of spintronic devices present a new approach for constructing the SNN. In the paper, a novel SNN is proposed, in which both the synapse and the neuron are mimicked with the spin transfer torque magnetic tunnel junction (STT-MTJ) device. The synaptic weight is presented by the conductance of the MTJ device. The mapping of the probabilistic spiking nature of the neuron to the stochastic switching behavior of the MTJ with thermal noise is presented based on the stochastic Landau–Lifshitz–Gilbert (LLG) equation. In this way, a simplified SNN is mimicked with the MTJ device. The function of the mimicked SNN is verified by a handwritten digit recognition task based on the MINIST database. Full article