Data-Driven Decentralized Learning Regulation for Networked Interconnected Systems Using Generalized Fuzzy Hyperbolic Models
Authors: 
Jian Liu, Jiachen Ke, Jinliang Liu, Xiangpeng Xie, Engang Tian, Jie CaoAuthors Info & Claims
Pages 5737 - 5749
Abstract
In this article, a decentralized event-triggered (ET) regulation problem is tackled for networked interconnected systems (NISs) with control constraints and unmatched interference. Foremost, the decentralized regulation issue is converted into the optimal control problems for the associated auxiliary subsystem. In confronting the unavailability of system dynamics, the utilization of generalized fuzzy hyperbolic models-assisted identifier provides a novel perspective to devise the efficacious control policy for the constrained NISs. For the sake of mitigating the communication workload, a new dual threshold functions-based adaptive ET scheme (DTAETS) is put forward by incorporating the current data and latest ET signal. Moreover, we present a data-driven decentralized reinforcement learning algorithm to acquire the solution of DTAETS-boosted Hamilton–Jacobi–Isaacs equation. Then, the uniformly ultimately bounded stability of auxiliary subsystem and the weight estimation error is assured. Ultimately, a numeral experiment is conducted to substantiate the validity of the theoretical results.
References
[1]
X. Wang, D. Ding, X. Ge, and H. Dong, “Neural-network-based control with dynamic event-triggered mechanisms under DoS attacks and applications in load frequency control,” IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 69, no. 12, pp. 5312–5324, Dec. 2022.
[2]
Y. Zheng, Y.-X. Li, W.-W. Che, and Z. Hou, “Adaptive NN-based event-triggered containment control for unknown nonlinear networked systems,” IEEE Trans. Neural Netw. Learn. Syst., vol. 34, no. 6, pp. 2742–2752, Jun. 2023.
[3]
D. Wu and J. M. Mendel, “On the continuity of type-1 and interval type-2 fuzzy logic systems,” IEEE Trans. Fuzzy Syst., vol. 19, no. 1, pp. 179–192, Feb. 2011.
[4]
D. Li and J. Dong, “Fuzzy control based on reinforcement learning and subsystem error derivatives for strict-feedback systems with an observer,” IEEE Trans. Fuzzy Syst., vol. 31, no. 8, pp. 2509–2521, Aug. 2023.
[5]
H. Zhang and Y. Quan, “Modeling, identification, and control of a class of nonlinear systems,” IEEE Trans. Fuzzy Syst., vol. 9, no. 2, pp. 349–354, Apr. 2001.
[6]
Z. Ming, H. Zhang, Y. Yan, and J. Sun, “Self-triggered adaptive dynamic programming for model-free nonlinear systems via generalized fuzzy hyperbolic model,” IEEE Trans. Syst., Man, Cybern. Syst., vol. 53, no. 5, pp. 2792–2801, May 2023.
[7]
C. Peng, M. Wu, X. Xie, and Y.-L. Wang, “Event-triggered predictive control for networked nonlinear systems with imperfect premise matching,” IEEE Trans. Fuzzy Syst., vol. 26, no. 5, pp. 2797–2806, Oct. 2018.
[8]
D. Wu, Y. Yuan, J. Huang, and Y. Tan, “Optimize TSK fuzzy systems for regression problems: Minibatch gradient descent with regularization, droprule, and adabound (MBGD-RDA),” IEEE Trans. Fuzzy Syst., vol. 28, no. 5, pp. 1003–1015, May 2020.
[9]
J.-W. Xing, C. Peng, Z. Cao, and W.-B. Xie, “Security-based control for networked interval type-2 fuzzy systems with multiple cyber-attacks: An improved dynamic event-triggered scheme,” IEEE Trans. Fuzzy Syst., vol. 31, no. 8, pp. 2747–2760, Aug. 2023.
[10]
Y. Cui, D. Wu, and J. Huang, “Optimize TSK fuzzy systems for classification problems: Minibatch gradient descent with uniform regularization and batch normalization,” IEEE Trans. Fuzzy Syst., vol. 28, no. 12, pp. 3065–3075, Dec. 2020.
[11]
J. Liu, J. Ke, J. Liu, X. Xie, and E. Tian, “Secure event-triggered control for IT-2 fuzzy networked systems with stochastic communication protocol and FDI attacks,” IEEE Trans. Fuzzy Syst., vol. 32, no. 3, pp. 1167–1180, Mar. 2024.
[12]
H. Zhang, C. Liu, H. Su, and K. Zhang, “Echo state network-based decentralized control of continuous-time nonlinear large-scale interconnected systems,” IEEE Trans. Syst., Man, Cybern. Syst., vol. 51, no. 10, pp. 6293–6303, Oct. 2021.
[13]
J. Mu, X.-G. Yan, S. K. Spurgeon, and D. Zhao, “Nonlinear sliding mode control for interconnected systems with application to automated highway systems,” IEEE Trans. Control Netw. Syst., vol. 5, no. 1, pp. 664–674, Mar. 2018.
[14]
H. Sun, L. Hou, G. Zong, and X. Yu, “Adaptive decentralized neural network tracking control for uncertain interconnected nonlinear systems with input quantization and time delay,” IEEE Trans. Neural Netw. Learn. Syst., vol. 31, no. 4, pp. 1401–1409, Apr. 2020.
[15]
X. Yang and H. He, “Decentralized event-triggered control for a class of nonlinear-interconnected systems using reinforcement learning,” IEEE Trans. Cybern., vol. 51, no. 2, pp. 635–648, Feb. 2021.
[16]
X. Yang, Y. Zhu, N. Dong, and Q. Wei, “Decentralized event-driven constrained control using adaptive critic designs,” IEEE Trans. Neural Netw. Learn. Syst., vol. 33, no. 10, pp. 5830–5844, Oct. 2022.
[17]
H. Su, X. Luan, H. Zhang, X. Liang, J. Yang, and J. Wang, “Decentralized optimal control of large-scale partially unknown nonlinear mismatched interconnected systems based on dynamic event-triggered control,” Neurocomputing, vol. 568, 2024, Art. no.
[18]
J. Liu, N. Zhang, L. Zha, X. Xie, and E. Tian, “Reinforcement learning-based decentralized control for networked interconnected systems with communication and control constraints,” IEEE Trans. Autom. Sci. Eng., to be published.
[19]
Y. Zhao, B. Niu, G. Zong, N. Xu, and A. M. Ahmad, “Event-triggered optimal decentralized control for stochastic interconnected nonlinear systems via adaptive dynamic programming,” Neurocomputing, vol. 539, 2023, Art. no.
[20]
Q. Wu, B. Zhao, D. Liu, and M. M. Polycarpou, “Event-triggered adaptive dynamic programming for decentralized tracking control of input constrained unknown nonlinear interconnected systems,” Neural Netw., vol. 157, pp. 336–349, 2023.
[21]
H. Zhao, H. Wang, B. Niu, X. Zhao, and N. Xu, “Adaptive fuzzy decentralized optimal control for interconnected nonlinear systems with unmodeled dynamics via mixed data and event driven method,” Fuzzy Sets Syst., vol. 474, 2024, Art. no.
[22]
P. Osinenko, D. Dobriborsci, G. Yaremenko, and G. Malaniya, “A generalized stacked reinforcement learning method for sampled systems,” IEEE Trans. Autom. Control, vol. 68, no. 11, pp. 7006–7013, Nov. 2023.
[23]
W. Bai, T. Li, Y. Long, and C. L. P. Chen, “Event-triggered multigradient recursive reinforcement learning tracking control for multiagent systems,” IEEE Trans. Neural Netw. Learn. Syst., vol. 34, no. 1, pp. 366–379, Jan. 2023.
[24]
X. Tong, D. Ma, R. Wang, X. Xie, and H. Zhang, “Dynamic event-triggered-based integral reinforcement learning algorithm for frequency control of microgrid with stochastic uncertainty,” IEEE Trans. Consum. Electron., vol. 69, no. 3, pp. 321–330, Aug. 2023.
[25]
X. Yang and B. Zhao, “Optimal neuro-control strategy for nonlinear systems with asymmetric input constraints,” IEEE/CAA J. Automatica Sinica, vol. 7, no. 2, pp. 575–583, Mar. 2020.
[26]
B. Zhao, D. Liu, and C. Luo, “Reinforcement learning-based optimal stabilization for unknown nonlinear systems subject to inputs with uncertain constraints,” IEEE Trans. Neural Netw. Learn. Syst., vol. 31, no. 10, pp. 4330–4340, Oct. 2020.
[27]
J. Liu, E. Gong, L. Zha, E. Tian, and X. Xie, “Interval type-2 fuzzy-model-based filtering for nonlinear systems with event-triggering weighted try-once-discard protocol and cyberattacks,” IEEE Trans. Fuzzy Syst., vol. 32, no. 3, pp. 721–732, Mar. 2024.
[28]
Y. Li, F. Song, J. Liu, X. Xie, and E. Tian, “Software-defined event-triggering control for large-scale networked systems subject to stochastic cyberattacks,” IEEE Trans. Control Netw. Syst., vol. 10, no. 3, pp. 1531–1541, Sep. 2023.
[29]
C. Peng and H. Sun, “Switching-like event-triggered control for networked control systems under malicious denial of service attacks,” IEEE Trans. Autom. Control, vol. 65, no. 9, pp. 3943–3949, Sep. 2020.
[30]
L. Zha, R. Liao, J. Liu, X. Xie, E. Tian, and J. Cao, “Dynamic event-triggered output feedback control for networked systems subject to multiple cyber attacks,” IEEE Trans. Cybern., vol. 52, no. 12, pp. 13800–13808, Dec. 2022.
[31]
Y. Sun, J. Yu, and H. Yin, “Finite-time output feedback control for nonlinear networked discrete-time systems with an adaptive event-triggered scheme,” J. Franklin Inst., vol. 358, no. 12, pp. 6035–6056, 2021.
[32]
H. Li, Z. Zhang, H. Yan, and X. Xie, “Adaptive event-triggered fuzzy control for uncertain active suspension systems,” IEEE Trans. Cybern., vol. 49, no. 12, pp. 4388–4397, Dec. 2019.
[33]
Y. Tan, Y. Yuan, X. Xie, E. Tian, and J. Liu, “Observer-based event-triggered control for interval type-2 fuzzy networked system with network attacks,” IEEE Trans. Fuzzy Syst., vol. 31, no. 8, pp. 2788–2798, Aug. 2023.
[34]
J. Wang, J. Wu, H. Shen, J. Cao, and L. Rutkowski, “A decentralized learning control scheme for constrained nonlinear interconnected systems based on dynamic event-triggered mechanism,” IEEE Trans. Syst., Man, Cybern. Syst., vol. 53, no. 8, pp. 4934–4943, Aug. 2023.
[35]
S. Xue, B. Luo, D. Liu, and Y. Gao, “Event-triggered ADP for tracking control of partially unknown constrained uncertain systems,” IEEE Trans. Cybern., vol. 52, no. 9, pp. 9001–9012, Sep. 2022.
[36]
B. Zhao, G. Shi, and D. Liu, “Event-triggered local control for nonlinear interconnected systems through particle swarm optimization-based adaptive dynamic programming,” IEEE Trans. Syst., Man, Cybern. Syst., vol. 53, no. 12, pp. 7342–7353, Dec. 2023.
[37]
X. Huo, H. R. Karimi, X. Zhao, B. Wang, and G. Zong, “Adaptive-critic design for decentralized event-triggered control of constrained nonlinear interconnected systems within an identifier-critic framework,” IEEE Trans. Cybern., vol. 52, no. 8, pp. 7478–7491, Aug. 2022.
[38]
J. Liu, N. Zhang, Y. Li, X. Xie, E. Tian, and J. Cao, “Learning-based event-triggered tracking control for nonlinear networked control systems with unmatched disturbance,” IEEE Trans. Syst., Man, Cybern. Syst., vol. 53, no. 5, pp. 3230–3240, May 2023.
[39]
H. Zhang, H. Su, K. Zhang, and Y. Luo, “Event-triggered adaptive dynamic programming for non-zero-sum games of unknown nonlinear systems via generalized fuzzy hyperbolic models,” IEEE Trans. Fuzzy Syst., vol. 27, no. 11, pp. 2202–2214, Nov. 2019.
[40]
H. Su, H. Zhang, D. W. Gao, and Y. Luo, “Adaptive dynamics programming for $H_\infty$ control of continuous-time unknown nonlinear systems via generalized fuzzy hyperbolic models,” IEEE Trans. Syst., Man, Cybern. Syst., vol. 50, no. 11, pp. 3996–4008, Nov. 2020.
[41]
H. Zhao, G. Zong, X. Zhao, H. Wang, N. Xu, and N. Zhao, “Hierarchical sliding-mode surface-based adaptive critic tracking control for nonlinear multiplayer zero-sum games via generalized fuzzy hyperbolic models,” IEEE Trans. Fuzzy Syst., vol. 31, no. 11, pp. 4010–4023, Nov. 2023.
[42]
L. M. Graves, “Riemann integration and Taylor's theorem in general analysis,” Trans. Amer. Math. Soc., vol. 29, no. 1, pp. 163–177, 1927.
[43]
X. Yang and H. He, “Adaptive critic designs for optimal control of uncertain nonlinear systems with unmatched interconnections,” Neural Netw., vol. 105, pp. 142–153, 2018.
[44]
D. S. Mitrinovic and P. M. Vasic, Analytic Inequalities. Berlin, Germany: Springer, 1970.
[45]
F. Lewis, S. Jagannathan, and A. Yesildirak, Neural Network Control of Robot Manipulators and Non-Linear Systems. London, U.K.: Taylor & Francis, 1999.
Index Terms
- Data-Driven Decentralized Learning Regulation for Networked Interconnected Systems Using Generalized Fuzzy Hyperbolic Models
Index terms have been assigned to the content through auto-classification.
Recommendations
Comparison of solvers for the generalized Riemann problem for hyperbolic systems with source terms
We compare four different approximate solvers for the generalized Riemann problem (GRP) for non-linear systems of hyperbolic equations with source terms. The GRP is a special Cauchy problem for a hyperbolic system with source terms whose initial ...
Convergence Acceleration for Hyperbolic Systems Using Semicirculant Approximations
The iterative solution of systems of equations arising from systems of hyperbolic, time-independent partial differential equations (PDEs) is studied. The PDEs are discretized using a finite volume or finite difference approximation on a structured grid. ...
Discontinuous Hamiltonian Finite Element Method for Linear Hyperbolic Systems
We develop a Hamiltonian discontinuous finite element discretization of a generalized Hamiltonian system for linear hyperbolic systems, which include the rotating shallow water equations, the acoustic and Maxwell equations. These equations have a ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
1941-0034 © 2024 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See https://www.ieee.org/publications/rights/index.html for more information.
Publisher
IEEE Press
Publication History
Published: 01 October 2024
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Feb 2025