Abstract
A communication network is a highly complex nonlinear dynamical system. To avoid congestion collapse and keep network utilization high, many congestion control methods have been proposed. In this paper, a new framework, using Adaptive Critic Designs (ACD) based on Approximate Dynamic Programming (ADP) theory, is presented for network congestion control. At the present time, almost all ACD controllers are designed for centralized control system. In the new frame, the whole network is considered as a multiple non-cooperative ACDs control system, wherein, each source controller is governed by an ACD. This frame provides a new approach to solve the congestion control problem of the networks.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Kelly, F., Maulloo, A., Tan, D.: Rate Control in Communication Networks: Shadow Prices, Proportional Fairness and Stability. J. Oper. Res. Soc. 49, 237–252 (1998)
Wen, J., Arcak, M.: A Unifying Passivity Framework for Network Flow Control. IEEE Transactions on Automatic Control 49(2), 162–174 (2004)
Balakrishnan, S., Biega, V.: Adaptive-critic-based Neural Networks for Aircraft Optimal Control. Journal of Guidance, Control, and Dynamics 19, 893–898 (1996)
Werbos, P.: Approximate Dynamic Programming for Real-time Control and Neural Modeling. In: Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches (1992)
Steven, L., Lapsley, D.: Optimization Flow Control-I: Basic Algorithm and Convergence. IEEE/ACM Transaction on Networking 7(7), 861–874 (1999)
Kunniyur, S., Srikant, R.: End-to-end Congestion Control: Utility Functions Random Losses and ecn Marks. IEEE/ACM Transactions on Networking, 689–702 (2003)
Cheng, J., David, X., Steven, L.: Fast TCP: Motivation, Architecture, Algorithms, Performance. In: IEEE INFOCOM, vol. 4, pp. 2490–2501 (2004)
Fan, X., Arcak, M., Wen, J.: Robustness of Network Flow Control against Disturbances and Time-delay. System and Control Letters 53(1), 13–29 (2004)
Paganini, F.: A Global Stability Result in Network Flow Control. Systems Control Lett. 46, 165–172 (2002)
Bellman, R.: Dynamic Programming. Princeton University Press, Princeton (1957)
Liu, D., Xiong, X., Zhang, Y.: Action-dependent Adaptive Critic Designs. In: Proceedings IJCNN 01, vol. 2, pp. 990–995 (2001)
Kelly, F.: Charging and Rate Control for Elastic Traffic. European Transactions on Telecommunications 8, 33–37 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Xiang, Y., Yi, J., Zhao, D. (2007). Multiple Approximate Dynamic Programming Controllers for Congestion Control. In: Liu, D., Fei, S., Hou, ZG., Zhang, H., Sun, C. (eds) Advances in Neural Networks – ISNN 2007. ISNN 2007. Lecture Notes in Computer Science, vol 4491. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72383-7_43
Download citation
DOI: https://doi.org/10.1007/978-3-540-72383-7_43
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72382-0
Online ISBN: 978-3-540-72383-7
eBook Packages: Computer ScienceComputer Science (R0)