Abstract
This paper considers the dynamic control of stochastic networks for the guaranteed delay with network utility maximization in multi-hop wireless networks. On contrary to single hop case, the delay is difficult to predict in multi-hop scenarios due to their unpredictable traffic pattern and variable queuing time in intermediate nodes. We present here a control policy for joint flow control and scheduling which can achieve high network utility and guarantees delay constraints. In addition, we derive the capacity region of the network under a given delay condition. Simulation results show that the proposed policy achieves near optimal network utility with delay guaranteed compare to exiting algorithms.
Similar content being viewed by others
References
Bobarshad, H., van der Schaar, M., Aghvami, A., Dilmaghani, R., & Shikh-Bahaei, M. (2012). Analytical modeling for delay-sensitive video over wlan. IEEE Transactions on Multimedia, 14(2), 401–414.
Georgiadis, L., Neely, M. J., & Tassiulas, L. (2006). Resource allocation and cross-layer control in wireless networks. Foundations and Trends in Networking, 1(1), 1–144.
Eryilmaz, A. (2005). Fair resource allocation in wireless networks using queue-length-based scheduling and congestion control. In: Proceedings of IEEE INFOCOM ’05, pp. 1794–1803.
Stolyar, A. L. (2005). Maximizing queueing network utility subject to stability: Greedy primal-dual algorithm. Queueing Systems: Theory and Applications, 50(4), 401–457.
Tassiulas, L., & Ephremides, A. (1992). Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks. IEEE Transaction on Automatic Control, 37(12), 1936–1948.
Pham, N. T., Enkhbat, R., & Hwang, W. J. (2011). Delay-guaranteed scheduling and flow control for new generation mobile networks. IEICE Transactions on Communication, 94–B(6), 1556–1564.
Ostovari, P., Khreishah, A., & Wu, J. (2013). Broadcasting with hard deadlines in wireless multihop networks using network coding. Wireless Communications and Mobile Computing.
El-Gendy, M., Bose, A., Wang, H., & Shin, K. G. (2003). Statistical characterization for per-hop QoS. In Proceedings of the 11th international conference on quality of service.
Joseph, V., & Chapman, B. (2009). Deploying QoS for Cisco IP and next generation networks: The definitive guide. Los Altos, CA: Morgan Kaufmann.
Kelly, F., Maulloo, A., & Tan, D. (1998). Rate control in communication networks: shadow prices, proportional fairness and stability. Journal of the Operational Research Society, 49, 237–252.
Chiang, M. (2005). Balancing transport and physical layers in wireless multihop networks: Jointly optimal congestion control and power control. IEEE Journal on Selected Areas in Communications, 23(1), 104–116.
Chiang, M., Low, S., Calderbank, A., & Doyle, J. (2007). Layering as optimization decomposition: A mathematical theory of network architectures. Proceedings of the IEEE, 95(1), 255–312.
Shah, D., Tse, D., & Tsitsiklis, J. (2011). Hardness of low delay network scheduling. IEEE Transactions on Information Theory, 57(12), 7810–7817.
Gopalan, A., Caramanis, C., & Shakkottai, S. (2012). Low-delay wireless scheduling with partial channel-state information. In Proceedings IEEE INFOCOM, pp. 1071–1079.
Neely, M. (2011). Opportunistic scheduling with worst case delay guarantees in single and multi-hop networks. In: INFOCOM, 2011 Proceedings IEEE, pp. 1728–1736.
Neely, M. (2006). Energy optimal control for time-varying wireless networks. IEEE Transactions on Information Theory, 52(7), 2915–2934.
Le, L. B., Modiano, E., & Shroff, N. (2012). Optimal control of wireless networks with finite buffers. IEEE/ACM Transactions on Networking, 20(4), 1316–1329.
Giaccone, P., Leonardi, E., & Shah, D. (2007). Throughput region of finite-buffered networks. IEEE Transaction of Parallel Distributed System, 18(2), 251–263.
Khodaian, A., & Khalaj, B. (2010). Delay-constrained utility maximisation in multi-hop random access networks. IET Communications, 4(16), 1908–1918.
Li, Y., Chiang, M., Calderbank, A., & Diggavi, S. (2007). Optimal rate-reliability-delay tradeoff in networks with composite links. Proceedings of IEEE INFOCOM, 07, 526–534.
Wang, Y., Vuran, M. C., & Goddard, S. (2012). Cross-layer analysis of the end-to-end delay distribution in wireless sensor networks. IEEE/ACM Transactions on Networking, 20(1), 305–318.
Xue, D., & Ekici, E. (2012). Delay-guaranteed cross-layer scheduling in multihop wireless networks. IEEE/ACM Transactions on Networking, 21(6), 1696–1707.
Huang, P.-K., Lin, X., & Wang, C.-C. (2011). A low-complexity congestion control and scheduling algorithm for multihop wireless networks with order-optimal per-flow delay. Proceedings IEEE INFOCOM, pp. 2588–2596.
Kar, K., Luo, X., & Sarkar, S. (2009). Delay guarantees for throughput-optimal wireless link scheduling. In: Proceedings of IEEE INFOCOM ’09, pp. 2331–2339.
Wang, Y., & Boyd, S. (2009). Performance bounds for linear stochastic control. Systems & Control Letters, 58(3), 178–182.
Zhang, Zhi, Moola, Sudhir, & Edwin K.P., Chong. (2010). Opportunistic fair scheduling in wireless networks: An approximate dynamic programming approach. Mobile Networks and Applications, 155, 710–728.
Warren B., Powell. (2007). Approximate dynamic programming: Solving the curses of dimensionality (Wiley series in probability and statistics). New York: Wiley-Interscience.
Low, S., & Lapsley, D. (1999). Optimization flow control. I. Basic algorithm and convergence. IEEE/ACM Transactions on Networking, 7(6), 861–874.
Mo, J., & Walrand, J. (2000). Fair end-to-end window-based congestion control. IEEE/ACM Transactions on Networking, 8(5), 556–567.
Modiano, E., Shah, D., & Zussman, G. (2006). Maximizing throughput in wireless networks via gossiping. SIGMETRICS Performance Evaluation Review, 34, 27–38.
Eryilmaz, A., Asuman, O., & Modiano, E. (2007). Polynomial complexity algorithms for full utilization of multi-hop wireless networks. Proceedings of INFOCOM, 2007, 499–507.
Sanghavi, S., Bui, L., & Srikant, R. (2007). Distributed link scheduling with constant overhead. SIGMETRICS Performance Evaluation Review, 35, 313–324.
Jung, K., & Shah, D. (2007). Low delay scheduling in wireless network. IEEE International Symposium on Information Theory, 2007, 1396–1400.
Chaporkar, P., Kar, K., Luo, X., & Sarkar, S. (2008). Throughput and fairness guarantees through maximal scheduling in wireless networks. IEEE Transactions on Information Theory, 54(2), 572–594.
Liu, J., Stolyar, A., Chiang, M., & Poor, H. (2009). Queue back-pressure random access in multihop wireless networks: Optimality and stability. IEEE Transactions on Information Theory, 55(9), 4087–4098.
Acknowledgments
This research was supported by the MSIP (Ministry of Science, ICT and Future Planning), Korea, under the Global IT Talent support program (NIPA-2014-H0904-14-1006) supervised by the NIPA (National IT Industry Promotion Agency).
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
1.1 Proof of Proposition 1
We have following basic inequalities
Squaring both sides of Eqs. (1) and (3), and using above inequalities yields
Summing over all queues and flows, noting that if \(i = s(c)\) then \(\mu _{a,i}^{(c)} (t) = r^{(c)}(t)\) and
we obtains (6).
1.2 Proof of Theorem 1
To begin the proof, we first consider following lemma.
Lemma 1
A queue with arrival rate \(\lambda ^{(c)} = E\{ r^{(c)}_{in} (t)\}\) and departure rate \(\mu ^{(c)} =\lambda ^{(c)} +\varepsilon ^{(c)} \) has queue length bound by \(\frac{E\{ r^{(c)}_{in} (t)^{2}\} -2(\lambda ^{(c)})^{2} +\lambda ^{(c)} }{2\varepsilon ^{(c)} }\).
To begin the proof, we first compute bound of a queue with arrival rate \(\lambda ^{(c)} \) and departure rate \(\mu ^{(c)} =\lambda ^{(c)} +\varepsilon ^{(c)} \). Consider Lyapunov function \(L(y^{(c)} (t))=y^{(c)} (t)^{2} \) of dynamic evolution of the given queue. The drift of the Lyapunov function is defined as \(\varDelta L(y^{(c)} (t))=y^{(c)} (t+1)^{2} -y^{(c)} (t)^{2} \). Squaring both sides of the queueing evolution and rearranging, we have:
where \(\bar{B}^{(c)} =E\{ (\mu ^{(c)} (t)-r^{(c)}_{in} (t))^{2} \} \).
Using the facts that \(E\{ (\mu ^{(c)})^{2} \} =E\{ \mu ^{(c)} \} \) and \(E\{ \mu ^{(c)} \} =\lambda ^{(c)} \) under the stability condition we obtain:
Using \(\mu ^{(c)} =\lambda ^{(c)} +\varepsilon ^{(c)} \) in (17) yields
Using Lemma 4.2 from [2] with the above condition, the following is obtained:
The proof of Theorem shows that (11) is sufficient condition for stability of the network with delay constraints. More specifically, it proves that Lyapunov of L(S(t)) is negative when \(y(t)\) is sufficiently large. We rewrite (7) as following
Following inequality hold for the optimal rate in (10) due to \(\alpha \le 1\)
Plug flow control vector \(r^{(c)*} (t)\) into (18) and using (19) we have
It is well-known that the dual control [2, 3]
obtains the maximum stability region \(\varLambda \). Since \(q^{(c)}_{s(c)} \le Q^{(c)}(t)\), DFSE flow control always admits smaller rate than the one of the dual control. Thus \(\lambda = \left\{ {\bar{r}^{(c)*} (t)} \right\} _{c \in C} \in \varLambda \) regardless the scheduling policy.
Since \(\lambda \in \varLambda \) there exist \(\varepsilon =\{ (N^{(c)}-1)\varepsilon ^{(c)} \} _{c \in C } >0\) such that \(\lambda = \left\{ {\bar{r}^{(c)*} (t)} \right\} _{c \in C} + \varepsilon \in \varLambda \). According to the Corollary 3.9 in [2], for this \(\lambda \), there exist a randomized algorithm that allocated \(\mu (t)\) such that on each node of flow \(c\) we have \(E\left\{ {\mu _{a,i}^{(c)} (t)} \right\} = E\left\{ {\mu _{i,b}^{(c)} (t) } \right\} + \varepsilon ^{(c)}\) and \(E\left\{ {\mu ^{(c)} (t)} \right\} \geqslant \lambda ^{(c)}\). According to Lemma 1, every queue \(q^{(c)}(t)\) is bounded under the randomized algorithm. Let \(\bar{B}_e\) the upper bound of \(B_e(t)\), hence \(B_e(t) \le \bar{B}_e\). Moreover, since elements of \(M^{(c)}(t)\) are bounded, \(\bar{M}^{(c)}\) are also bounded. Thus under the randomized algorithm we have expectation of \(\varDelta L_e (S(t + 1))\) is bounded as follows
Since the scheduling in DFSE minimizes over all possible choice of \(\mu (t)\) at every time slot, including the randomized algorithm, (20) is also held for DFSE scheduling. Note that \(q^{(c)} (t) = \sum \limits _{(a,i) \in L^{(c)} } {q_i^{(c)} (t)}\), (20) is then rewritten as follows
It is clear that if (21) holds, the queueing system is stable since large \(y^{(c)}(t)\) leads to negative drift of the Lyapunov function \(L_e (S(t + 1))\) (Lemma 4.2 in [2, 3]). We now shows that condition (11) of Theorem 1 is sufficient condition of (21).
We first calculate the upper bound of \(q^{(c)} (t)\) under the randomized algorithm. According to Lemma 1, for the first node in flow \(c\) we have
For intermediate node, since \( E\{ r^{(c)}_{in} (t)^{2}\} = E\{ r^{(c)}_{in} (t)\} = \lambda , ^{(c)}\)
Hence, \(q^{(c)}(t)\) of flow \(c\) with \(N^{(c)}\) nodes on the path is bounded as follows
Thus given (11), (21) holds for all \(q^(c)(t)\). Theorem 1 holds.
1.3 Proof of Theorem 2
Proof technique of Theorem 2 is similar with the one of Theorem one. Here are the sketch of the proof. Lyapunov drift of \(L_{h}(S(t))\) is defined as follows
Applying DFSH flow control and randomized algorithm into (22), noting that \(E\left\{ \mu _{i,b}^{(c)} (t)\right. \left. - \mu _{a,i}^{(c)} (t) \right\} = \lambda ^{(c)*} + \varepsilon \) and \(E\left\{ {\mu ^{(c)} (t)} \right\} \geqslant \lambda ^{(c)*}\) we obtain
This is equivalent to
Thus, sufficient condition for the stability of the system under DFSH is
Condition (16) guarantees that (23) holds for every \(q_i^{(c)} (t)\). Thus (16) is sufficient condition for (23). Theorem 2 holds.
Rights and permissions
About this article
Cite this article
Huynh, T., Pham, NT., Lee, SH. et al. Dynamic Control Policy for Delay Guarantees in Multi-hop Wireless Networks. Wireless Pers Commun 80, 647–670 (2015). https://doi.org/10.1007/s11277-014-2033-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11277-014-2033-3