Article

Optimal control of admission to a station in a closed two queue system

Authors:

Taposh Banerjee,

Arzad A. KheraniAuthors Info & Claims

valuetools '06: Proceedings of the 1st international conference on Performance evaluation methodolgies and tools

Pages 63 - es

https://doi.org/10.1145/1190095.1190176

Published: 11 October 2006 Publication History

Get Access

Abstract

We consider a closed queueing system consisting of two stations in tandem. The controller has to make a decision on the number of customers to be admitted for service at the first station so that a long term utility function is maximized. We study the nature of optimal policy for some classes of utility function and transition probability structures. This model can be used to solve many practical closed queueing system problems, like node activation in a rechargeable sensor network. We show that, depending on the number of servers at the various stations, the optimal policy may or may not be greedy.

References

[1]

V. S. Borkar, A. A. Kherani, and B. J. Prabhu. Control of buffer and energy of a wireless device: Closed and open loop approaches. In INRIA Research Report No. RR-5414, 2004.

Google Scholar

[2]

M. Goyal, A. Kumar, and V. Sharma. Power constrained and delay optimal policies for scheduling transmission over a fading channel. In proceedings of IEEE Infocom, 2003.

Google Scholar

[3]

B. Hajek. Optimal control of two interacting service stations. IEEE transactions on Automatic Control, 29(6), June 1984.

Google Scholar

[4]

Shaler Stidham Jr. and Richard Weber. A survey of markov decision models for control of network of queues. Queueing Systems, 13, 1993.

Google Scholar

[5]

K. Kar, A. Krishnamurthy, and N. Jaggi. Dynamic node activation in networks of rechargeable sensors. In proceedings of IEEE Infocom, 2005.

Crossref

Google Scholar

[6]

Cheng-Yuan Ku and S. Jordan. Access control to two multi-server loss queues in series. IEEE transactions on Automatic Control, 42(7), JULY 1997.

Google Scholar

[7]

Z. Rosberg, P. P. Varaiya, and J. C. Walrand. Optimal control of service in tandem queue. IEEE transactions on Automatic Control, 27(3), June 1982.

Google Scholar

[8]

M. Schal. Average optimality in dynamic programming with general state space. Mathematics of Operations Research, 18(1), February 1993.

Digital Library

Google Scholar

Cited By

View all

Banerjee TKherani A(2007)Sensor Node Activation Policies using Partial or No Information2007 5th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks and Workshops10.1109/WIOPT.2007.4480063(1-7)Online publication date: Apr-2007
https://doi.org/10.1109/WIOPT.2007.4480063
Banerjee TPadhy SKherani A(2007)Optimal Dynamic Activation Policies in Sensor Networks2007 2nd International Conference on Communication Systems Software and Middleware10.1109/COMSWA.2007.382435(1-8)Online publication date: Jan-2007
https://doi.org/10.1109/COMSWA.2007.382435

Index Terms

Optimal control of admission to a station in a closed two queue system
1. Mathematics of computing
  1. Probability and statistics
    1. Probabilistic representations
      1. Markov networks
    2. Stochastic processes
      1. Markov processes
2. Theory of computation
  1. Theory and algorithms for application domains
    1. Machine learning theory
      1. Markov decision processes

Recommendations

Optimal control of parallel queues with impatient customers
Performance modelling and evaluation of high-performance parallel and distributed systems

We consider a queueing system with a number of identical exponential servers. Each server has its own queue with unlimited capacity. The service discipline in each queue is first-come-first-served (FCFS). Customers arrive according to a state-dependent ...
Control of a Heterogeneous Two-Server Exponential Queueing System

A dynamic control policy known as "threshold queueing" is defined for scheduling customers from a Poisson source on a set of two exponential servers with dissimilar service rates. The slower server is invoked in response to instantaneous system loading ...
A Two-Queue Polling Model with Two Priority Levels in the First Queue

In this paper we consider a single-server cyclic polling system consisting of two queues. Between visits to successive queues, the server is delayed by a random switch-over time. Two types of customers arrive at the first queue: high and low priority ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

valuetools '06: Proceedings of the 1st international conference on Performance evaluation methodolgies and tools

October 2006

638 pages

ISBN:1595935045

DOI:10.1145/1190095

General Chairs:
Luciano Lenzini
University of Pisa, Italy
,
Rene Cruz
UCSD, US

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 October 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 90 of 196 submissions, 46%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
157
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Banerjee TKherani A(2007)Sensor Node Activation Policies using Partial or No Information2007 5th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks and Workshops10.1109/WIOPT.2007.4480063(1-7)Online publication date: Apr-2007
https://doi.org/10.1109/WIOPT.2007.4480063
Banerjee TPadhy SKherani A(2007)Optimal Dynamic Activation Policies in Sensor Networks2007 2nd International Conference on Communication Systems Software and Middleware10.1109/COMSWA.2007.382435(1-8)Online publication date: Jan-2007
https://doi.org/10.1109/COMSWA.2007.382435

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Optimal control of parallel queues with impatient customers

Control of a Heterogeneous Two-Server Exponential Queueing System

A Two-Queue Polling Model with Two Priority Levels in the First Queue

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations