More Web Proxy on the site http://driver.im/

research-article

Reducing allocation errors in network testbeds

Authors:

Jelena Mirkovic,

Alefiya HussainAuthors Info & Claims

IMC '12: Proceedings of the 2012 Internet Measurement Conference

Pages 495 - 508

https://doi.org/10.1145/2398776.2398828

Published: 14 November 2012 Publication History

Abstract

Network testbeds have become widely used in computer science, both for evaluation of research technologies and for hands-on teaching. This can naturally lead to oversubscription and resource allocation failures, as limited testbed resources cannot meet the increasing demand.

This paper examines the causes of resource allocation failures on DeterLab testbed and finds three main culprits that create perceived resource oversubscription, even when available nodes exist: (1) overuse of mapping constraints by users, (2) testbed software errors and (3) suboptimal resource allocation. We propose solutions that could resolve these issues and reduce allocation failures to 57.3% of the baseline. In the remaining cases, real resource oversubscription occurs. We examine testbed usage patterns and show that a small fraction of unfair projects starve others for resources under the current first-come-first-served allocation policy. Due to interactive use of testbeds traditional fair-sharing techniques are not suitable solutions. We then propose two novel approaches -- Take-a-Break and Borrow-and-Return -- that temporarily pause long-running experiments. These approaches can reduce resource allocation failures to 25% of the baseline case by gently prolonging 1-2.5% of instances. While our investigation is done on DeterLab testbed's data, it should apply to all testbeds that run Emulab software.

Supplementary Material

PDF File (61.pdf)

Summary Review Documentation for "Reducing Allocation Failures in Network Testbeds", Authors: J. Mirkovic, H. Shi, A. Hussain

Download
66.87 KB

References

[1]

Other Emulab Testbeds. https://users.emulab.net/trac/emulab/wiki/OtherEmulabs.

[2]

Schooner WAIL (Wisconsin Advanced Internet Laboratory). http://www.schooner.wail.wisc.edu.

[3]

R. Bajcsy, T. Benzel, M. Bishop, et al. Cyber Defense Technology Networking and Evaluation. Communications of the ACM, 2004.

Digital Library

[4]

S. M. Banik, L. P. Daigle, and T. H. Chang. Implementation and Empirical Evaluations of Floor Control Protocols on Planetlab Network. In Proceedings of the 47th Annual Southeast Regional Conference, ACM-SE 47, 2009.

Digital Library

[5]

T. Benzel. The Science of Cyber Security Experimentation: The DETER Project. In Proc. of 2011 Annual Computer Security Applications Conference (ACSAC), December 2012.

Digital Library

[6]

N. M. M. K. Chowdhury, M.R. Rahman, and R. Boutaba. Virtual network embedding with coordinated node and link mapping. In Proc. of INFOCOM 2009, pages 783--791, 2009.

[7]

B. Chun, D. Culler, et al. Planetlab: an Overlay Testbed for Broad-coverage Services. ACM SIGCOMM Computer Communication Review, 33(3):3--12, 2003.

Digital Library

[8]

Ali Ghodsi, Matei Zaharia, Benjamin Hindman, Andy Konwinski, Scott Shenker, and Ion Stoica. Dominant resource fairness: Fair allocation of multiple resource types. In Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation, 2011.

Digital Library

[9]

F. Hermenier and R. Ricci. How to Build a Better Testbed: Lessons From a Decade of Network Experiments on Emulab. In TridentCom, 2012.

[10]

J.P. Herron, L. Fowler, and C. Small. The GENI Meta-Operations Center. In Proc. of IEEE Conf. on eScience, pages 384--385. IEEE Computer Society, 2008.

Digital Library

[11]

Benjamin Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony D. Joseph, Randy Katz, Scott Shenker, and Ion Stoica. Mesos: a platform for fine-grained resource sharing in the data center. In Proceedings of the 8th USENIX conference on Networked Systems Design and Implementation, 2011.

Digital Library

[12]

B. W. Kernighan and S. Lin. An Efficient Heuristic Procedure for Partitioning Graphs. The Bell system technical journal, 49(1):291--307, 1970.

[13]

W. Kim, A. Roopakalu, K.Y. Li, and V.S. Pai. Understanding and Characterizing PlanetLab Resource Usage for Federated Network Testbeds. In Proc. of the ACM SIGCOMM, pages 515--532. ACM, 2011.

Digital Library

[14]

S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi. Optimization by Simulated Annealing. Science, 220(4598):671--680, 1983.

[15]

J. Lu and J. Turner. Efficient mapping of virtual networks onto a shared substrate. Washington University in St. Louis, Tech. Rep, 2006.

[16]

A. Medina, A. Lakhina, I. Matta, et al. BRITE: An Approach to Universal Topology Generation. In Proc. of MASCOTS, pages 346--. IEEE Computer Society, 2001.

Digital Library

[17]

Dejan S. Milojicic, Fred Douglis, Yves Paindaveine, Richard Wheeler, and Songnian Zhou. Process migration. ACM Comput. Surv., 32(3):241--299, September 2000.

Digital Library

[18]

T. Miyachi, K. Chinen, and Y. Shinoda. Automatic Configuration and Execution of Internet Experiments on an Actual Node-based Testbed. In Proc. of Tridentcom, 2005.

Digital Library

[19]

J. Nakata, S. Uda, T. Miyaclii, et al. Starbed2: Large-scale, Realistic and Real-time Testbed for Ubiquitous Networks. In Proc. of TridentCom, 2007.

[20]

R. Ricci, C. Alfeld, and J. Lepreau. A Solver for the Network Testbed Mapping Problem. SIGCOMM Comput. Commun. Rev., 33(2):65--81, 2003.

Digital Library

[21]

M. Ripeanu, M. Bowman, S. Chase, et al. Globus and Planetlab Resource Management Solutions Compared. In Proc. of International Symposium on High Performance Distributed Computing, pages 246 -- 255, 2004.

Digital Library

[22]

I. Stoica, S. Shenker, and H. Zhang. Core-stateless Fair Queueing: a Scalable Architecture to Approximate Fair Bandwidth Allocations in High-speed Networks. IEEE/ACM Trans. Netw., 11(1):33--46, 2003.

Digital Library

[23]

Douglas Thain, Todd Tannenbaum, and Miron Livny. Distributed Computing in Practice: the Condor Experience. Concurrency - Practice and Experience, 17(2--4):323--356, 2005.

Digital Library

[24]

B. White, J. Lepreau, L. Stoller, et al. An Integrated Experimental Environment for Distributed Systems and Networks. In Proc. of OSDI, pages 255--270, December 2002.

Digital Library

[25]

M. Yu, Y. Yi, J. Rexford, and M. Chiang. Rethinking Virtual Network Embedding: Substrate Support for Path Splitting and Migration. ACM SIGCOMM Comp. Comm. Rev., 38(2):17--29, 2008.

Digital Library

Cited By

Mirkovic JBartlett GBlythe JCollberg CPeterson P(2018)DEWProceedings of the 11th USENIX Conference on Cyber Security Experimentation and Test10.5555/3307412.3307416(4-4)Online publication date: 13-Aug-2018
https://dl.acm.org/doi/10.5555/3307412.3307416
Curran MRahman MGupta HSekar V(2018)Rethinking Virtual Network Embedding in Reconfigurable Networks2018 15th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON)10.1109/SAHCN.2018.8397143(1-9)Online publication date: Jun-2018
https://doi.org/10.1109/SAHCN.2018.8397143
Cao LBu XFahmy SCao S(2017)Towards High Fidelity Network Emulation2017 26th International Conference on Computer Communication and Networks (ICCCN)10.1109/ICCCN.2017.8038453(1-11)Online publication date: Jul-2017
https://doi.org/10.1109/ICCCN.2017.8038453
Show More Cited By

Index Terms

Reducing allocation errors in network testbeds
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
2. Networks

Recommendations

Resource reconstruction algorithms for on-demand allocation in virtual computing resource pool

Resource reconstruction algorithms are studied in this paper to solve the problem of resource on-demand allocation and improve the efficiency of resource utilization in virtual computing resource pool. Based on the idea of resource virtualization and ...
Understanding and characterizing PlanetLab resource usage for federated network testbeds
IMC '11: Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference

Global network testbeds are crucial for innovative network research. Built on the success of PlanetLab, the next generation of federated testbeds are under active development, but very little is known about resource usage in the shared infrastructures. ...
Resource Allocation and Optimization Based on Queuing Theory and BP Network
Neural Information Processing
Abstract
In this article, we present a resource allocation and optimization strategy for data center based on resource utilization prediction with back-propagation (BP) neural network, aiming to improve the resource utilization. We handle resource ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

IMC '12: Proceedings of the 2012 Internet Measurement Conference

November 2012

572 pages

ISBN:9781450317054

DOI:10.1145/2398776

General Chairs:
John Byers
Boston University
,
Jim Kurose
University of Massachusetts Amherst
,
Program Chairs:
Ratul Mahajan
Microsoft Research
,
Alex C. Snoeren
UC San Diego

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMETRICS: ACM Special Interest Group on Measurement and Evaluation
SIGCOMM: ACM Special Interest Group on Data Communication
USENIX Assoc: USENIX Assoc

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

IMC '12

Sponsor:

SIGMETRICS
SIGCOMM
USENIX Assoc

IMC '12: Internet Measurement Conference

November 14 - 16, 2012

Massachusetts, Boston, USA

Acceptance Rates

Overall Acceptance Rate 277 of 1,083 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
158
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mirkovic JBartlett GBlythe JCollberg CPeterson P(2018)DEWProceedings of the 11th USENIX Conference on Cyber Security Experimentation and Test10.5555/3307412.3307416(4-4)Online publication date: 13-Aug-2018
https://dl.acm.org/doi/10.5555/3307412.3307416
Curran MRahman MGupta HSekar V(2018)Rethinking Virtual Network Embedding in Reconfigurable Networks2018 15th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON)10.1109/SAHCN.2018.8397143(1-9)Online publication date: Jun-2018
https://doi.org/10.1109/SAHCN.2018.8397143
Cao LBu XFahmy SCao S(2017)Towards High Fidelity Network Emulation2017 26th International Conference on Computer Communication and Networks (ICCCN)10.1109/ICCCN.2017.8038453(1-11)Online publication date: Jul-2017
https://doi.org/10.1109/ICCCN.2017.8038453
Schlinker BZarifis KCunha IFeamster NKatz-Bassett EKatz-Bassett EHeidemann JGodfrey BFeldmann A(2014)PEERINGProceedings of the 13th ACM Workshop on Hot Topics in Networks10.1145/2670518.2673887(1-7)Online publication date: 27-Oct-2014
https://dl.acm.org/doi/10.1145/2670518.2673887

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents