column

NEPI: using independent simulators, emulators, and testbeds for easy experimentation

Authors:

Walid DabbousAuthors Info & Claims

ACM SIGOPS Operating Systems Review, Volume 43, Issue 4

Pages 60 - 65

https://doi.org/10.1145/1713254.1713268

Published: 27 January 2010 Publication History

Get Access

Abstract

Evaluating new network protocols, applications, and architectures uses many kinds of experimentation environments: simulators, emulators, testbeds, and sometimes, combinations of these. As the functionality and complexity of these tools increases, mastering and efficiently using each of them is becoming increasingly difficult.

In this paper, we consider how to make it easier to use multiple tools separately and together to improve the productivity of network researchers. We show how a single object model which encompasses every aspect of a typical experimentation workow can be used to completely describe experiments to be run within very different experimentation environments.

Although Nepi is still in early design and prototyping stage, we expect that its ability to describe and automate easily complex mixed experiments will enable further experimentation with heterogenous networks.

References

[1]

Leonini, Riviere, and Felber. "SPLAY: Distributed Systems Evaluation Made Simple." Proc. of the 6th USENIX Symposium on Networked Systems Design and Implementation.

Digital Library

Google Scholar

[2]

Albrecht, Braud, Dao, Topilski, Tuttle, Snoeren, and Vahdat. "Remote Control: Distributed Application Configuration, Management, and Visualization with Plush" Proc. of the 21st conference on Large Installation System Administration.

Digital Library

Google Scholar

[3]

Bavier, Bowman, Chun, Culler, Karlin, Muir, Peterson, Roscoe, Spalink, and Wawrzoniak. "Operating System Support for Planetary-Scale Network Services." Proc. of the First Symposium on Networked Systems Design and Implementation.

Digital Library

Google Scholar

[4]

Vahdat, Yocum, Walsh, Mahadevan, Kostic, Chase, and Becker. "Scalability and Accuracy in a Large-Scale Network Emulator" Proc. of the 5th Symposium on Operating Systems Design and Implementation.

Digital Library

Google Scholar

[5]

Raychaudhuri, Seskar, Ott, Ganu, Ramachandran, Kremo, Siracusa, Liu and Singh. "Overview of the ORBIT radio grid testbed for evaluation of next-generation wireless network protocols." Proc. of the Wireless Communications and Networking Conference.

Google Scholar

[6]

OMF: http://omf.mytestbed.net

Google Scholar

[7]

White, Lepreau, Stoller, Ricci, Guruprasad, Newbold, Hibler, Barb, Joglekar. "An Integrated Experimental Environment for Distributed Systems and Networks." Proc. of the 5th Symposium on Operating Systems Design and Implementation.

Digital Library

Google Scholar

[8]

Ahrenholz, Danilov, Henderson, and Kim. "CORE: A real-time network emulator" Proc. of the IEEE Military Communications Conference, 2008.

Google Scholar

[9]

ns-3: http://www.nsnam.org

Google Scholar

[10]

Varga, András. "The OMNeT++ Discrete Event Simulation System" Proc. of the European Simulation Multiconference, 2001.

Google Scholar

Cited By

View all

de Resende HSchimuneck MBoth CWickboldt JMarquez-Barja J(2020)COPA: Experimenter-Level Container Orchestration for Networking TestbedsIEEE Access10.1109/ACCESS.2020.30356198(201781-201798)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3035619
Zhang TZhao SCheng BRen BChen J(2018)FEP: High Fidelity Experiment Platform for Mobile NetworksIEEE Access10.1109/ACCESS.2018.27939436(3858-3871)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2793943
Sardara MMuscariello LAugé JEnguehard MCompagno ACarofiglio GSchmidt TSeedorf J(2017)Virtualized ICN (vICN)Proceedings of the 4th ACM Conference on Information-Centric Networking10.1145/3125719.3125726(109-115)Online publication date: 26-Sep-2017
https://dl.acm.org/doi/10.1145/3125719.3125726
Show More Cited By

Recommendations

nepi-ng: An Efficient Experiment Control Tool in R2lab
WiNTECH '18: Proceedings of the 12th International Workshop on Wireless Network Testbeds, Experimental Evaluation & Characterization

Experimentation is an essential step for realistic evaluation of wireless network protocols. The evaluation methodology entails controllable environment conditions and a rigorous and efficient experiment control and orchestration for a variety of ...
Making Things Smart: Easy Embedded JavaScript Programming for Making Everyday Objects into Intelligent Machines
Applying and Exploring Bayesian Hypothesis Testing for Large Scale Experimentation in Online Tutoring Systems
L@S '17: Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale

This paper demonstrates the viability of using Bayesian hypothesis testing for statistical analysis of experiments run in online learning systems. An empirical Bayesian method for learning a genuine prior from past historical experiment data is applied ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGOPS Operating Systems Review

ACM SIGOPS Operating Systems Review Volume 43, Issue 4

January 2010

105 pages

ISSN:0163-5980

DOI:10.1145/1713254

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 January 2010

Published in SIGOPS Volume 43, Issue 4

Check for updates

Qualifiers

Column

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
242
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

de Resende HSchimuneck MBoth CWickboldt JMarquez-Barja J(2020)COPA: Experimenter-Level Container Orchestration for Networking TestbedsIEEE Access10.1109/ACCESS.2020.30356198(201781-201798)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3035619
Zhang TZhao SCheng BRen BChen J(2018)FEP: High Fidelity Experiment Platform for Mobile NetworksIEEE Access10.1109/ACCESS.2018.27939436(3858-3871)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2793943
Sardara MMuscariello LAugé JEnguehard MCompagno ACarofiglio GSchmidt TSeedorf J(2017)Virtualized ICN (vICN)Proceedings of the 4th ACM Conference on Information-Centric Networking10.1145/3125719.3125726(109-115)Online publication date: 26-Sep-2017
https://dl.acm.org/doi/10.1145/3125719.3125726
Tsai PPiccialli FTsai CLuo MYang C(2017)Control frameworks in network emulation testbeds: A surveyJournal of Computational Science10.1016/j.jocs.2017.03.00322(148-161)Online publication date: Sep-2017
https://doi.org/10.1016/j.jocs.2017.03.003
Quereilhac ASaucez DTurletti TDabbous WGamess EBarnes PTazaki HBaldo N(2015)Automating ns-3 experimentation in multi-host scenariosProceedings of the 2015 Workshop on ns-310.1145/2756509.2756513(1-8)Online publication date: 13-May-2015
https://dl.acm.org/doi/10.1145/2756509.2756513
Buchert TRuiz CNussbaum LRichard O(2015)A survey of general-purpose experiment management tools for distributed systemsFuture Generation Computer Systems10.1016/j.future.2014.10.00745:C(1-12)Online publication date: 1-Apr-2015
https://dl.acm.org/doi/10.1016/j.future.2014.10.007
Keranidis SGiatsios DKorakis TKoutsopoulos ITassiulas LRakotoarivelo TOtt MParmentelat T(2014)Experimentation on end-to-end performance aware algorithms in the federated environment of the heterogeneous PlanetLab and NITOS testbedsComputer Networks10.1016/j.bjp.2013.12.02663(48-67)Online publication date: Apr-2014
https://doi.org/10.1016/j.bjp.2013.12.026
Khan SAziz BNajeeb SAhmed AUsman MUllah S(2013)Reliability of network simulators and simulation based research2013 IEEE 24th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC)10.1109/PIMRC.2013.6666127(180-185)Online publication date: Sep-2013
https://doi.org/10.1109/PIMRC.2013.6666127
Gavras ABak ABiczók GGajowniczek PGulyás AHrasnica HMartinez-Julia PNémeth FPapagianni CPapavassiliou SPilarski MSkarmeta A(2013)Heterogeneous Testbeds, Tools and Experiments –Measurement Requirements PerspectiveMeasurement Methodology and Tools10.1007/978-3-642-41296-7_9(139-158)Online publication date: 2013
https://doi.org/10.1007/978-3-642-41296-7_9
Léone RLeguay JMedagliani PChaudet C(2013)Demo Abstract: MakeSense—Managing Reproducible WSNs ExperimentsReal-World Wireless Sensor Networks10.1007/978-3-319-03071-5_7(65-71)Online publication date: 20-Dec-2013
https://doi.org/10.1007/978-3-319-03071-5_7
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

nepi-ng: An Efficient Experiment Control Tool in R2lab

Making Things Smart: Easy Embedded JavaScript Programming for Making Everyday Objects into Intelligent Machines

Applying and Exploring Bayesian Hypothesis Testing for Large Scale Experimentation in Online Tutoring Systems