User-friendly scheduling tools for large-scale simulation experiments
Pages 610 - 616
Abstract
Planning and steering numerical experiments that involve many simulations are difficult tasks to automate. We describe how a simulation scheduling tool can help experimenters submit and revoke simulation jobs on the basis of the most up to date partial results and resource estimates. We show how ideas such as pre- and post-conditions; interrupt handling; rapid experiment schema creation; and sparse parameter cross-products can be used to make a generalisable and user-friendly scheduling toolset. We describe our prototype in the context of typical long-running computational experiments of a complex networks simulation problem.
References
[1]
Abramson, D., J. Giddy, and L. Kotler. 2000, May. High performance parametric modeling with nimrod/g: Killer application for the global grid? In Proc. Int. Parallel and Distributed Processing Symp (IPDPS), 520--528.
[2]
Abramson, D., R. Sosic, J. Giddy, and B. Hall. 1995, August. Nimrod: A tool for performing parameterised simulations using distributed workstations. In Proc. 4th IEEE Symp. High Performance Distributed Computing. Virginia.
[3]
Altair Grid Technologies Available at <http://www.openpbs.org> last visited 2007. Portable Batch System.
[4]
Angel, M. 1996. Conducting experiments with experiment manager. In Proc 1996 Winter Simulation Conference, ed. J. M. Charnes, D. J. Morrice, D. T. Brunner, and J. J. Swain, 535--541.
[5]
Apple Computer Inc Available at <http://developer.apple.com/hardwaredrivers/hpc/xgrid_intro.html> last visited 2007. Xgrid: High performance computing for the rest of us.
[6]
Epperson, J. E., K. A. Hawick, C. G. Windsor, and V. S. Rainey. 1990, Nov. A small angle neutron scattering investigation of phase separation in an Fe-Cr-Ni alloy. In Proc. Materials Research Society Meeting. Boston, USA: Materials Research Society. Symposium F.
[7]
Feynman, R. P., R. Leighton, and E. Hutchings. 1997. Surely You're Joking, Mr. Feynman! (Adventures of a Curious Character). ISBN 0393316041: W. W. Norton & Company.
[8]
FlowGrid Consortium 2004. FlowGrid Project available from <http://www.unizar.es/flowgrid/>.
[9]
Foster, I., and C. Kesselman. (Eds.) 1999. The grid: Blueprint for a new computing infrastructure. Morgan Kaufmann Publishers, Inc. ISBN 1-55860-475-8.
[10]
Fox, G. C., R. D. Williams, and P. C. Messina. 1994. Parallel computing works! Morgan Kaufmann Publishers, Inc. ISBN 1-55860-253-4.
[11]
Hawick, K. A., J. E. Epperson, C. G. Windsor, and V. S. Rainey. 1990, Nov. Chemical phase separation in binary Iron-Chromium alloys. In Proc. Materials Research Society Meeting. Boston, USA: Materials Research Society. Symposium F.
[12]
Hawick, K. A., and H. A. James. 2006. Ising model scaling behaviour on z-preserving small-world networks arxiv:cond-mat/0611763.
[13]
James, H. A., and K. A. Hawick. 1998, February. A web-based interface for on-demand processing of satellite imagery archives. In Proc. 21st Australasian Computer Science Conf. ACSC'98, ed. C. McDonald, Volume 20 of Australian Computer Science Communications: Springer-Verlag Pte Ltd.
[14]
James, H. A., and K. A. Hawick. 2005. Scientific data management in a grid environment. J. Grid Computing 3:39--51.
[15]
James, H. A., and K. A. Hawick. 2007. Computational data structures for high-performance complex network-based small-world simulations. submitted to ACM Transactions on Modeling and Computer Simulation.
[16]
Medawar, P. 1988. Memoir of a thinking radish. ISBN 0192829834: Oxford University Press.
[17]
Object Management Group (OMG) 2006, June. Object Contraint Language Specification 2.0 available from <http://www.omg.org>.
[18]
Persson, A., H. Grimm, and A. Ng. 2006. On-line instrumentation for simulation-based optimization. In Proceedings of the 2006 Winter Simulation Conference, ed. L. F. Perrone, F. P. Wieland, J. Liu, B. G. Lawson, D. M. Nicol, and R. M. Fujimoto.
[19]
Python Software Foundation 2007. The python programming language.
[20]
Smarr, L., and C. E. Catlett. 1992, June. Metacomputing. Communications of the ACM 35 (6): 44--52.
[21]
STARLIMS Corporation 2007. STARLIMS Laboratory Information Management System. available from <http://www.starlims.com>.
Recommendations
Simulation Based Job Scheduling Optimization for Batch Workloads
ICPE '19: Proceedings of the 2019 ACM/SPEC International Conference on Performance EngineeringWe present a simulation based approach for scheduling jobs that are part of a batch workflow. Our objective is to minimize the makespan, defined as completion time of the last job to leave the system in a batch workflow with dependencies. The existing ...
Modelling and developing conflict-aware scheduling on large-scale data centres
AbstractLarge-scale data centres are the growing trend for modern computing systems. Since a large-scale data centre has to manage a large number of machines and jobs, deploying multiple independent schedulers (termed as distributed schedulers in ...
Highlights- Propose a method to quantify the relation between the scheduling conflicts and the resource demands.
- Develop a game-theoretical solution for the distributed schedulers in large scale data centres.
- Design and conduct both simulation ...
Complex simulation experiments made easy
WSC '18: Proceedings of the 2018 Winter Simulation ConferenceDiverse methods for complex simulation experiments can contribute to developing and gaining insights into simulation models, for example simulation-based optimization, sensitivity analysis, or statistical model-checking. An effective tool for conducting ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Sponsors
- IIE: Institute of Industrial Engineers
- INFORMS-SIM: Institute for Operations Research and the Management Sciences: Simulation Society
- ASA: American Statistical Association
- IEEE/SMC: Institute of Electrical and Electronics Engineers: Systems, Man, and Cybernetics Society
- SIGSIM: ACM Special Interest Group on Simulation and Modeling
- NIST: National Institute of Standards and Technology
- (SCS): The Society for Modeling and Simulation International
Publisher
IEEE Press
Publication History
Published: 09 December 2007
Check for updates
Qualifiers
- Research-article
Conference
WSC07
Sponsor:
- IIE
- INFORMS-SIM
- ASA
- IEEE/SMC
- SIGSIM
- NIST
- (SCS)
Acceptance Rates
WSC '07 Paper Acceptance Rate 152 of 244 submissions, 62%;
Overall Acceptance Rate 3,413 of 5,075 submissions, 67%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 102Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 01 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in