Article

A Lightweight Middleware Monitor for Distributed Scientific Workflows

Authors:

Sergio Manuel Serra da Cruz,

Fabricio Nogueira da Silva,

Luiz M. R. Gadelha Jr.,

Maria Claudia Reis Cavalcanti,

Maria Luiza M. Campos,

Marta MattosoAuthors Info & Claims

CCGRID '08: Proceedings of the 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid

Pages 693 - 698

https://doi.org/10.1109/CCGRID.2008.89

Published: 19 May 2008 Publication History

Publisher Site

Abstract

Monitoring the execution of distributed tasks within the workflow execution is not easy and is frequently controlled manually. This work presents a lightweight middleware monitor to design and control the parallel execution of tasks from a distributed scientific workflow. This middleware can be connected into a workflow management system. This middleware implementation is evaluated with the Kepler workflow management system, by including new modules to control and monitor the distributed execution of the tasks. These middleware modules were added to a bioinformatics workflow to monitor parallel BLAST executions. Results show potential to high performance process execution while preserving the original features of the workflow.

Cited By

View all

Deelman ECarothers CMandal ATierney BVetter JBaldin ICastillo CJuve GKról DLynch VMayer BMeredith JProffen TRuth PFerreira da Silva R(2017)PANORAMAInternational Journal of High Performance Computing Applications10.1177/109434201559451531:1(4-18)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1177/1094342015594515
Xu RLiu XXie YYuan DYang YZhang HHuang LRichardson I(2014)A gaussian fields based mining method for semi-automating staff assignment in workflow applicationProceedings of the 2014 International Conference on Software and System Process10.1145/2600821.2600843(178-182)Online publication date: 26-May-2014
https://dl.acm.org/doi/10.1145/2600821.2600843
Juve GChervenak ADeelman EBharathi SMehta GVahi K(2013)Characterizing and profiling scientific workflowsFuture Generation Computer Systems10.1016/j.future.2012.08.01529:3(682-692)Online publication date: 1-Mar-2013
https://dl.acm.org/doi/10.1016/j.future.2012.08.015
Show More Cited By

Index Terms

Recommendations

Workflows and e-Science: An overview of workflow system features and capabilities

Scientific workflow systems have become a necessary tool for many applications, enabling the composition and execution of complex analysis on distributed resources. Today there are many workflow systems, often with overlapping functionality. A key issue ...
Monitoring of Grid scientific workflows
Large-Scale Programming Tools and Environments

Scientific workflows are a means of conducting in silico experiments in modern computing infrastructures for e-Science, often built on top of Grids. Monitoring of Grid scientific workflows is essential not only for performance analysis but also to ...
Understanding workflows for distributed computing: nitty-gritty details
WORKS '13: Proceedings of the 8th Workshop on Workflows in Support of Large-Scale Science

Scientific workflow management is heavily used in our organization. After six years, a large number of workflows are available and regularly used to run biomedical data analysis experiments on distributed infrastructures, mostly on grids. In this paper ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CCGRID '08: Proceedings of the 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid

May 2008

817 pages

ISBN:9780769531564

Publisher

IEEE Computer Society

United States

Publication History

Published: 19 May 2008

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Deelman ECarothers CMandal ATierney BVetter JBaldin ICastillo CJuve GKról DLynch VMayer BMeredith JProffen TRuth PFerreira da Silva R(2017)PANORAMAInternational Journal of High Performance Computing Applications10.1177/109434201559451531:1(4-18)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1177/1094342015594515
Xu RLiu XXie YYuan DYang YZhang HHuang LRichardson I(2014)A gaussian fields based mining method for semi-automating staff assignment in workflow applicationProceedings of the 2014 International Conference on Software and System Process10.1145/2600821.2600843(178-182)Online publication date: 26-May-2014
https://dl.acm.org/doi/10.1145/2600821.2600843
Juve GChervenak ADeelman EBharathi SMehta GVahi K(2013)Characterizing and profiling scientific workflowsFuture Generation Computer Systems10.1016/j.future.2012.08.01529:3(682-692)Online publication date: 1-Mar-2013
https://dl.acm.org/doi/10.1016/j.future.2012.08.015
Gunter DDeelman ESamak TBrooks CGoode MJuve GMehta GMoraes PSilva FSwany MVahi KChemouil PMehaoua AFestor OLupu E(2011)Online workflow management and performance analysis with stampedeProceedings of the 7th International Conference on Network and Services Management10.5555/2147671.2147695(152-161)Online publication date: 24-Oct-2011
https://dl.acm.org/doi/10.5555/2147671.2147695
Samak TGunter DGoode MDeelman EMehta GSilva FVahi KTaylor IMontagnat J(2011)Failure prediction and localization in large scientific workflowsProceedings of the 6th workshop on Workflows in support of large-scale science10.1145/2110497.2110510(107-116)Online publication date: 14-Nov-2011
https://dl.acm.org/doi/10.1145/2110497.2110510

Abstract

Cited By

Index Terms

Recommendations

Workflows and e-Science: An overview of workflow system features and capabilities

Monitoring of Grid scientific workflows

Understanding workflows for distributed computing: nitty-gritty details

Comments

Information

Published In

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Share

Share this Publication link

Share on social media

Affiliations