More Web Proxy on the site http://driver.im/

research-article

Transparent grid enablement of weather research and forecasting

MG '08: Proceedings of the 15th ACM Mardi Gras conference: From lightweight mash-ups to lambda grids: Understanding the spectrum of distributed computing requirements, applications, tools, infrastructures, interoperability, and the incremental adoption of key capabilities

Article No.: 39, Pages 1 - 8

https://doi.org/10.1145/1341811.1341854

Published: 29 January 2008 Publication History

Abstract

The impact of hurricanes is so devastating throughout different levels of society that there is a pressing need to provide a range of users with accurate and timely information that can enable effective planning for and response to potential hurricane landfalls. The Weather Research and Forecasting (WRF) code is the latest numerical model that has been adopted by meteorological services worldwide. The current version of WRF has not been designed to scale out of a single organization's local computing resources. However, the high resource requirements of WRF for fine-resolution and ensemble forecasting demand a large number of computing nodes, which typically cannot be found within one organization. Therefore, there is a pressing need for the Grid-enablement of the WRF code such that it can utilize resources available in partner organizations. In this paper, we present our research on Grid enablement of WRF by leveraging our work in transparent shaping, GRID superscalar, profiling, code inspection, code modeling, meta-scheduling, and job flow management.

References

[1]

The Weather Research & Forecasting Model, http://www.wrfmodel.org/index.php.

[2]

Patrick T. Welsh and Peter Bogenschutz. Weather Research and Forecast (WRF) Model: Precipitation Prognostics from the WRF Model during Recent Tropical Cyclones, 59th Interdepartmental Hurricane Conference, March 7--11, 2005 Jacksonville, FL.

[3]

S. M. Sadjadi et al. Improving separation of concerns in the development of scientific applications. In Proceedings of The Nineteenth International Conference on Software Engineering and Knowledge Engineering, pages 456--461, Boston, USA, 2007.

[4]

S. M. Sadjadi, P. K. McKinley, and B. Cheng. Transparent shaping of existing software to support pervasive and autonomic computing. In Proceedings of the first Workshop on the Design and Evolution of Autonomic Application Software 2005, in conjunction with ICSE 2005, St. Louis, Missouri, May 2005.

Digital Library

[5]

R. Badia, R. Sirvent, J. Labarta, and J. Perez. Programming the GRID: An Imperative Language Based Approach. Book chapter in Engineering the Grid, Section 4, Chapter 12, Jan. 2006.

[6]

S. Shimizu, R. Rangaswami, and H. Duran-Limon. "Platform-independent Modeling and Prediction of Application Resource Usage Characteristics", Florida International University Technical Report FIU-SCIS-TR-2007-07-05, July 2007.

[7]

L. Fong et al. The LA Grid meta-scheduling project. In the poster presentation session of the 5th Latin American Grid (LA Grid) Summit, The IBM T. J. Watson Research Center, NY, U.S.A., September 2007.

[8]

G. Dasgupta et al. Fault-tolerant job-flow management in grid environment. In the poster presentation session of the 5th Latin American Grid (LA Grid) Summit, The IBM T. J. Watson Research Center, NY, U.S.A., September 2007.

[9]

S. M. Sadjadi et al. The Latin American Grid (LA Grid) Weather Research and Forecast (WRF) Portal. In the poster presentation session of the 5th Latin American Grid Summit, The IBM T. J. Watson Research Center, NY, U.S.A., September 2007.

[10]

Chen, S. S., J. F. Price, W. Zhao, M. A. Donelan, and E. J. Walsh, 2007: The CBLAST-Hurricane Program and the next-generation fully coupled atmosphere-wave-ocean models for hurricane research and prediction. Bull. Amer. Meteor. Soc, 88, 311--317.

[11]

Houze, R. A., S. S. Chen, B. Smull, W.-C. Lee, M. Bell, 2007: Hurricane intensity and eyewall replacement. Science, 315, 1235--1239.

[12]

Davis, C., W. Wang, S. S. Chen, Y. Chen, K. Corbosiero, M. DeMaria, J. Dudhia, G. Holland, J. Klemp, J. Michalakes, H. Reeves, R. Rotunno1, and Q. Xiao, 2007: Prediction of landfalling hurricanes with the Advanced Hurricane WRF Model, Mon. Wea. Rev., in press.

[13]

T. N. Krishnamurti et al. Improved Weather and Seasonal Climate Forecasts from Multimodel Superensemble, Science 3, Vol. 285. no. 5433, 1548--1550 pp, 1999.

[14]

V. Kumar et al. Multimodel Superensemble Forecasting of Tropical Cyclones in the Pacific, Mon Wea Rev., 131, 574--583, 2003.

[15]

W. C. Eric et al. Real-Time Multimodel Superensemble Forecasts of Atlantic Tropical Systems of 1999, Mon Wea Rev, 131, 1878--1894, 2003.

[16]

Wolfgang Emmerich. Engineering Distributed Objects. John Wiley & Sons, Apr. 2000.

Digital Library

[17]

The Globus Project (Globus Alliance)", http://www.globus.org

[18]

Legion Web Site. http://legion.virginia.edu

[19]

M. Litzkow, M. Livny, and M. Mutka. "Condor - A Hunter of Idle Workstations", Proc. of the 8th International Conference of Distributed Computing Systems (ICDCS 1988), January 1988, San Jose, CA, IEEE CS Press, USA, 1998.

[20]

A. Anjomshoaa, M. Drescher, et. al. "Job Submission Description Language (JSDL) Specification"; Version 1.0, 2005.

[21]

V. Gucer, J. Biggs-Finstad, et. al. "Getting Started with Tivoli Dynamic Workload Broker 1.1". www.redbooks.ibm.com, SG24-7442-00.

[22]

GridWay Web Site. http://www.gridway.org

[23]

I. Rodero, R. M. Badia, J. Corbalan, J. Labarta, "eNANOS Grid Resource Broker", European Grid Conference 2005, LNCS 3470, Amsterdam, Netherlands, 14--16 Feb., 2005, pp. 111-121.

Digital Library

[24]

O. Ezenwoye and S. M. Sadjadi. Composing aggregate Web services in BPEL. In Proceedings of the 44th ACM Southeast Conference (ACMSE 2006), Melbourne, Florida, March 2006.

Digital Library

[25]

O. Ezenwoye and S. M. Sadjadi. TRAP/BPEL: A framework for dynamic adaptation of composite services. In Proceedings of the International Conference on Web Information Systems and Technologies (WEBIST 2007), Barcelona, Spain, March 2007.

[26]

S. M. Sadjadi, P. K. McKinley, B. Cheng, and R. Stirewalt. TRAP/J: Transparent generation of adaptable Java programs. In Proceedings of the International Symposium on Distributed Objects and Applications, Agia Napa, Cyprus, October 2004.

[27]

S. M. Sadjadi et al. Finding an appropriate profiler for the weather research and forecasting code. Technical Report FIU-SCIS-2007-09-03, School of Computing and Information Sciences, Florida International University, 11200 SW 8th St., Miami, FL 33199, August 2007.

[28]

Sameer S. Shende and Allen D. Malony. "The Tau Parallel Performance System," International Journal of High Performance Computing Applications. 2006; 20; 287.

Digital Library

[29]

IBM HPC Toolkit. https://domino.research.ibm.com/comm/research_projects.nsf/pages/actc.index.html.

[30]

Vincent Pillet, Jesus Labarta, Toni Cortes and Sergi Girona. "PARAVER: A Tool to Visualize and Analyze Parallel Code," CEPBA/UPC Report No. RR-95/03 February 1995.

[31]

O'Reilly, T. "What Is Web 2.0 - Design Patterns and Business Models for the Next Generation of Software," http://www.oreillynet.com/pub/a/oreilly/tim/news/2005/09/30/what-is-web-20.html, 09/30/2005.

[32]

Yahoo UI, http://developer.yahoo.com/yui/

[33]

Google Maps, http://www.google.com/apis/maps/

[34]

PostgreSQL, http://www.postgresql.org/

[35]

Global Forecast System, http://en.wikipedia.org/wiki/Global_Forecast_System

[36]

VisAD, http://www.ssec.wisc.edu/~billh/visad.html

[37]

CPUlimit - CPU Usage Limiter for Linux: http://CPUlimit.sourceforge.net. Sept. 15 2007.

[38]

S. M. Sadjadi et al. Weather research and forecasting model 2.2 documentation: A step-by-step guide of a model run. Technical Report FIU-SCIS-2007-09-02, Florida International University, 11200 SW 8th St., Miami, FL 33199, August 2007.

[39]

R. Badia et al. HPC and Grids in Action, chapter Innovative Grid Technologies Applied to Bioinformatics and Hurricane Mitigation. IOS Press, Amsterdam, 2007.

Cited By

Almeida ECampos Velho HPreto A(2013)Challenges for mesoscale climatology execution on experimental grid computing systemsJournal of the Brazilian Computer Society10.1007/s13173-013-0099-519:3(279-290)Online publication date: 22-Feb-2013
https://doi.org/10.1007/s13173-013-0099-5
Rodero IVillegas DBobroff NLiu YFong LSadjadi S(2013)Enabling Interoperability among Grid Meta-SchedulersJournal of Grid Computing10.1007/s10723-013-9252-911:2(311-336)Online publication date: 1-Jun-2013
https://dl.acm.org/doi/10.1007/s10723-013-9252-9
Villegas DBobroff NRodero IDelgado JLiu YDevarakonda AFong LMasoud Sadjadi SParashar M(2012)Cloud federation in a layered service modelJournal of Computer and System Sciences10.1016/j.jcss.2011.12.01778:5(1330-1344)Online publication date: 1-Sep-2012
https://dl.acm.org/doi/10.1016/j.jcss.2011.12.017
Show More Cited By

Index Terms

Transparent grid enablement of weather research and forecasting

Recommendations

Deep learning-based effective fine-grained weather forecasting model
Abstract
It is well-known that numerical weather prediction (NWP) models require considerable computer power to solve complex mathematical equations to obtain a forecast based on current weather conditions. In this article, we propose a novel lightweight ...
P-GRADE portal family for grid infrastructures

P-GRADE portal is one of the most widely used general-purpose grid portal in Europe. The paper summarizes the most advanced features of P-GRADE, such as parameter sweep workflow execution, multi-grid workflow execution and integration with the DSpace ...
Large-scale climate simulations harnessing clusters, grid and cloud infrastructures

The current availability of a variety of computing infrastructures including HPC, Grid and Cloud resources provides great computer power for many fields of science, but their common profit to accomplish large scientific experiments is still a challenge. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MG '08: Proceedings of the 15th ACM Mardi Gras conference: From lightweight mash-ups to lambda grids: Understanding the spectrum of distributed computing requirements, applications, tools, infrastructures, interoperability, and the incremental adoption of key capabilities

January 2008

178 pages

ISBN:9781595938350

DOI:10.1145/1341811

General Chair:
Daniel S. Katz
LSU
,
Program Chair:
Craig Lee
Aerospace Corporation

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

National e-Science Institute (Edinburgh, UK)
Louisiana State University (USA)

In-Cooperation

SIGAPP: ACM Special Interest Group on Applied Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 January 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

Mardi Gras'08

Sponsor:

Mardi Gras'08: 15th Mardi Gras Conference on Distributed Applications

January 29 - February 3, 2008

Louisiana, Baton Rouge, USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
350
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Almeida ECampos Velho HPreto A(2013)Challenges for mesoscale climatology execution on experimental grid computing systemsJournal of the Brazilian Computer Society10.1007/s13173-013-0099-519:3(279-290)Online publication date: 22-Feb-2013
https://doi.org/10.1007/s13173-013-0099-5
Rodero IVillegas DBobroff NLiu YFong LSadjadi S(2013)Enabling Interoperability among Grid Meta-SchedulersJournal of Grid Computing10.1007/s10723-013-9252-911:2(311-336)Online publication date: 1-Jun-2013
https://dl.acm.org/doi/10.1007/s10723-013-9252-9
Villegas DBobroff NRodero IDelgado JLiu YDevarakonda AFong LMasoud Sadjadi SParashar M(2012)Cloud federation in a layered service modelJournal of Computer and System Sciences10.1016/j.jcss.2011.12.01778:5(1330-1344)Online publication date: 1-Sep-2012
https://dl.acm.org/doi/10.1016/j.jcss.2011.12.017
Guim FRodero IOzalp EMadry S(2009)A google earth based distributed infrastructure to support natural disaster response2009 4th International Conference on Recent Advances in Space Technologies10.1109/RAST.2009.5158298(83-88)Online publication date: Jun-2009
https://doi.org/10.1109/RAST.2009.5158298
Shimizu SRangaswami RDuran-Limon HCorona-Perez M(2009)Platform-independent modeling and prediction of application resource usage characteristicsJournal of Systems and Software10.1016/j.jss.2009.07.02082:12(2117-2127)Online publication date: 1-Dec-2009
https://dl.acm.org/doi/10.1016/j.jss.2009.07.020

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

Affiliations

S. Masoud Sadjadi

Florida International University (FIU), Miami, Florida

Liana Fong

IBM T. J. Watson, NY

Rosa M. Badia

Barcelona Supercomputing Center, Barcelona, Spain

Javier Figueroa

Florida International University (FIU), Miami, Florida and University of Miami, Coral Gables, Florida

Javier Delgado

Florida International University (FIU), Miami, Florida

Xabriel J. Collazo-Mojica

University of Puerto Rico, Mayaguez Campus, Puerto Rico

Khalid Saleem

Florida International University (FIU), Miami, Florida

Raju Rangaswami

Florida International University (FIU), Miami, Florida

Shu Shimizu

IBM Tokyo Research Laboratory, Tokyo, Japan

Hector A. Duran Limon

University of Guadalajara, CUCEA, Mexico

Pat Welsh

University of North Florida, Jacksonville, Florida

Sandeep Pattnaik

Florida State University, Tallahassee, Florida

Anthony Praino

IBM T. J. Watson, NY

David Villegas

Florida International University (FIU), Miami, Florida

Selim Kalayci

Florida International University (FIU), Miami, Florida

Gargi Dasgupta

IBM IRL, India

Onyeka Ezenwoye

Florida International University (FIU), Miami, Florida

Juan Carlos Martinez

Florida International University (FIU), Miami, Florida

Ivan Rodero

Barcelona Supercomputing Center, Barcelona, Spain

Shuyi Chen

University of Miami, Coral Gables, Florida

Javier Muñoz

Florida International University (FIU), Miami, Florida

Diego Lopez

Florida International University (FIU), Miami, Florida

Julita Corbalan

Barcelona Supercomputing Center, Barcelona, Spain

Hugh Willoughby

Florida International University (FIU), Miami, Florida

Michael McFail

Florida International University (FIU), Miami, Florida

Christine Lisetti

Florida International University (FIU), Miami, Florida

Malek Adjouadi

Florida International University (FIU), Miami, Florida

View Table of Contents