[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3511808.3557186acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
short-paper
Public Access

CyberWater: An Open Framework for Data and Model Integration in Water Science and Engineering

Published: 17 October 2022 Publication History

Abstract

The CyberWater project is to build an open-data open-model framework for easy and incremental integration of heterogeneous data sources and diverse scientific models across disciplines in the broad water domain. The CyberWater framework extends the open-data open-model framework called Meta-Scientific-Modeling (MSM) that provides a system-wide data and model integration platform. On top of MSM, the CyberWater framework provides a set of toolkits, and external system integration engines, to further facilitate users' scientific modeling and collaboration across disciplines. For example, the developed generic model agent toolkit enables users to integrate their computational models into CyberWater via graphical user interface configuration without coding, which further simplifies the data and model integration and model coupling. CyberWater adopts a graphical scientific workflow system, VisTrails, ensuring data provenance and reproducible computing. CyberWater supports novel access to high-performance computing resources on demand for users' computational expensive model tasks. We demonstrate merits of CyberWater by a use case of hydrologic modeling workflow.

Supplementary Material

MP4 File (CIKM22-demo093.mp4)
In this presentation, we propose an open and sustainable modeling framework software system, CyberWater, to enable easy and incremental integration of diverse data sources and models without coding for knowledge discovery and interdisciplinary teamwork. We first present the overall architecture of the CyberWater framework and its functionalities. We then demonstrate CyberWater system via two modeling workflows. The first one is to illustrate the model coupling function of CyberWater for the integration of two models (VIC model and Routing model) using the generic model agent toolkit, where the coupled models are executed for the Princeton Millstone River watershed with 1-year data. The second one is to demonstrate on-demand HPC access, in which the VIC model is executed on the remote High-Performance Computing platform with our HPC module. The model results are retrieved back and plotted on the local machine with the data visualization utility of CyberWater.

References

[1]
Daniel Salas, Xu Liang, Miguel Navarro, Yao Liang, and Daniel Luna, 2020. An open-data open-model framework for hydrological models' integration, evaluation and application, Environmental Modelling & Software, Vol. 126, 104622.
[2]
Ranran Chen, Daniel Luna, Yuan Cao, Yao Liang, and Xu Liang, 2022. Open data and model integration through generic model agent toolkit in CyberWater framework, Environmental Modelling & Software, Vol. 152, 105384.
[3]
Daniel Luna, Ranran Chen, Ryan Young, Yao Liang, and Xu Liang, 2021. Static Parameter Agents of CyberWater Framework for Geoscience Data and Model Integration, In American Geophysical Union Fall Meeting(hybrid), New Orleans, LA, USA.
[4]
Feng Li, Ranran Chen, Yuankun Fu, Fengguang Song, Yao Liang, Isuru Ranawaka, Sudhakar Pamidighantam, Daniel Luna, and Xu Liang, 2021. Accelerating complex modeling workflows in CyberWater using on-demand HPC/Cloud resources, 2021 IEEE 17th International Conference on eScience (eScience), 196--205.
[5]
Steven P Callahan, Juliana Freire, Emanuele Santos, Carlos E Scheidegger, Cl´audio T Silva, and Huy T Vo, 2006. Vistrails: visualization meets data management. In Proceedings of the 2006 ACM SIGMOD international conference on Management of data, 745--747.
[6]
Andy B Yoo, Morris A Jette, and Mark Grondona, 2003. Slurm: Simple linux utility for resource management, In Workshop on job scheduling strategies for parallel processing, 44--60.
[7]
Suresh Marru, Lahiru Gunathilake, and Chathura Herath, 2011. Apache airavata: a framework for distributed applications and computational workflows, In Proceedings of the 2011 ACM workshop on Gateway computing environments, 21--28.
[8]
Xu Liang, Dennis P. Lettenmaier, Eric F. Wood, and Stephen J. Burges, 1994. A simple hydrologically based model of land surface water and energy fluxes for general circulation models, Journal Of Geographical Research Atmospheres, Vol. 99, 14415--14428. 96JD01448.
[9]
John Towns, Timothy Cockerill, Maytal Dahan, Ian Foster, Kelly Gaither, Andrew Grimshaw, Victor Hazlewood, Scott Lathrop, Dave Lifka, Gregory D. Peterson, Ralph Roskies, J. Ray Scott, and Nancy Wilkins-Diehr, 2014. XSEDE: Accelerating Scientific Discovery, Computing in Science & Engineering, Vol.16, 62--74.

Cited By

View all
  • (2024)Asynchronous modeling workflows in CyberWater with on-demand HPC/Cloud accessFuture Generation Computer Systems10.1016/j.future.2024.04.023159:C(307-322)Online publication date: 1-Oct-2024
  • (2024)Facilitating open data and open model integration: generic parameter input file generators in the CyberWater frameworkEnvironmental Modelling & Software10.1016/j.envsoft.2024.106266(106266)Online publication date: Nov-2024
  • (2023)HDFR: A Hydrologic Data and Modeling System with On-Demand Access to Environmental Sensing Data for Decision Making2023 17th International Conference on Ubiquitous Information Management and Communication (IMCOM)10.1109/IMCOM56909.2023.10035593(1-8)Online publication date: 3-Jan-2023

Index Terms

  1. CyberWater: An Open Framework for Data and Model Integration in Water Science and Engineering

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CIKM '22: Proceedings of the 31st ACM International Conference on Information & Knowledge Management
    October 2022
    5274 pages
    ISBN:9781450392365
    DOI:10.1145/3511808
    • General Chairs:
    • Mohammad Al Hasan,
    • Li Xiong
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 17 October 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. hpc access on demand
    2. model coupling without coding
    3. open data and model framework
    4. scientific workflow

    Qualifiers

    • Short-paper

    Funding Sources

    Conference

    CIKM '22
    Sponsor:

    Acceptance Rates

    CIKM '22 Paper Acceptance Rate 621 of 2,257 submissions, 28%;
    Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

    Upcoming Conference

    CIKM '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)105
    • Downloads (Last 6 weeks)6
    Reflects downloads up to 13 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Asynchronous modeling workflows in CyberWater with on-demand HPC/Cloud accessFuture Generation Computer Systems10.1016/j.future.2024.04.023159:C(307-322)Online publication date: 1-Oct-2024
    • (2024)Facilitating open data and open model integration: generic parameter input file generators in the CyberWater frameworkEnvironmental Modelling & Software10.1016/j.envsoft.2024.106266(106266)Online publication date: Nov-2024
    • (2023)HDFR: A Hydrologic Data and Modeling System with On-Demand Access to Environmental Sensing Data for Decision Making2023 17th International Conference on Ubiquitous Information Management and Communication (IMCOM)10.1109/IMCOM56909.2023.10035593(1-8)Online publication date: 3-Jan-2023

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media