[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3332186.3338096acmotherconferencesArticle/Chapter ViewAbstractPublication PagespearcConference Proceedingsconference-collections
research-article

Improving Science Gateways usage reporting for XSEDE

Published: 28 July 2019 Publication History

Abstract

Science Gateways have gained wide use by research community by providing a rich and easy to use web interface to access and utilize complex cyberinfrastructure. Science Gateways are consuming an increasing proportion of computational capacity provided by XSEDE. A typical approach employed by Science Gateways is to use a single community account with a compute allocation to process compute jobs on behalf of their users. The computation usage for Science Gateways is compiled from batch job submission systems and reported by the XSEDE service providers. However, this reporting does not capture and provide any information about the user who actually initiated the computation, as the batch systems do not have record this information. To overcome this reporting limitation, Science Gateways utilize a separate pipeline to submit job-specific attributes to XSEDE, which is then later co-joined with batch system information submitted by the Service Providers to create detailed usage reports. In this article we describe improvements to the Gateway attribute reporting system, which better serves the needs of the growing number of Science Gateways by providing their operators a simpler and versatile interface to easily report a richer set of attributes and ultimately publish this information via XDMoD that enables various stake holders to assess resource utilization and their potential impact.

References

[1]
John Towns, Timothy Cockerill, Maytal Dahan, Ian Foster, Kelly Gaither, Andrew Grimshaw, Victor Hazlewood, Scott Lathrop, Dave Lifka, Gregory D. Peterson, Ralph Roskies, J. Ray Scott, and Nancy Wilkins-Diehr. 2014. XSEDE: Accelerating Scientific Discovery. Computing in Science & Engineering 16, 5 (2014), 62--74.
[2]
CIPRES. Retrieved Feb 19, 2019 from https://www.phylo.org
[3]
Miller, M.A., Pfeiffer, W., and Schwartz, T. (2010) "Creating the CIPRES Science Gateway for inference of large phylogenetic trees" in Proceedings of the Gateway Computing Environments Workshop (GCE), 14 Nov. 2010, New Orleans, LA pp 1--8.
[4]
OpenTopography: https://www.opentopography.org
[5]
Krishnan S, Crosby CJ, Nandigam V, Phan M, Cowart C, Baru C, Arrowsmith RJ. 2011. OpenTopography: A Services Oriented Architecture for Community Access to LIDAR Topography. Proceedings of the 2Nd International Conference on Computing for Geospatial Research & Applications.
[6]
NSG Portal: https://www.nsgportal.org
[7]
S Sivagnanam, A Majumdar, K Yoshimoto, V Astakhov, A Bandrowski, M. E. Martone, and N. T. Carnevale. Introducing the Neuroscience Gateway, IWSG, volume 993 of CEUR Workshop Proceedings, CEUR-WS.org, 2013.
[8]
Genepattern: http://software.broadinstitute.org/cancer/software/genepattern
[9]
I-TASSER: https://zhanglab.ccmb.med.umich.edu/I-TASSER/
[10]
Y Zhang. I-TASSER server for protein 3D structure prediction. BMC Bioinformatics, 9: 40 (2008).
[11]
GridChem: https://gridchem.org
[12]
Airavata: http://airavata.apache.org/development.html
[13]
Marru, Suresh, Marlon Pierce, Sudhakar Pamidighantam, and Chathuri Wimalasena. "Apache Airavata as a laboratory: architecture and case study for component-based gateway middleware." In Proceedings of the 1st Workshop on The Science of Cyberinfrastructure: Research, Experience, Applications and Models, pp. 19--26. ACM, 2015.
[14]
Galaxy: https://galaxyproject.org
[15]
Enis Afgan, Dannon Baker, Bérénice Batut, Marius van den Beek, Dave Bouvier, Martin Čech, John Chilton, Dave Clements, Nate Coraor, Björn Grüning, Aysam Guerler, Jennifer Hillman-Jackson, Vahid Jalili, Helena Rasche, Nicola Soranzo, Jeremy Goecks, James Taylor, Anton Nekrutenko, and Daniel Blankenberg. The Galaxy platform for accessible, reproducible and collaborative biomedical analyses: 2018 update, Nucleic Acids Research, Volume 46, Issue W1, 2 July 2018, Pages W537--W544.
[16]
GenApp: https://genapp.rocks
[17]
Emre H. Brookes. 2014. An Open Extensible Multi-Target Application Generation Tool for Simple Rapid Deployment of Multi-Scale Scientific Codes. In Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment (XSEDE '14). ACM, New York, NY, USA, Article 53, 6 pages.
[18]
HubZero: https://hubzero.org
[19]
M. McLennan and R. Kennell, "Hubzero: A platform for dissemination and collaboration in computational science and engineering," Computing in Science & Engineering, vol. 12, no. 2, pp. 48--53, 2010.
[20]
Nikolay A. Simakov, Joseph P. White, Robert L. DeLeon, Steven M. Gallo, Matthew D. Jones, Jeffrey T. Palmer, Benjamin Plessinger, and Thomas R. Furlani. 2018. "A Workload Analysis of NSF's Innovative HPC Resources Using XDMoD". https://arxiv.org/pdf/1801.04306
[21]
R. T. Fielding and R. N. Taylor (May 2002), "Principled Design of the Modern Web Architecture" (PDF), ACM Transactions on Internet Technology (TOIT) (New York: Association for Computing Machinery) 2 (2): 115--150
[22]
Stewart, C.A., Cockerill, T.M., Foster, I., Hancock, D., Merchant, N., Skidmore, E., Stanzione, D., Taylor, J., Tuecke, S., Turner, G., Vaughn, M., and Gaffney, N.I., Jetstream: a self-provisioned, scalable science and engineering cloud environment. 2015, In Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure. St. Louis, Missouri. ACM: 2792774. p. 1--8.
[23]
Kerberos: https://web.mit.edu/kerberos/
[24]
Curl: https://curl.haxx.se

Index Terms

  1. Improving Science Gateways usage reporting for XSEDE

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    PEARC '19: Practice and Experience in Advanced Research Computing 2019: Rise of the Machines (learning)
    July 2019
    775 pages
    ISBN:9781450372275
    DOI:10.1145/3332186
    • General Chair:
    • Tom Furlani
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 July 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. HPC
    2. Science Gateways

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    PEARC '19

    Acceptance Rates

    Overall Acceptance Rate 133 of 202 submissions, 66%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 68
      Total Downloads
    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 20 Dec 2024

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media