Abstract
An efficient exploitation of Distributed Computing Infrastructures (DCIs) is needed to deal with the data deluge that the scientific community is facing, in particular the Astrophysics one due to the emerging Square Kilometre Array (SKA) telescope that will reach data rates in the exascale domain. Hence, Science Gateways are being enriched with advanced tools that not only enable the scientists to build their experiments but also to optimize their adaptation to different infrastructures. In this work we present a method, called “two-level workflow system”, to build this kind of tools and we apply it to a set of analysis tasks of interest for some use applications to the SKA. This method uses the Software-as-a-Service model to keep the scientists insulated from technical complexity of DCIs, and the COMPSs programming model to achieve an efficient use of the computing resources.
Similar content being viewed by others
References
Kiss, T., Kelley, I., Kacsuk, P.: Porting computation and data intensive applications to distributed computing infrastructures incorporating desktop grids inproceedings of science (2011)
Lordan, F., Tejedor, E., Ejarque, J., Rafanell, R., Álvarez, J., Marozzo, F., Lezzi, D., Sirvent, R., Talia, D., Badia, R.M.: Servicess: An Interoperable Programming Framework for the Cloud. Journal of Grid Computing 12(1), 67 (2014)
Filguiera, R., Klampanos, I., Krause, A., David, M., Moreno, A., Atkinson, M.: Dispel4Py:A Python framework for data-intensive scientific computing. In: Proceedings of the 2014 International Workshop on Data Intensive Scalable Computing Systems. doi:10.1109/DISCS.2014.12, pp 9–16 (2014)
Kacsuk, P., Farkas, Z., Kozlovszky, M., Hermann, G., Balasko, A., Karoczkai, K., Marton, I.: WS-PGRADE/gUSE generic DCI Gateway Framework for a large variety of user communities. Journal of Grid Computing 10(4), 601 (2012)
Balasko, A., Farkas, Z., Kacksuk, P.: Building Science Gateways by utilizing the generic WS-PGRADE/gUSE workflow system. Computer Science 14(2), 307 (2013)
Krüger, J., Grunzke, R., Gesing, S., Breuers, S., Brinkmann, A., de la Garza, L., Kohlbacher, O., Kruse, M., Nagel, W. E., Packschies, L., Müller-Pfefferkorn, R., Schäfer, P., Schärfe, C., Steinke, T., Schlemmer, T., Warzecha, K.D., Zink, A, Herres-Pawlis, S.: The MoSGrid Science Gateway – A Complete solution for molecular simulations. J. Chem. Theory Comput. 10(6), 2232 (2014)
Sciacca, E., Bandieramonte, M., Becciani, U., Costa, A., Krokos, M., Massimino, P., Petta, C., Pistagna, C., Riggi, S., Vitello, F.: VisIVO Science Gateway: A collaborative environment for the Astrophysics community. In: International Workshop on Science Gateways (2013)
Costa, A., Massimino, P., Bandieramonte, M., Becciani, U., Krokos, M., Pistagna, C., Riggi, S., Sciacca, E., Vitello, F.: An innovative Science Gateway for the Cherenkov Telescope Array. Journal of Grid Computing 13(4), 547 (2015)
Wolstencroft, K., Haines, R., Fellows, D., Williams, A., Withers, D., Owen, S., Soiland-Reyes, S., Dunlop, I., Nenadic, A., Fisher, P., Bhagat, J., Belhajjame, K., Bacall, F., Hardisty, A., Nieva de la Hidalga, A., Balcazar Vargas, M.P., Sufi, S., Goble, C.: The Taverna workflow suite: designing and executing workflows of Web Services on the desktop, web or in the cloud . Nucleic Acids Research 41(W1), W557 (2013). doi:10.1093/nar/gkt328
Le Blanc, A., Brooke, J., Fellows, D., Soldati, M., Pérez-Suárez, D., Marassi, A., Santin, A.: Workflows for heliophysics. Journal of Grid Computing 11(3), 481 (2013)
De Roure, D., Goble, C., Stevens, R.: The design and realisation of the myExperiment Virtual Research Environment for social sharing of workflows. Futur. Gener. Comput. Syst. 561, 25 (2009)
Scheers, B., Groffen, F.: Towards dynamic light-curve catalogues. In: Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series. doi:10.1117/12.926069, vol. 8451, p 0 (2012)
Begeman, K., Belikov, A., Boxhoorn, D., Dijkstra, F., Holties, H., Meyer-Zhao, Z., Renting, G., Valentijn, E., Vriend, W.J.: LOFAR Information System. Futur. Gener. Comput. Syst. 27(3), 319 (2011). doi:10.1016/j.future.2010.08.010
Kiddle, C., Taylor, A.R., Pigat, D., Eymere, O., Rosolowsky, E., Kaspi, V., Willis, A.G.: CyberSKA : An on-line collaborative portal for data-intensive radio Astronomy. In: ACM workshop on Gateway computing environments, pp 65–72 (2011)
Amaral, R., Badia, R.M., Blanquer, I., Braga-Neto, R., Candela, L., Castelli, D., Flann, C., De Giovanni, R., Gray, W.A., Ourones, A., Lezzi, D., Pagano, P., Perez-Canhos, V., Quevedo, F., Rafanell, R., Rebello, V., Sousa-Baena, M.S., Torres, E.: Supporting biodiversity studies with the EUBrazilOpenBio Hybrid Data Infrastructure. Concurrency and Computation: Practice and Experience (2014). doi:10.1002/cpe.3238
Sanchez-Exposito, S., Martin, P., Ruiz, J.E., Verdes-Montenegro, L., Garrido, J., Sirvent, R., Ruiz Falco, A., Badia, R.M.: Web Services as building blocks for Science Gateways in Astrophysics. In: proceedings of Interntational workshop on Science Gateways. doi:10.1109/IWSG, pp 80–84 (2015)
Martin, P., Sanchez-Exposito, S., Ruiz Falco, A., Lorenzana, J., Ortega, E., Verdes-Montenegro, L., Garrido, J., Ruiz, J.E., Badia, R.M., Sirvent, R., Tejedor, E.: Business rules driven federated access to heterogeneous computing infrastructures with Web Services (in prep.)
Rogstad, D.H., Lockhart, I.A., Wright, M.C.H.: Aperture-synthesis observations of HI in the galaxy M83. Astrophys. J. 193, 309 (1974). doi:10.1086/153164
Vogelaar, M.G.R., Terlouw, J.P.: The evolution of GIPSY, or the survival of an image processing system. In: Astronomical Data Analysis Software and Systems X, vol. 238, p 358 (2001)
Ruiz, J.E., Garrido, J., Santander-Vela, J., Sánchez-Expósito, S., Verdes-Montenegro, L.: Astrotaverna - Building workflows with Virtual Observatory services. Astronomy and Computing I, 3 (2014)
Sengupta, C., Scott, T.C., Verdes Montenegro, L., Bosma, A., Verley, S., Vilchez, J.M., Durbala, A., Fernández Lorenzo, M., Espada, D., Yun, M.S., Athanassoula, E., Sulentic, J., Portas, A.: HI asymmetry in the isolated galaxy CIG 85 (UGC 1547). Astronomy and Astrophysics 546, A95 (2012). doi:10.1051/0004-6361/201219948
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sánchez-Expósito, S., Martín, P., Ruiz, J.E. et al. Web Services as Building Blocks for Science Gateways in Astrophysics. J Grid Computing 14, 673–685 (2016). https://doi.org/10.1007/s10723-016-9382-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10723-016-9382-y