Data Management and Exchange between a Meta-Orchestration Platform and Data Spaces
Authors: 
Anastasios Zafeiropoulos, Nikos Filinis, Dimitrios Spatharakis, Ioannis Dimolitsas, Eleni Fotopoulou, Constantinos Vassilakis, Symeon PapavassiliouAuthors Info & Claims
Pages 33 - 36
Abstract
A transition is underway towards the development of orchestration systems for the distributed computing continuum, where microservices-based applications are deployed and managed over resources that span from the Internet of Things (IoT) to the edge to the cloud part of it. In parallel, distributed monitoring frameworks are deployed to manage the vast amount of data produced to assist orchestration actions, optimal deployment of Machine Learning (ML) workflows, and processing of data produced by the IoT infrastructure that are related to vertical industries. In the current work, we detail the data collection and management approach that we follow in the development of a novel meta-orchestration platform for processing and sharing such data. For the latter, the potential for exploitation of the produced data is analyzed along with the interlinkage of the meta-orchestration platform with emerging work in the domain of Data Spaces. Opportunities and limitations for such an interlinkage are discussed.
References
[1]
Diana Carrizales-Espinoza, Dante D. Sanchez-Gallegos, J.L. Gonzalez-Compean, and Jesus Carretero. 2024. StructMesh: A storage framework for serverless computing continuum. Future Generation Computer Systems 159 (2024), 353–369. https://doi.org/10.1016/j.future.2024.05.033
[2]
Laura Daniele, Frank den Hartog, and Jasper Roes. 2015. Created in Close Interaction with the Industry: The Smart Appliances REFerence (SAREF) Ontology. In Formal Ontologies Meet Industry, Roberta Cuel and Robert Young (Eds.). Springer International Publishing, Cham, 100–112.
[3]
Romain David, Kurt Baumann, Yann Le Franc, Barbara Magagna, Lars Vogt, Heinrich Widmann, Thomas Jouneau, Hanna Koivula, Bénédicte Madon, Wolmar Nyberg Åkerström, Milan Ojsteršek, Andrea Scharnhorst, Christian Schubert, Zhengdong Shi, Letizia Tanca, and Sadia Vancauwenbergh. 2023. Converging on a Semantic Interoperability Framework for the European Data Space for Science, Research and Innovation (EOSC). In 2nd Workshop on Ontologies for FAIR and FAIR Ontologies (Onto4FAIR), 9th Joint Ontology Workshops (JOWO 2023),. Cassia Trojahn and Luiz Olavo Bonino da Silva Santos and Giancarlo Guizzardi and Clement Jonquet, Sherbrooke, Québec, Canada. https://doi.org/10.5281/zenodo.8042997
[4]
[4] Eclipse Data Space Components. Last Accessed on 2024-06-05. https://github.com/eclipse-edc
[5]
Nikos Filinis, Ioannis Dimolitsas, Dimitrios Spatharakis, Eleni Fotopoulou, Ioannis Tzanettis, Constantinos Vassilakis, Anastasios Zafeiropoulos, and Symeon Papavassiliou. 2024. A Synergetic Meta-Orchestration Framework for Distributed Application Deployments in the Computing Continuum. In Proceedings of the 1st International Workshop on MetaOS for the Cloud-Edge-IoT Continuum (Athens, Greece) (MECC ’24). Association for Computing Machinery, New York, NY, USA, 21–27. https://doi.org/10.1145/3642975.3678964
[6]
Nikos Filinis, Ioannis Tzanettis, Dimitrios Spatharakis, Eleni Fotopoulou, Ioannis Dimolitsas, Anastasios Zafeiropoulos, Constantinos Vassilakis, and Symeon Papavassiliou. 2024. Intent-driven orchestration of serverless applications in the computing continuum. Future Generation Computer Systems 154 (2024), 72–86. https://doi.org/10.1016/j.future.2023.12.032
[7]
[7] IDS Open Data Connector. Last Accessed on 2024-06-05. https://www.dataspaces.fraunhofer.de/en/software/connector/open_data_connector.html
[8]
Akif Quddus Khan, Mihhail Matskin, Radu Prodan, Christoph Bussler, Dumitru Roman, and Ahmet Soylu. 2024. Cloud storage cost: a taxonomy and survey. World Wide Web 27, 4 (May 2024), 36. https://doi.org/10.1007/s11280-024-01273-4
[9]
Dragi Kimovski, Roland Mathá, Josef Hammer, Narges Mehran, Hermann Hellwagner, and Radu Prodan. 2021. Cloud, Fog, or Edge: Where to Compute?IEEE Internet Computing 25, 4 (2021), 30–36. https://doi.org/10.1109/MIC.2021.3050613
[10]
Junyu Lu, Laurence T. Yang, Bing Guo, Qiang Li, Hong Su, Gongliang Li, and Jun Tang. 2022. A Sustainable Solution for IoT Semantic Interoperability: Dataspaces Model via Distributed Approaches. IEEE Internet of Things Journal 9, 10 (2022), 7228–7242. https://doi.org/10.1109/JIOT.2021.3097068
[11]
Michael Nast, Benjamin Rother, Frank Golatowski, Dirk Timmermann, Jens Leveling, Christian Olms, and Christian Nissen. 2020. Work-in-Progress: Towards an International Data Spaces Connector for the Internet of Things. In 2020 16th IEEE International Conference on Factory Communication Systems (WFCS). 1–4. https://doi.org/10.1109/WFCS47810.2020.9114503
[12]
NEPHELE Horizon Europe Project. Last Accessed on 2024-06-05. A lightweight software stack and synergetic meta-orchestration framework for the next generation compute continuum. https://nephele-project.eu/
[13]
[13] Prometheus. Last Accessed on 2024-06-06. https://prometheus.io/.
[14]
Victor Casamayor Pujol, Praveen Kumar Donta, Andrea Morichetta, Ilir Murturi, and Schahram Dustdar. 2023. Edge Intelligence—Research Opportunities for Distributed Computing Continuum Systems. IEEE Internet Computing 27, 4 (2023), 53–74.
[15]
Dumitru Roman, Radu Prodan, Nikolay Nikolov, Ahmet Soylu, Mihhail Matskin, Andrea Marrella, Dragi Kimovski, Brian Elvesæter, Anthony Simonet-Boulogne, Giannis Ledakis, Hui Song, Francesco Leotta, and Evgeny Kharlamov. 2022. Big Data Pipelines on the Computing Continuum: Tapping the Dark Data. Computer 55, 11 (2022), 74–84. https://doi.org/10.1109/MC.2022.3154148
[16]
Dimitrios Spatharakis, Ioannis Dimolitsas, Giacomo Genovese, Ioannis Tzanettis, Nikos Filinis, Eleni Fotopoulou, Constantinos Vassilakis, Anastasios Zafeiropoulos, Antonio Iera, Antonella Molinaro, and Symeon Papavassiliou. 2023. A Lightweight Software Stack for IoT Interoperability within the Computing Continuum. In 2023 19th International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT). 715–722. https://doi.org/10.1109/DCOSS-IoT58021.2023.00112
[17]
Toni Taipalus. 2024. Vector database management systems: Fundamental concepts, use-cases, and current challenges. Cognitive Systems Research 85 (2024), 101216. https://doi.org/10.1016/j.cogsys.2024.101216
Index Terms
- Data Management and Exchange between a Meta-Orchestration Platform and Data Spaces
Recommendations
The MobiSpaces Manifesto on Mobility Data Spaces
eSAAM '24: Proceedings of the 4th Eclipse Security, AI, Architecture and Modelling Conference on Data SpaceData spaces consist of trusted frameworks that manage the entire data lifecycle, encompassing various data models, metadata descriptors, ontologies for semantic interpretation, and data services for accessing, processing, and analyzing data. Domain-...
A Synergetic Meta-Orchestration Framework for Distributed Application Deployments in the Computing Continuum
MECC '24: Proceedings of the 1st International Workshop on MetaOS for the Cloud-Edge-IoT ContinuumThe rapid evolution of the Internet of Things (IoT) and edge computing is driving a shift towards distributed computing continuum systems. These systems integrate virtualization technologies to optimize resource allocation across edge and cloud ...
Analyzing Distributed Medical Data in FAIR Data Spaces
WWW '23 Companion: Companion Proceedings of the ACM Web Conference 2023The exponential growth in data production has led to increasing demand for high-quality data-driven services. Additionally, the benefits of data-driven analysis are vast and have significantly propelled research in many fields. Data sharing benefits ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2024
118 pages
ISBN:9798400709845
DOI:10.1145/3685651
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 22 October 2024
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Funding Sources
- NEPHELE Horizon Europe Project
Conference
eSAAM 2024
eSAAM 2024: 4th Eclipse Security, AI, Architecture and Modelling Conference on Data Space
October 22, 2024
Mainz, Germany
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 93Total Downloads
- Downloads (Last 12 months)93
- Downloads (Last 6 weeks)34
Reflects downloads up to 20 Jan 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in