[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

A computational model to support in-network data analysis in federated ecosystems

Published: 01 March 2018 Publication History

Abstract

Software-defined networks (SDNs) have proven to be an efficacious tool for undertaking complex data analysis and manipulation within data intensive applications. SDN technology allows us to separate the data path from the control path, enabling in-network processing capabilities to be supported as data is migrated across the network. We propose to leverage software-defined networking (SDN) to gain control over the data transport service with the purpose of dynamically establishing data routes such that we can opportunistically exploit the latent computational capabilities located along the network path. This strategy allows us to minimize waiting times at the destination data center and to cope with spikes in demand for computational capability. We validate our approach using a smart building application in a multi-cloud infrastructure. Results show how the in-transit processing strategy increases the computational capabilities of the infrastructure and influences the percentage of job completion without significantly impacting costs and overheads. We present a model that leverages software-defined networks to opportunistically exploit the latent computational capabilities located along the data path.Our model is able to use alternative methods of computation when our primary method cannot be used due to SLA constraints. In this paper we use a neuronal network approximation model as alternative to EnergyPlus.The description of two algorithms that introduces how the neuronal network model is trained and how neuronal network jobs are deployed across in-transit resources.A new set of experiments to validate and evaluate the effect that our new strategy has in the energy optimization of smart buildings.

References

[1]
S. Jain, A. Kumar, S. Mandal, B4: Experience with a globally-deployed software defined wan, in: ACM SIGCOMM 2013, 2013, pp. 3-14.
[2]
OpenCloud, NFaaS - network function as a service, 2014.
[3]
FIDIA Project. http://www.sporte2.eu/fidia-sport. (Last accessed on June 2016).
[4]
I. Petri, O.F. Rana, Y. Rezgui, H. Li, T. Beach, M. Zou, J.D. Montes, M. Parashar, Cloud supported building data analytics, in: CCGrid, 2014, pp. 641-650.
[5]
T. Jin, F. Zhang, Q. Sun, Poster: leveraging deep memory hierarchies for data staging in coupled data-intensive simulation workflows, in: IEEE CLUSTER, 2014, pp. 268-269.
[6]
I. Petri, M. Zou, A. Zamani, J. Diaz-Montes, O.F. Rana, M. Parashar, Integrating software defined networks within a cloud federation, in: CCGrid, 2015.
[7]
J. Diaz-Montes, M. AbdelBaky, M. Zou, M. Parashar, Cometcloud: enabling software-defined federations for end-to-end application workflows, IEEE Internet Comput., 19 (2015) 69-73.
[8]
J. Diaz-Montes, Y. Xie, I. Rodero, Federated computing for the masses - aggregating resources to tackle large-scale engineering problems, CiSE Mag., 16 (2014) 62-72.
[9]
Z. Li, M. Parashar, Comet: A scalable coordination space for decentralized distributed environments, in: Intl. Workshop on Hot Topics in Peer-to-Peer Systems, 2005.
[10]
Mininet Project. http://mininet.org. (Last accessed on June 2016).
[11]
GRE Tunneling. http://lartc.org/howto/lartc.tunnel.gre.html. (Last accessed on June 2016).
[12]
B.A.A. Nunes, M. Mendonca, X.N. Nguyen, K. Obraczka, T. Turletti, Asurvey of software-defined networking: past, present, and future of programmable networks, IEEE Commun. Surv. Tutor., 16 (2014) 1617-1634.
[13]
S. Scott-Hayward, G. OCallaghan, S. Sezer, Sdn security: A survey, in: Future Networks and Services, SDN4FNS, 2013 IEEE SDN for, 2013, pp. 17.
[14]
S. Shin, G. Gu, Attacking software-defined networks: A first feasibility study, in: ACM SIGCOMM Workshop on Hot Topics in Software Defined Networking, 2013, pp. 165166.
[15]
N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford, S. Shenker, J. Turner, OpenFlow: enabling innovation in campus networks, ACM SIGCOMM Comput. Commun. Rev., 38 (2008) 69-74.
[16]
SWITCH Project. http://www.switchproject.eu. (Last accessed on June 2016).
[17]
D.L. Tennenhouse, D.J. Wetherall, Towards an active network architecture, SIGCOMM Comput. Commun. Rev., 37 (2007) 81-94.
[18]
L. Lefevre, C.-D. Pham, P. Primet, B. Tourancheau, B. Gaidioz, J.-P. Gelas, M. Maimour1, Active networking support for the grid, in: Lecture Notes in Computer Science, vol. 2207, 2001, pp. 16-33.
[19]
C. Guok, D. Robertson, M. Thompson, J. Lee, B. Tierney, W. Johnston, Intra and interdomain circuit provisioning using the oscars reservation system, in: 3rd Intl. Conf. on Broadband Communications, Networks and Systems, BROADNETS, 2006, pp. 18.
[20]
N. Rao, W. Wing, S. Carter, Q. Wu, Ultrascience net: network testbed for large-scale science applications, IEEE Commun. Mag., 43 (2005) S12-S17.
[21]
G. Wang, T. Ng, A. Shaikh, Programming your network at run-time for big data applications, in: ACM SIGCOMM Workshop on Hot Topics in Software Defined Networks, 2012, pp. 103108.
[22]
P. Xiong, H. Hacigumus, J.F. Naughton, A software-defined networking based approach for performance management of analytical queries on distributed data stores, in: ACM SIGMOD Intl. Conf. on Management of Data, ACM, 2014, pp. 955-966.
[23]
S. Das, Y. Yiakoumis, G. Parulkar, N. McKeown, P. Singh, D. Getachew, P.D. Desai, Application-aware aggregation and traffic engineering in a converged packet-circuit network, in: National Fiber Optic Engineers Conference, Optical Society of America, 2011.
[24]
Z. Liu, X. Wang, Y. Qi, J. Li, LiveCloud: a lucid orchestrator for cloud datacenters, in: CloudCom, 2012, pp. 341-348.
[25]
M.-Y. Luo, J.-Y. Chen, Software defined networking across distributed datacenters over cloud, in: CloudCom, 2013, pp. 615-622.
[26]
T. Miyamoto, M. Hayashi, K. Nishimura, Sustainable network resource management system for virtual private clouds, in: CloudCom, 2010, pp. 512-520.
[27]
K. Moreland, R. Oldfield, P. Marion, etal., Examples of in transit visualization, in: Intl. Workshop on Petascal Data Analytics: Challenges and Opportunities, PDAC 11, 2011, pp. 16.
[28]
J.C. Bennett, H. Abbasi, P.-T. Bremer, Combining in-situ and in-transit processing to enable extreme-scale scientific analysis, in: SC12, 2012, pp. 49:1-49:9.

Cited By

View all
  • (2020)Harnessing the Computing Continuum for Urgent ScienceACM SIGMETRICS Performance Evaluation Review10.1145/3439602.343961848:2(41-46)Online publication date: 25-Nov-2020
  1. A computational model to support in-network data analysis in federated ecosystems

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image Future Generation Computer Systems
    Future Generation Computer Systems  Volume 80, Issue C
    March 2018
    655 pages

    Publisher

    Elsevier Science Publishers B. V.

    Netherlands

    Publication History

    Published: 01 March 2018

    Author Tags

    1. Cloud federation
    2. CometCloud
    3. In-transit
    4. Smart buildings
    5. Software-defined networks

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 26 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2020)Harnessing the Computing Continuum for Urgent ScienceACM SIGMETRICS Performance Evaluation Review10.1145/3439602.343961848:2(41-46)Online publication date: 25-Nov-2020

    View Options

    View options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media