Abstract
The development of smart city infrastructures is seen as an important strategic component for many countries with applications in the areas of government services, healthcare, transport and traffic management, energy, water, and the management of waste services. In general, each of these infrastructural components generates data as it delivers its service. The usage of this data is often crucial both to the continued development of the service and for forward planning. While the data sources are often not complex in structure, traditional decision support systems are not built to handle continuous data streams, new or disappearing data sources, or the integration of multiple online data sources. In this work, we develop a flexible ETL process to quickly process and integrate online smart city data sources to deliver information that can be used in close to real-time.
This work is supported by Science Foundation Ireland under grant number SFI/12/RC/2289.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Baazizi, M.A., Lahmar, H.B., Colazzo, D., Ghelli, G., Sartiani, C.: Schema inference for massive JSON datasets. In: Extending Database Technology (EDBT) (2017)
Barnaghi, P.M., Bermúdez-Edo, M., Tönjes, R.: Challenges for quality of data in smart cities. J. Data Inform. Qual. 6(2–3), 6:1–6:4 (2015)
Bellini, P., Benigni, M., Billero, R., Nesi, P., Rauch, N.: Km4city ontology building vs data harvesting and cleaning for smart-city services. J. Vis. Lang. Comput. 25(6), 827–839 (2014)
Cappellari, P., Virgilio, R., Maccioni, A., Roantree, M.: A path-oriented RDF index for keyword search query processing. In: Hameurlain, A., Liddle, S.W., Schewe, K.-D., Zhou, X. (eds.) DEXA 2011. LNCS, vol. 6861, pp. 366–380. Springer, Heidelberg (2011). doi:10.1007/978-3-642-23091-2_31
Dublin Bikes API. (originally available in XML, now only available in JSON): http://api.citybik.es/v2/networks/dublinbikes
Dublin Bus RTPI. http://dublinked.ie/real-time-passenger-information-rtpi/
Dublin City travel times. http://opendata.dublincity.ie/TrafficOpenData/CP_TR/trips.csv
Gea, T., Paradells, J., Lamarca, M., Roldan, D.: Smart cities as an application of internet of things: experiences and lessons learnt in Barcelona. In: Seventh International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS), 2013, pp. 552–557. IEEE (2013)
Hernández-Muñoz, J.M., Vercher, J.B., Muñoz, L., Galache, J.A., Presser, M., Hernández Gómez, L.A., Pettersson, J.: Smart cities at the forefront of the future internet. In: Domingue, J., et al. (eds.) FIA 2011. LNCS, vol. 6656, pp. 447–462. Springer, Heidelberg (2011). doi:10.1007/978-3-642-20898-0_32
Irish Rail. http://api.irishrail.ie/realtime/index.htm?realtime_irishrail
Komamizu, T., Amagasa, T., Shaikh, S.A., Shiokawa, H., Kitagawa, H.: Towards real-time analysis of smart city data: a case study on city facility utilizations. In: IEEE 18th International Conference HPCC/SmartCity/DSS, pp. 1357–1364. IEEE (2016)
Nebot, V., Berlanga, R., Pérez, J.M., Aramburu, M.J., Pedersen, T.B.: Multidimensional integrated ontologies: a framework for designing semantic data warehouses. In: Spaccapietra, S., Zimányi, E., Song, I.-Y. (eds.) Journal on Data Semantics XIII. LNCS, vol. 5530, pp. 1–36. Springer, Heidelberg (2009). doi:10.1007/978-3-642-03098-7_1
Roantree, M., Liu, J.: A heuristic approach to selecting views for materialization. Softw. Pract. Exp. 44(10), 1157–1179 (2014)
Roantree, M., McCann, D., Moyna, N.: Integrating sensor streams in phealth networks. In: 14th IEEE International Conference on Parallel and Distributed Systems, ICPADS 2008, pp. 320–327. IEEE (2008)
Scriney, M., O’Connor, M.F., Roantree, M.: Generating cubes from smart city web data. In: Proceedings of the Australasian Computer Science Week Multiconference, ACSW 2017, Australia, pp. 49:1–49:8 (2017)
Skoutas, D., Simitsis, A.: Ontology-based conceptual design of etl processes for both structured and semi-structured data. Int. J. Semant. Web Inform. Syst. (IJSWIS) 3(4), 1–24 (2007)
Transport for Ireland. http://www.transportforireland.ie/real-time/real-time-ireland/
Transport Infrastructure Ireland. https://www.tiitraffic.ie/travel_times/
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Scriney, M., O’Connor, M.F., Roantree, M. (2017). Integrating Online Data for Smart City Data Marts. In: Calì, A., Wood, P., Martin, N., Poulovassilis, A. (eds) Data Analytics. BICOD 2017. Lecture Notes in Computer Science(), vol 10365. Springer, Cham. https://doi.org/10.1007/978-3-319-60795-5_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-60795-5_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-60794-8
Online ISBN: 978-3-319-60795-5
eBook Packages: Computer ScienceComputer Science (R0)