Abstract
In this paper, we propose a new approach to manage data storage and distribution in a data warehouse (DWH) environment. This approach deals with the dynamic data distribution of the DWH on a set of servers. The data distribution that we consider is different from the “classical” one which depends on the data use. The distribution in our approach consists in distributing data when the server reaches his storage capacity limit. This distribution assures the scalability and exploits the storage and processing resources available in the organization using the DWH. It is worth noting that our approach is based on a multi-agent model mixed with the scalability distribution proposed by the Scalable Distributed Data Structures.
The proposed multi-agent model is composed of stationary agent classes: Client, Dispatcher, Domain and Server, and a mobile agent class called Messenger. These agents collaborate and interact to achieve automatically the storage, the splitting (distribution), the redirection and the access operations on the distributed DWH.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Inmon, W.: Building the Data Warehouse. QED Technical Publishing Group (1992)
Wu, M., Buchmann, A.: Research Issues in Data Warehousing. In: BTW’97 (March 1997)
Kimball, R.: The Data Warehouse Toolkit. J. Wiley & Sons, New York (1996)
Kimball, R., Reeves, L., Ross, M., Thornthwalte, W.: The Data Warehouse Lifecycle Toolkit. J. Wiley & Sons, New York (1998)
Bellatreche, L., Boukhalfa, K.: An Evolutionary Approach to Schema Partitioning Selection in a Data Warehouse. In: Tjoa, A.M., Trujillo, J. (eds.) DaWaK 2005. LNCS, vol. 3589, pp. 115–125. Springer, Heidelberg (2005)
Bernardino, J., Madeira, H.: Data Warehousing and OLAP: Improving Query Performance Using Distributed Computing (2001)
Costa, M., Vieira, J., Bernardino, J., Furtado, P., Madeira, H.: A middle layer for distributed data warehouses using the DWS-AQA technique (2003)
Furtado, P.: Experimental Evidence on Partitioning in Parallel Data Warehouses. In: DOLAP 04 -WORKSHOP of the Int’l Conference on Information and Knowledge Management (CIKM), Washington (November 2004)
Kolsi, N., Ghedira, K., Abdellatif, A.: Utilisation d’un Système Multi-Agents pour la Répartition et la Scalabilité des Données d’un Data Warehouse. In: Acts of the Fourth Scientific Days, Tome 1, Borj El Amri Aviation School, Tunis, Tunisia, 21-22 May 2003, pp. 118–129 (2003)
Informatica white paper. Enterprise-Scalable Data Marts: A New Strategy for Building and Deploying Fast, Scalable Data Warehousing Systems (1997), http://www.informatica.com
Litwin, W., Neimat, M.A., Schneider, D.: RP*: A Family of Order-Preserving Scalable Distributed Data Structures. In: 20th Intl. Conf. On very Large Data Bases VLDB (1994)
Diene, A., Litwin, W.: Performance Measurements of RP*: A Scalable Distributed Data Structure for Range Partitioning. In: Int. Conf. on Information Society in the 21st Century: Emerging Techn. and New Challenges, Aizu City, Japan (2000)
Arcangeli, J., Hameurlain, A., Migeon, F., Morvan, F.: Apport des agents mobiles à l’évaluation et l’optimisation de requêtes bases de données réparties à grande échelle. Technical Report, laboratory IRIT, Université Paul Sabatier (2002)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kolsi, N., Abdellatif, A., Ghedira, K. (2007). Agent Based Dynamic Data Storage and Distribution in Data Warehouses. In: Nguyen, N.T., Grzech, A., Howlett, R.J., Jain, L.C. (eds) Agent and Multi-Agent Systems: Technologies and Applications. KES-AMSTA 2007. Lecture Notes in Computer Science(), vol 4496. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72830-6_39
Download citation
DOI: https://doi.org/10.1007/978-3-540-72830-6_39
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72829-0
Online ISBN: 978-3-540-72830-6
eBook Packages: Computer ScienceComputer Science (R0)