Abstract
The object-based storage system, in which files are mapped onto one or more data objects stored on Object-Based Storage Devices (OSDs), has distributed storage system architecture. In such a system, the policy for object allocation is a critical aspect affecting the overall systems performance. Hashing and fragment-strip are two common techniques used for managing objects, but both have their disadvantages, and advantages, e.g. hashing achieves good workload balance and provide rather high effectiveness in allocating data, but it can not provide readily available parallelism for large file; fragment-strip takes full advantage device parallelism, simplifies the clients’ operations, but this policy is not fit for small file. In this paper, we present an efficient algorithm that combines the advantages of these two approaches while avoiding their shortcomings. The key factors which can impact the performance of the whole system in the objects allocation are also be discussed.
This work was supported by the National Basic Research Program of China (973 Program) under Grant No. 2004CB318201, the National Science Foundation of China under Grant No.60303032.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Wang, F., Brandt, S.A., Miller, E.L., Long, D.D.E.: OBFS: A File System for Object-based Storage Devices. In: 21st IEEE / 12th NASA Goddard Conference on Mass Storage Systems and Technologies (MSST 2004), College Park, MD (April 2004)
Xue, L., Liu, Y.: MDS Functionality Analysis, December 4 (2001)
Morris, J.H., Satyanarayanan, M., Conner, M.H., Howard, J.H., Rosenthal, D.S.H., Smith, F.D.: Andrew: A distributed personal computing environment. Communications of the ACM 29(3), 184–201 (1986)
McKusick, M.K., Joy, W.N., Leffler, S.J., Fabry, R.S.: A fast file system for UNIX. ACM Transactions on Computer Systems 2(3), 181–197 (1984)
Gibson, G.A., Meter, R.V.: Network attached storage architecture. Communications of the ACM 43(11), 37–45 (2000)
Spasojevic, M., Satyanarayanan, M.: An Empirical Study of a Wide-Area Distributed File System. ACM Transactions on Computer Systems 14(2) (May 1996)
Roselli, D., Lorch, J., Anderson, T.: A comparison of file system workloads. In: Proceedings of the 2000 USENIX Annual Technical Conference (June 2000)
Braam, P.J., et al.: The Lustre Storage Architecture. Cluster File Systems, Inc. (August 2003), http://www.clusterfs.com
Moase, J.R.: Panasas Storage Cluster & Object Storage Overview (October 2004), http://www.panasas.com
Hennessy, J.L., Patterson, D.A.: Computer Architecture A Quantitative Approach, 3rd edn.
Soltis, S.R., Ruwart, T.M., O’Keefe, M.T.: The Global File System. In: Proceedings of the 5th NASA Goddard Conference on Mass Storage Systems and Technologies, College Park, MD (1996)
Satyanarayanan, M., Kistler, J.J., Kumar, P., Okasaki, M.E., Siegel, E.H., Steere, D.C.: Coda: A highly available file system for a distributed workstation environment. IEEE Transactions on Computers 39(4), 447–459 (1990)
Schmuck, F., Haskin, R.: GPFS: A shared-disk file-system for large computing clusters. In: Proceedings of the 2002 Conference on File and Storage Technologies (FAST), USENIX (January 2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, F., Zhang, S., Feng, D., Jiang, H., Zeng, L., Lv, S. (2006). A Hybrid Scheme for Object Allocation in a Distributed Object-Storage System. In: Alexandrov, V.N., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds) Computational Science – ICCS 2006. ICCS 2006. Lecture Notes in Computer Science, vol 3994. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11758549_57
Download citation
DOI: https://doi.org/10.1007/11758549_57
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-34385-1
Online ISBN: 978-3-540-34386-8
eBook Packages: Computer ScienceComputer Science (R0)