Author : Shaik Naval Bhanu 1
Date of Publication :7th August 2016
Abstract: Cloud storage services are emerging at a fast rate and rising in data storage field. These services are utilized by people for uploading and backing up data, sharing file through social networks like Cloud, Email, Google Drives Users are able to upload data from pc, mobile or tablet and also download and share them to others. Thus, system load in cloud storage becomes large. Nowadays, Cloud storage service has become an important requirement for several enterprises because of its features like cost saving, performance, security, flexibility. To design an efficient storage engine for cloud based storage systems, it is always required to deal with requirements like huge file processing, light-weight metadata, de-duplication, and high scalability. Here we propose big file cloud architecture to handle all issues in big file cloud system. Basically, here we propose to make a scalable distributed data cloud storage that supports huge file with size up to several terabytes to gigabytes. In cloud storage, system load is usually heavy. Data de-duplication with file compression to reduce the storage space caused by storing same static data from different users. In order to solve the above issues, a common method used in Cloud storage, is by dividing big file into small blocks, storing them on disks and then dealing them using a metadata system. Current cloud storage services have a complex metadata system.
Reference :
-
- Thanh Trung Nguyen · Minh Hieu Nguyen, “Zing Database: High-Performance Key value Store For LargeScale Storage Service”, 17 August 2014, Springer - Vietnam J Comput Science (2015), DOI 10.1007/s40595-014-0027-4.
- Mihir Bellare, Sriram Keelveedhi, Thomas Ristenpart, “DupLESS: Server-Aided Encryption for Deduplicated Storage”, 2013, USENIX Security Symposium.
- Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah A. Wallach, Mike Burrows, Tushar Chandra, Andrew Fikes, Robert E. Gruber, “Bigtable: A Distributed Storage System for Structured Data”, Google, Inc.
- P. FIPS. 197: the official aes standard. “Figure2: Working scheme with four LFSRs and their IV generation LFSR1” LFSR, 2, 2001.
- S. Ghemawat and J. Dean.“Leveldb is a fast key-value storage library written at google that provides an ordered mapping from string keys to string values.”https://github.com/google/leveldb. Accessed November 2, 2014
- S. Ghemawat, H. Gobioff, and S.-T. Leung. “The google file system”. In ACM SIGOPS Operating Systems Review, volume 37, pages 29–43. ACM, 2003.
- Y. Gu and R. L. Grossman. “Udt: Udp-based data transfer for high-speed wide area networks.” Computer Networks, 51(7):1777–1799, 2007.
- Martin Placek, Rajkumar Buyya, “A Taxonomy of Distributed Storage Systems”.
- T. Nguyen and M. Nguyen. Zing database: highperformance key-value store for large-scale storage service. Vietnam Journal of Computer Science, pages 1– 11, 2014.
- P. ONeil, E. Cheng, D. Gawlick, and E. ONeil. The logstructured merge-tree (lsm-tree). Acta Informatica, 33(4):351–385, 1996.
- M. Placek and R. Buyya. A taxonomy of distributed storage systems. Reporte tecnico, Universidad de Melbourne, Laboratorio de sistemas distribuidosy computo grid, 2006.
- F. PUB. Secure hash standard (shs). 2012.
- S. Shepler, M. Eisler, D. Robinson, B. Callaghan, R. Thurlow, D. Noveck, and C. Beame. Network file system (nfs) version 4 protocol. Network, 2003.
- J. Stanek, A. Sorniotti, E. Androulaki, and L. Kencl. A secure data deduplication scheme for cloud storage. 2014.
- M. Szeredi et al. Fuse: Filesystem in userspace. Accessed on, 2010.
- S. A. Weil, S. A. Brandt, E. L. Miller, D. D. E. Long, and C. Maltzahn. Ceph: A scalable, high-performance distributed file system. In Proceedings of the 7th Symposium on Operating Systems Design and Implementation, OSDI ’06, pages 307–320, Berkeley, CA, USA, 2006. USENIX Association.