KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

An adaptive fault tolerance strategy for cloud storage

  • Xiai, Yan (Hunan University, College of Computer Science and Electronic Engineering) ;
  • Dafang, Zhang (Hunan University, College of Computer Science and Electronic Engineering) ;
  • Jinmin, Yang (Hunan Police Academy, Department of Information Technology)
  • Received : 2016.05.26
  • Accepted : 2016.09.27
  • Published : 2016.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

With the growth of the massive amount of data, the failure probability of the cloud storage node is becoming more and more big. A single fault tolerance strategy, such as replication and erasure codes, has some unavoidable disadvantages, which can not meet the needs of the today's fault tolerance. Therefore, according to the file access frequency and size, an adaptive hybrid redundant fault tolerance strategy is proposed, which can dynamically change between the replication scheme and erasure codes scheme throughout the lifecycle. The experimental results show that the proposed scheme can not only save the storage space(reduced by 32% compared with replication), but also ensure the fast recovery of the node failures(increased by 42% compared with erasure codes).

Keywords

References

  1. YAO Wenbin, HAN Si, and LI Xiaoyong, "Security sharing scheme for encrypted data in cloud storage," Journal on Communications, Vol.36, NO.10, PP.1-8, October 2015.
  2. WANG Hongyuan, ZHU Liehuang, and LILONG Yijia, "Group provable data possession with deduplication in cloud storage," Journal of Software, Vol,27, No, 6, PP.1-16. June 2016.
  3. MICHELE A and STEFANO C, "Replication vs erasure coding in data centric storage for wireless sensor networks," Computer Networks, Vol. 77, No.11, PP.42-55. November 2015. https://doi.org/10.1016/j.comnet.2014.11.018
  4. LUO J Q, MOCHAN S, and XU L H, et al, "Efficient encoding schedules for XOR-based erasure codes[J]," IEEE Transactions on Computers, Vol.63, No.9, PP.2259-2272. September 2014. https://doi.org/10.1109/TC.2013.23
  5. KHAN O, BURNS R, and PLANK J S, "Rethinking erasure codes for cloud file systems: minimizing I/O for recovery and degraded reads," in Proc. of USENIX. FAST 2012: 10th USENIX Conference on File and Storage Technologies. San Jose, CA, PP.1-14, 2012.
  6. FAN B, TANTISIRIROJ W, and XIAO L, et al, "DiskReduce: RAID for data-intensive scalable computing," in Proc. of the Petascale Data Storage Workshop (PDSW 2009). Portland: ACM Press, PP. 6-10, 2009.
  7. ZHANG Z, DESHPANDE A, and Ma X, et al, "Does erasure coding have a role to play in my data center," Microsoft research MSR-TR-2010, 52, 2010.
  8. YADI M, THYAGA N, and KRISHNA P N, et al, "An ensemble of replication and erasure codes for cloud file systems," in Proc. of 2013 Proceedings IEEE INFOCOM, Italy, PP.1276-1284, 2013.
  9. AYE C K andWINT T Z, "Fault tolerant erasure coded replication for HDFS based cloud storage," in Proc. of 2014 IEEE Fourth International Conference on Big Data and Cloud Computing, Sydney, PP.104-109, 2014.
  10. ROY F,YOAV K, and AMIR K, " Replicated erasure codes for storage and repair traffic efficiency," in Proc. of 14-th IEEE International Conference on Peer-to-Peer Computing, London, PP.1-10, 2014.
  11. YANG Dongri, WANG Ying, and LIU Peng, "Fault-tolerrant mechanism combined with replication and error correcting code for clould file systems," Journal of Tsinghua University(SCI &Technol),Vol.54, No1, PP.137-144, January 2014.
  12. SONG Baoyan, WANG Junlu, and WANG Yan, "Optimized storage strategy research of HDFS based on vandermonde code," Chinese Journal of Computers, Vol.38, No.9, PP.:1825-1836, Septmeber 2015.
  13. BHAGWAT D, POLLACK K , and LONG D D, et al, "Providing high reliability in a minimum redundancy archival strorage system," in Proc. of the 14th IEEE International Symposium on MASCOTS. PP.413-421,2016.
  14. LACAN J and FIMES J., "Systematic MDS erasure codes baesd on vandermonde matrices," IEEE Communications Letters, Vol. 8, No. 9, PP. 570-582, Septmeber 2004. https://doi.org/10.1109/LCOMM.2004.833807
  15. PLANK J S, "A tutorial on reed-solomon coding for fault-tolerance in RAID-like systems," Software: Practice and Experience, Vol.27, No.9, PP.995-1012, Septmeber 1997. https://doi.org/10.1002/(SICI)1097-024X(199709)27:9<995::AID-SPE111>3.0.CO;2-6
  16. ZHANG Zhiyun, MENG Huiping, and LI Dun, et al, "Research on dynamic replication redundancy storage strategy based on erasure code," Computer Engineering and Design, Vol.35, NO. 9, PP.3085-3090, Septmeber 2014.
  17. DANIEL F and HAIPING X., "A raid-based secure and fault-tolerant model for cloud information storage," International Journal of Software Engineering & Knowledge Engineering, Vol. 23, No. 5, PP.627-654, May 2013. https://doi.org/10.1142/S0218194013400111
  18. LI Yong, WU Fei, and CHEN Fujie., "Design and management of large scale hierarchical VOD storage system," Journal of Software, Vol.10, No.4, PP.355-358, April 1994.
  19. DU Z, HU J and CHEN Y, "Optimized Qos-aware replica placement heuristics and applications in astronomy data grid," Journal of Systems and Software, Vol.84, No.7, PP.1224-1232, July 2011. https://doi.org/10.1016/j.jss.2011.02.038
  20. CHEN Y, GANAPATHI A, and GRIFFITH R, et al, "The case for evaluating mapReduce performance using workload suites," in Proc. of 19th Annual IEEE International Symposium on Modelling, Singapore, PP.390-399, 2011.