DOI QR코드

DOI QR Code

Offline Deduplication for Solid State Disk Using a Lightweight Hash Algorithm

  • Park, Eunsoo (College of Information & Communication Engineering, Sungkyunkwan University) ;
  • Shin, Dongkun (College of Information & Communication Engineering, Sungkyunkwan University)
  • Received : 2015.04.21
  • Accepted : 2015.09.24
  • Published : 2015.10.30

Abstract

Deduplication technique can expand the lifespan and capacity of flash memory-based storage devices by eliminating duplicated write operations. The deduplication techniques can be classified into two approaches, i.e., online and offline approaches. We propose an offline deduplication technique that uses a lightweight hash algorithm, whereas the previous offline technique uses a high-cost hash algorithm. Therefore, the memory space for caching hash values can be reduced, and more pages can be examined for deduplication during short idle intervals. As a result, it can provide shorter write latencies compared to the online approach, and can show low garbage collection costs compared to the previous offline deduplication technique.

Keywords

References

  1. Y.-H. Chang, J.-W. Hsieh, and T.-W. Kuo, "Endurance enhancement of flash-memory storage systems: An efficient static wear leveling design," Design Automation Conference, pp.212-217, Jun., 2007.
  2. S. Boboila and P. Desnoyers, "Write endurance in flash drives: measurements and analysis," File and storage technologies, the 8th USENIX conference on, Vol.10, pp.9-9, Feb., 2010.
  3. Chen, Feng, Tian Luo, and Xiaodong Zhang, "CAFTL: A Content-Aware Flash Translation Layer Enhancing the Lifespan of Flash Memory based Solid State Drives," File and storage technologies, USENIX conference on, Vol. 11, Feb., 2011.
  4. Andersen, David G., and Steven Swanson, "Rethinking flash in the data center," IEEE micro 4, pp.52-54, 2010. https://doi.org/10.1109/MM.2010.71
  5. Meyer, Dutch T., and William J. Bolosky, "A study of practical deduplication," ACM Transactions on Storage, 7.4:14, 2012.
  6. A. Jeongcheol, S. Dongkun, "Offline Deduplication-Aware Block Separation for Solid State Disk," File and storage technologies, USENIX conference on, 2013.
  7. N. Agrawal et al., "Design Tradeoffs SSD Performance," USENIX Annual Technical Conference, Jun., 2008.
  8. R. Koller et al., "I/O Deduplication: Utilizing Content Similarity to Improve I/O Performance," ACM Transactions on Storage, 6.3, 2010.