KIPS Transactions on Computer and Communication Systems (정보처리학회논문지:컴퓨터 및 통신 시스템)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Deployment and Performance Analysis of Data Transfer Node Cluster for HPC Environment

HPC 환경을 위한 데이터 전송 노드 클러스터 구축 및 성능분석

  • 홍원택 (한국과학기술정보연구원) ;
  • 안도식 (한국과학기술정보연구원 슈퍼컴퓨팅인프라센터) ;
  • 이재국 (한국과학기술정보연구원 슈퍼컴퓨팅인프라센터) ;
  • 문정훈 (한국과학기술정보연구원) ;
  • 석우진 (한국과학기술정보연구원)
  • Received : 2020.07.17
  • Accepted : 2020.07.28
  • Published : 2020.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

Collaborative research in science applications based on HPC service needs rapid transfers of massive data between research colleagues over wide area network. With regard to this requirement, researches on enhancing data transfer performance between major superfacilities in the U.S. have been conducted recently. In this paper, we deploy multiple data transfer nodes(DTNs) over high-speed science networks in order to move rapidly large amounts of data in the parallel filesystem of KISTI's Nurion supercomputer, and perform transfer experiments between endpoints with approximately 130ms round trip time. We have shown the results of transfer throughput in different size file sets and compared them. In addition, it has been confirmed that the DTN cluster with three nodes can provide about 1.8 and 2.7 times higher transfer throughput than a single node in two types of concurrency and parallelism settings.

HPC(High Performance Computing) 서비스를 기반으로 한 거대과학 응용분야의 협업연구는 원거리에 떨어져 있는 연구자들 사이에서 대용량 데이터의 빠른 전송을 필요로 한다. 이와 관련하여 최근 미국 내의 주요 슈퍼컴퓨터들을 연계하여 고속 전송하기 위한 연구들이 수행되고 있다. 본 논문에서는 기 구축되어 운영 중인 한국과학기술정보연구원의 누리온 슈퍼컴퓨터 병렬 파일시스템 내의 대용량 데이터를 고속 전송하기 위해서 고성능 과학기술연구망 기반의 데이터 전송 노드(DTN) 클러스터를 구축하고 종단간 왕복지연 시간이 약 130ms에 달하는 원거리 전송 실험을수행한다. 실험을 통해 다른 크기의 파일들로 구성된 실험 군들에 대해 DTN 클러스터링에 따른 전송 성능을 비교하였고, 3대의 멀티 노드로 구성된 DTN 클러스터는 두 종류의 병행성, 병렬성 설정에서 단일 노드 대비 각각 약 1.8, 2.7배의 전송 성능 향상을 가져올 수 있음을 확인하였다.

Keywords

References

  1. A. Khan, T. Kim, H. Byun, and Y. Kim, "SCISPACE: A scientific collaboration workspace for geo-distributed HPC data centers," International Journal of Future Generation Computer Systems, Vol.101, pp.398-409, 2019. https://doi.org/10.1016/j.future.2019.06.006
  2. C. Laat, E. Radius, and S. Wallace, "The rationale of the current optical networking initiatives," International Journal of Future Generation Computer Systems, Vol.19, No.6, pp.999-1008, 2003. https://doi.org/10.1016/S0167-739X(03)00077-3
  3. E. Dart, L. Rotman, B. Tierney, M. Hester, and J. Zurawski, "The Science DMZ: A Network Design Pattern for Data-Intensive Science," Proceedings of IEEE/ACM Annual SuperComputing Conference (SC13), Denver, USA, Nov. 2013.
  4. J. Crichigno, E. Bou-Harb, and N. Ghani, "A Comprehensive Tutorial on Science DMZ," IEEE Communications Surveys & Tutorials, Vol.21, No.2, pp.2041-2078, 2019. https://doi.org/10.1109/COMST.2018.2876086
  5. Petascale DTN project [Internet], https://cs.lbl.gov /newsmedia/news/2017/esnets-petascale-dtn-project-speeds-up-data-transfers-between-leading-hpc-centers/.
  6. E. Yildirim, E. Arslan, J. Kim, and T. Kosar, "Application-Level Optimization of Big Data Transfers through Pipelining, Parallelism and Concurrency," IEEE Transactions on Cloud Computing, Vol.4, No.1, pp.63-75, 2016. https://doi.org/10.1109/TCC.2015.2415804
  7. Z. Liu, R. Kettimuthu, I. Foster, and N. Rao, "Cross-Geography Scientific Data Transferring Trends and Behavior," Proceedings of the 27th International Symposium on High-Performance Parallel and Distributed Computing, New York, USA, Jun. 2018.
  8. Globus project [Internet], https://docs.globus.org/ globusconnect-server/.
  9. ESnet DTNs [Internet], https://fasterdata.es.net/ performancetesting/DTNs/.
  10. R. Kettimuthu, Z. Liu, D. Wheeler, I. Foster, K. Heitmann, and F. Cappello, "Transferring a Petabyte in a Day," International Journal of Future Generation Computer Systems, Vol.88, pp.191-198, 2018. https://doi.org/10.1016/j.future.2018.05.051
  11. Z. Liu, R. Kettimuthu, I. Foster, and Y. Liu, "A Comprehensive Study of Wide Area Data Movement at a Scientific Computing Facility," Proceedings of IEEE International Conference on Distributed Computing Systems, Vienna, Austria, Jul. 2018.
  12. Y. Liu, Z. Liu, R. Kettimuthu, N. Rao, Z. Chen, and I. Foster, "Data transfer between scientific facilities - bottleneck analysis, insights, and optimizations," Proceedings of the 19th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), Larnaca, Cyprus, May 2019.
  13. L. Zhang, W. Wu, P. DeMar, and E. Pouyoul, "mdtmFTP and its evaluation on ESNET SDN testbed," International Journal of Future Generation Computer Systems, Vol.79, pp.199-204, 2018. https://doi.org/10.1016/j.future.2017.04.024
  14. J. Bresnahan, M. Link, R. Kettimuthu, D. Fraser, and I. Foster, "GridFTP Pipelining," Proceedings of the TeraGrid2007 Conference, Madison, USA, Jun. 2007.