The Journal of the Korea institute of electronic communication sciences (한국전자통신학회논문지)

Korea Institute of Electronic Communication Science (한국전자통신학회)
권호 표지
DOI QR코드

DOI QR Code

Implementation of Ring Buffer based Massive VLBI Data Stream Input/Output over the Wide Area Network

광역 네트워크 상의 링 버퍼 기반 대용량 VLBI 데이터 스트림 입출력 구현

  • 송민규 (한국천문연구원 전파천문본부) ;
  • 김효령 (한국천문연구원 전파천문본부) ;
  • 강용우 (한국천문연구원 전파천문본부) ;
  • 제도흥 (한국천문연구원 전파천문본부) ;
  • 위석오 (한국천문연구원 전파천문본부) ;
  • 이성모 (한국천문연구원 전파천문본부)
  • Received : 2019.10.22
  • Accepted : 2019.12.15
  • Published : 2019.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

In the field of VLBI, If the quality of the connected network between the VLBI station and the correlation center is ensured, the existing inefficiency of repeatedly storing the observation data in each station and the correlation center can be overcome. In other words, the data center can be unified with the correlation center where data analysis is performed, which can improve data processing speed and productivity. In this paper, we design a massive VLBI data system that directly transmits and stores the observation data stream obtained from the VLBI station to the correlation center via the high - speed network KREONET. Based on this system, VLBI test observations confirmed that the observation data was stored perfectly in the recording system of the correlation center without a single packet loss.

VLBI 연구 분야에서 관측소와 상관센터 간 네트워크의 품질이 보장된다면 관측 데이터를 각 관측소와 상관센터에 반복 저장하던 기존의 비효율을 극복할 수 있다. 즉, 데이터 분석 작업이 수행되는 상관센터로 데이터 저장을 일원화할 수 있고 이를 통해 데이터 처리의 신속성, 생산성을 향상시킬 수 있다. 이를 구현하기 위해 본 논문에서는 VLBI 관측소에서 생산되는 관측 데이터 스트림을 초고속 네트워크 KREONET을 경유해 상관센터로 직접 전송, 저장하는 원격 기록 시스템을 설계하였다. 이 시스템을 기반으로 데이터 기록을 실시한 결과 패킷 손실이 최소화된 상태에서 관측 데이터가 상관센터의 기록시스템에 안정적으로 저장된 것을 확인하였다.

Keywords

References

  1. J. Mcdonough, "Moving standards to 100 GbE and beyond," IEEE Communications Mag., vol. 45, no. 11, 2007, pp. 6-9. https://doi.org/10.1109/MCOM.2007.4378339
  2. A. Whitney, C. Beaudoin, R. Cappallo, B. Corey, G. Crew, S. Doeleman, D. Lapsley, A. Hinton, S. McWhirter, and A. Niell, "Demonstration of a 16 Gbps Station-1 Broadband-RF VLBI System," Publications of the Astronomical Society of the Pacific, vol. 125.924, no. 196, 2013. pp. 196-203. https://doi.org/10.1086/669718
  3. R. Cappallo, C. Ruszczyk, and A. Whitney, "Mark6: Design and Status," Reports of the Finnish Geodetic Institute, vol. 5, no. 8, Mar. 2013, pp. 9-12.
  4. A. Szomoru, "EXPReS and the e-EVN," The 9th European VLBI Network Symp. on The role of VLBI in the Golden Age for Radio Astronomy and EVN Users Meeting, vol. 72. Sept. 2009, pp. 1-8.
  5. S. Lee, L. Petrov, D. Byun, J. Kim, T. Jung, M. Song, C. Oh, D. Roh, D. Je, S. Wi, B. Sohn, S. Oh, K. Kim, J. Yeom, M. Chung, J. Kang, S. Han, J. Lee, B. Kim, H. Chung, H. Kim, H. Kim, Y. Kang, and S. Cho, "Early science with the Korean VLBI network: evaluation of system performance," The Astronomical J. vol. 147.4, no. 77, 2014, pp. 1-14. https://doi.org/10.1088/0004-6256/147/4/77
  6. M. Song, H. Kim, D. Byun, T. Jung, Y. Kang, H. Kim, J. Kim, S. Wi, S. Lee, D. Roh, S. Oh, and J. Yeom, The Design and Implementation of e-KVN Network for the Data Processing in Wideband VLBI Observation. Daejoen: Korea Astronomy and Space Science Institute, 2019, pp. 3-5.
  7. D. Thompson and J. Best, "The future of magnetic data storage techology," IBM J. of Research and Development, vol. 44, no. 3, 2000, pp. 311-322. https://doi.org/10.1147/rd.443.0311
  8. M. Song, Y. Kwang, and H. Kim, "Performance Evaluation of Big Stream based High Speed Data Storage," J. of the Korea Institute of Electronic Communication Sciences, vol. 12, no. 5, Oct. 2017, pp. 817-827. https://doi.org/10.13067/JKIECS.2017.12.5.817
  9. J. Vetter and S. Mittal, "Opportunities for nonvolatile memory systems in extreme-scale high-performance computing," Computing in Science & Engineering, vol. 17, no. 2, Jan. 2015, pp. 73-82. https://doi.org/10.1109/MCSE.2015.4
  10. D. Luca, "Improving passive packet capture: Beyond device polling," In Proc. of SANE, Amsterdam, Netherlands, 2004, pp. 85-93.
  11. S. Zhang, W. Li, Y. Zhang, and T. Wu, "Flow Control System Performance Optimization Based-On Zero-Copy," International Conf. on Information Computing and Applications, Chengde, China, 2012, pp. 834-839.
  12. M. Song, Y. Kang, and H. Kim, "The Study on the Design and Optimization of Storage for the Recording of High Speed Astronomical Data," J. of the Korea Institute of Electronic Communication Sciences, vol. 12, no. 1, Jan. 2017, pp. 75-84. https://doi.org/10.13067/JKIECS.2017.12.1.75