Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

Development of the Performance Benchmark Tool for Data Stream Management Systems Combined with DBMS

DBMS와 결합된 데이터스트림관리시스템을 위한 성능 평가 도구 개발

  • Received : 2010.04.21
  • Accepted : 2010.07.02
  • Published : 2010.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Many applications of DSMS(Data Stream Management System) require not only to process real-time stream data efficiently but also to provide high quality services such as data mining and data warehouse combining with DBMS(Database Management System) to users. In this paper we execute the performance benchmark of the combined system of DSMS and DBMS that is developed for high quality services. We use the stream data of network monitoring application system and combine the traditional representative DSMSs and DBMSs in a single system for the performance testing. We develop the total performance benchmark tool implementing JAVA language for the our testing. For our performance testing, we combine DSMS such as STREAM and Coral8 and DBMS such MySQL and Oracle10g respectively.

데이터스트림 관리시스템(DSMS)의 많은 응용분야에서는 단순한 실시간 스트림 데이터의 효율적인 처리뿐만 아니라 기존의 DBMS와 결합하여 데이터마이닝이나 데이터웨어하우징 같은 고급 서비스를 사용자에게 제공하는 것을 요구하고 있다. 본 논문에서는 고급 서비스를 위하여 DSMS와 DBMS를 결합한 시스템의 성능평가를 위한 도구를 개발하였다. 기존 연구 개발된 대표적인 DSMS와 DBMS를 결합하여 네트워크 모니터링 스트림 데이터를 기반으로 통합된 시스템의 성능평가를 수행하였다. 통합된 시스템의 평가를 위하여 JAVA로 통합 시스템 성능 평가 툴을 개발하였으며, 개발 된 툴을 이용하여 DSMS(STREAM, Coral8)와 DBMS(MySQL, Oracle10g)를 결합한 시스템의 성능평가를 수행하였다

Keywords

References

  1. Golab, L. and Ozsu, M. T., "Issues in Data Stream Management," ACM SIGMOD Record, Vol. 32, No. 2, pp. 5-14, 2003. https://doi.org/10.1145/776985.776986
  2. Babcock, B. et al., "Models and Issues in Data Stream Systems," PODS2002, pp. 1-16, 2002.
  3. Motwani, R. et al., "Query Processing, Approximation, and Resource Management in a Data Stream Management System," In Proc. the First BiennialConf. on Innovative Data Systems Research, Asiloma, California, pp. 245-256, Jan. 2003.
  4. A. Arasu, B. Babcock, S. Babu, J. Cieslewicz, M. Datar, K. Ito, R. Motwani, U. Srivastava and J. Widom, "Stream: The Stanford Data Stream Management System," in IEEE Data Engineering Bulletin, vol. 4(1), pp.19-26, 2003.
  5. S. Chandrasekaran, O. Copper, A. Deshpande, M. J. Franklin, H. Joseph M, W. Hong, S. Krishnamurthy, S. Madden, V. Raman, F. Reiss and M. Shah, "TelegraphCQ: Continuous Dataflow Processing for an Uncertain World," in Proceedings of the Conference on Innovative Data Systems Research, pp.11-18, 2003.
  6. Zdonik, S. et al., "The Aurora and Medusa Projects," IEEE Data Engineering Bulletin, Vol. 26, No. 1, pp. 3-10, 2003.
  7. Jianjun Chen, David J. DeWitt, Feng Tian and Yuan Wang, "NiagaraCQ: A calable Continuous Query Stream for Internet Databases," ACM SIGMOD Record, pp.379-390, 2000.
  8. M. A. Hammad, M. F. Mokbel, M. H. Ali, W. G. Aref, A. C. Catlin, A. K. Elmagarmid, M. Eltabakh, M. G. Elfeky, T. M. Ghanem, R. Gwadera, I. F. Ilyas, M. Marzouk, and X. Xiong. "Nile: A Query Processing Engine for Data Streams", In ICDE, p.851, 2004.
  9. http://www.coral8.com
  10. http://www/streambase.com
  11. Mohamed F. Mokbel , Xiaopeng Xiong, Moustafa A. Hammad , Walid G. Aref, "Continuous Query Processing of Spatio-Temporal Data Streams in PLACE," Geoinformatica, v.9 n.4, p.343-365, 2005. https://doi.org/10.1007/s10707-005-4576-7
  12. F. Reiss and J. Hellerstein. "Data Triage: An Adaptive Architecture for Load Shedding in TelegraphCQ," In IEEE ICDE Conference, pp.155-156, April 2005.
  13. 이충호, 안경환, 이문수, 김주완, "u-GIS 공간정보 기술동향," 전자통신동향분석, 제 22권, 제 3호, 110-123쪽, 2007년.
  14. Coral8, "Guide to Evaluating Complex Event Processing Engines," http://www.coral8.com/system/files/assets/pdf/GuideToEvaluatingCEP Engines.pdf
  15. A. Arasu, M. Cherniack, E. Galvez, D. Maier, A. Maskey, E. Ryvkina, M. Stonebraker, and R. Tibbetts, "Linear Road: A Stream Data Management Benchmark," VLDB 2004, pp.480-491, 2004.
  16. http://datalab.cs.pdx.edu/niagara/NEXMark/
  17. http://www.mysql.org
  18. http://www.oracle.com
  19. Frederick Reiss, Kurt Stockinger, Kesheng Wu, Arie Shoshani, Joseph M. Hellerstein, "Enabling Real-Time Querying of Live and Historical Stream Data," Proceedings of the 19th International Conference on Scientific and Statistical Database Management, p.28, July 09-11, 2007.
  20. http://www.tpc.org
  21. Navendu Jain, Lisa Amini, Henrique Andrade, Richard King, Yoonho Park, Philippe Selo, Chitra Venkatramani, "Design, implementation, and evaluation of the linear road benchmark on the stream processing core," Proceedings of the ACM SIGMOD Conference, pp.431-442, 2006.