Design and Implementation of Cloud-based Sensor Data Management System

클라우드 기반 센서 데이터 관리 시스템 설계 및 구현

  • 박경욱 (전남대학교 문화콘텐츠학부) ;
  • 김경옥 (순천대학교 컴퓨터과학과) ;
  • 반경진 (순천대학교 컴퓨터과학과) ;
  • 김응곤 (순천대학교 컴퓨터과학과)
  • Received : 2010.10.20
  • Accepted : 2010.12.10
  • Published : 2010.12.31

Abstract

Recently, the efficient management system for large-scale sensor data has been required due to the increasing deployment of large-scale sensor networks. In this paper, we propose a cloud-based sensor data management system with low cast, high scalability, and efficiency. Sensor data in sensor networks are transmitted to the cloud through a cloud-gateway. At this point, outlier detection and event processing is performed. Transmitted sensor data are stored in the Hadoop HBase, distributed column-oriented database, and processed in parallel by query processing module designed as the MapReduce model. The proposed system can be work with the application of a variety of platforms, because processed results are provided through REST-based web service.

최근 대규모 센서 네트워크의 구축이 증가하면서 대규모의 센서 데이터를 효율적으로 관리하는 시스템이 요구되고 있다. 본 논문에서는 저비용, 높은 확장성 그리고 고 효율성을 지닌 클라우드 기반의 센서 데이터 관리 시스템을 제안한다. 제안된 시스템에서는 센서 데이터는 클라우드 게이트웨이를 통해 클라우드로 전송되며 이때 이상상황 검출과 이벤트 처리가 수행된다. 클라우드로 전송된 센서 데이터는 분산 컬럼 지향 데이터 베이스인 하둡 HBase에 저장되며 맵리듀스 모델 기반의 질의처리 모듈을 통해 병렬 처리된다. 처리된 결과는 REST 기반의 웹서비스를 통해 제공되므로 다양한 플랫폼의 응용프로그램과 연동이 가능하다.

Keywords

References

  1. K. Aberer, G. Alonso, and D. Kossmann, "Data Management for a Smart Earth-The Swiss NCCR-MICS initiative", SIGMOD Record, Vol. 35, No. 4, pp. 40-45, 2006 https://doi.org/10.1145/1228268.1228277
  2. K. Aberer, M. Hauswirth, and A. Salehi, "Infrastructure for Data Processing in Large-Scale Interconnected Sensor Networks", 2007 International Conference on Mobile Data Management, pp. 198-205, May 2007.
  3. C. Jardak, J. Riihijärvi, and P. Mähönen, "Extremely Large-scale Sensing Applications for Planetary WSNs", In Proceedings of the 2nd ACM international Workshop on Hot Topics in Planet-Scale Measurement, pp. 1-6, June 2010.
  4. K. Aberer, G. Alonso, and D. Kossmann, "Data Management for a Smart Earth", SIGMOD Record, Vol. 35, No. 4, pp. 40-45, 2006. https://doi.org/10.1145/1228268.1228277
  5. B. Hayes, "Cloud Computing", Communications of The ACM, Vol. 51, No. 7, pp. 9-11, July 2008. https://doi.org/10.1145/1364782.1364786
  6. I. Foster, Y. Zhao, I. Raicu, and S. Lu, "Cloud computing and Grid Computing 360-Degree Compared", Grid Computing Environment Workshop(GCE'08), pp. 1-10, Nov. 2008.
  7. R. Buyya, C. S. Yeo, and S. Venugopal, "Market-Oriented Cloud Computing: Vision, Hype, and Reality for Delivering IT Services as Computing Utilities", Proceedings of the 2008 10th IEEE International Conference on High Performance Computing and Communications, pp. 5-13, 2008.
  8. J. Dean and S. Ghemawat, "Mapreduce: Simplified Data Processing on Large Clusters", In OSDI'04: 6th Symposium on Operating System Design and Implementation, December 2004.
  9. H. Liu and D. Orban, "GridBatch: Cloud Computing for Large-Scale Data-Intensive Batch Applications", Proc. 8th IEEE International Symposium on Cluster Computing and the Grid (CCGRID'08), pp. 295-305, May 2008.
  10. C. Vecchiola, S. Pandey, and R. Buyya, "High-Performance Cloud Computing: A View of Scientific Applications", 2009 10th International Symposium on Pervasive Systems, Algorithms, and Networks, pp. 4-16, 2009.
  11. V. Rajesh, J. M. Gnanasekar, R. S. Ponmagal, and P. Anbalagan, "Integration of Wireless Sensor Network with Cloud", 2010 International Conference on Recent Trends in Information, Telecommunication and Computing, pp. 321-323, 2010.
  12. M. Hassan, B. Song, and E. Huh, "A Framework of Sensor-cloud Integration Opportunities and Challenges", Conference On Ubiquitous Information Management And Communication, pp. 618-626, 2009.
  13. X. Lee, S. Lee, P. T. True, L. T. Vinh, A. M. Khattak, M. Han, D. V. Hung, M. M. Hassan, M. Kim, K. Koo, Y. Lee, and E. Huh, "Secured WSN-integrated cloud computing for u-life care", In Proceedings of the 7th IEEE Conference on Consumer Communications and Networking Conference, pp. 702-703, Jan. 2010.
  14. Hadoop : http://hadoop.apache.org
  15. HBase : http://hadoop.apache.org/hbase
  16. Roy Thomas Fielding, "Architectural Styles and the design of Network-based Software Architectures", PhD. thesis, University of California, Irvine, 2000.