DOI QR코드

DOI QR Code

An Analysis of Big Video Data with Cloud Computing in Ubiquitous City

클라우드 컴퓨팅을 이용한 유시티 비디오 빅데이터 분석

  • Lee, Hak Geon (School of Computer Science and Engineering, University of Seoul) ;
  • Yun, Chang Ho (School of Computer Science and Engineering, University of Seoul) ;
  • Park, Jong Won (School of Computer Science and Engineering, University of Seoul) ;
  • Lee, Yong Woo (School of Computer Science and Engineering, University of Seoul)
  • Received : 2013.07.31
  • Accepted : 2014.04.11
  • Published : 2014.06.30

Abstract

The Ubiquitous-City (U-City) is a smart or intelligent city to satisfy human beings' desire to enjoy IT services with any device, anytime, anywhere. It is a future city model based on Internet of everything or things (IoE or IoT). It includes a lot of video cameras which are networked together. The networked video cameras support a lot of U-City services as one of the main input data together with sensors. They generate huge amount of video information, real big data for the U-City all the time. It is usually required that the U-City manipulates the big data in real-time. And it is not easy at all. Also, many times, it is required that the accumulated video data are analyzed to detect an event or find a figure among them. It requires a lot of computational power and usually takes a lot of time. Currently we can find researches which try to reduce the processing time of the big video data. Cloud computing can be a good solution to address this matter. There are many cloud computing methodologies which can be used to address the matter. MapReduce is an interesting and attractive methodology for it. It has many advantages and is getting popularity in many areas. Video cameras evolve day by day so that the resolution improves sharply. It leads to the exponential growth of the produced data by the networked video cameras. We are coping with real big data when we have to deal with video image data which are produced by the good quality video cameras. A video surveillance system was not useful until we find the cloud computing. But it is now being widely spread in U-Cities since we find some useful methodologies. Video data are unstructured data thus it is not easy to find a good research result of analyzing the data with MapReduce. This paper presents an analyzing system for the video surveillance system, which is a cloud-computing based video data management system. It is easy to deploy, flexible and reliable. It consists of the video manager, the video monitors, the storage for the video images, the storage client and streaming IN component. The "video monitor" for the video images consists of "video translater" and "protocol manager". The "storage" contains MapReduce analyzer. All components were designed according to the functional requirement of video surveillance system. The "streaming IN" component receives the video data from the networked video cameras and delivers them to the "storage client". It also manages the bottleneck of the network to smooth the data stream. The "storage client" receives the video data from the "streaming IN" component and stores them to the storage. It also helps other components to access the storage. The "video monitor" component transfers the video data by smoothly streaming and manages the protocol. The "video translator" sub-component enables users to manage the resolution, the codec and the frame rate of the video image. The "protocol" sub-component manages the Real Time Streaming Protocol (RTSP) and Real Time Messaging Protocol (RTMP). We use Hadoop Distributed File System(HDFS) for the storage of cloud computing. Hadoop stores the data in HDFS and provides the platform that can process data with simple MapReduce programming model. We suggest our own methodology to analyze the video images using MapReduce in this paper. That is, the workflow of video analysis is presented and detailed explanation is given in this paper. The performance evaluation was experiment and we found that our proposed system worked well. The performance evaluation results are presented in this paper with analysis. With our cluster system, we used compressed $1920{\times}1080(FHD)$ resolution video data, H.264 codec and HDFS as video storage. We measured the processing time according to the number of frame per mapper. Tracing the optimal splitting size of input data and the processing time according to the number of node, we found the linearity of the system performance.

유비쿼터스 시티(유시티)에서는 수많은 비디오 카메라들이 설치된다. 이렇게 설치된 많은 카메라로부터 대용량의 비디오 데이터가 실시간으로 끊임없이 발생하고 유시티의 관리 시스템으로 전달된다. 유시티의 다양한 서비스들을 뒷받침하기 위해서는 이러한 비디오 데이터를 저장하고, 이렇게 저장된 대용량의 비디오 데이터를 분석할 수 있는 방법과 관리 시스템이 요구된다. 그래서, 이 논문에서는 클라우드 컴퓨팅을 기반으로 한 유시티 비디오 관리 시스템을 제안한다. 또한, 근래 주목받고 있는 데이터 병렬처리 프레임워크인 Hadoop MapReduce를 이용하여 이러한 빅데이터 비디오를 분석하는 방법을 제안하고, 이에 따른 우리의 성능 평가를 소개한다.

Keywords

References

  1. Cho, B.S., Jeong, W.S., Cho, H.S., "A Study on the Business and Trend of u-City", Electronics and Telecommunications Trends, vol. 21, no. 4, pp. 152-162, 2006.
  2. Burn, U.I., Nam, Y.Y., Cho, W.D., "Agent-based Automatic Camera Placement for Video Surveillance Systems" Journal of Korean Society for Internet Information, vol. 11, no.1, pp.103-116, 2010.
  3. Jung, H.S., Jeong, C.S., Lee, Y.W. and Hong P.D., "An Intelligent Ubiquitous Middleware for U-City: SmartUM," Journal of information science and engineering, vol. 25, pp.375-388, 2009.
  4. Jung, H.S., Baek, J.K., Jeong, C.S., Lee, Y.W. and Hong, P.D., "Unified Ubiquitous Middleware for U-City," Proceedings of the International Conference on Convergence Information Technology 2007 (ICCIT 07), pp.2347-2379, 2007.
  5. Apache Hadoop [Online] Available: http://hadoop.apache.org/
  6. Dean, J. and Ghemawat, S., "MapReduce: Simplified Data Processing on Large Clusters," Proceedings of OSDI, pp.137-150, 2004.
  7. Detmold, H., Hengel, A.V.D., Dick, A.R., Falkner, K.E., Munro, D.S. and Morrison, R., "Middleware for Distributed Video Surveillance," IEEE Distributed systems Online, vol.9, no.2, pp. 1-10, 2008.
  8. Hampaur, A., Borger, S., Brown, L., Carlson, C., Connell, J., Lu, M., Senior, A., Reddy, V., Shu, C. and Tian, Y., "S3 : The IBM Smart Surveillance System: From Transactional Systems to Observational Systems," Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing 2007 (ICASSP 07), vol. 4, pp.1385-1388, 2007.
  9. Valera, M. and Velastin, S.A., "Intelligent distributed surveillance systems: a review," Proceedings of the IEE Vision, Image and Signal Processing, vol. 152, no. 2, pp.192-204. 2005. https://doi.org/10.1049/ip-vis:20041147
  10. Lin, C.F. Yuan, S., Leu, M. and Tsai, C., "A Framework for Scalable Cloud Video Recorder System in Surveillance Environment," Proceedings of the Ubiquitous Intelligence & Computing and 9th International Conference on Autonomic & Trusted Computing (UIC/ATC 12), pp.655-660, 2012.
  11. Rodriguez-Silva, D.A., Adkinson-Orellana, L., Gonz'lez-Castano, F.J., Armino-Franco, I. and Gonz'lez-Martinez, D., "Video Surveillance Based on Cloud Storage," Proceedings of the IEEE Cloud Computing (CLOUD 12), pp.991-992, 2012.
  12. Wu, Y.S., Chang, Y.S., Jang, T.Y. and Yen, J.S., "An Architecure for Video Surveillance Service based on P2P and Cloud Computing," Proceedings of the Ubiquitous Intelligence & Computing and 9th International Conference on Autonomic & Trusted Computing (UIC/ATC 12), Sept. 2012, pp.661-666.
  13. Hossain, M.S., Hassan, M.M., Qurishi, M.A. and Alghamdi, A., "Resource Allocation for Service Composition in Cloud-based Video Surveillance Platform," Proceedings of the IEEE International Conference on Multimedia and Expo Workshops (ICMEW 12), pp.408-412, 2012.
  14. Karimaa, Aleksandra, "Video Surveillance in the Cloud: Dependability Analysis," Proceeding of the 4th International Conference on Dependability (DEPEND 11), pp. 92-95, 2011.
  15. Pereira, R., Azambuja, M., Breitman, K. and Endler, M., "An Architecture for Distributed High Performance Video Processing in the Cloud," Proceedings of the IEEE 3rd International Conference on Cloud Computing (CLOUD 10), pp.482-489, 2010
  16. White, B., Yeh, T., Lin, J. and Davis, L., "Web-Scale Computer Vision using MapReduce for Multimedia Data Mining," Proceedings of the 10th International Workshop on Multimedia Data Mining (MDMKDD 10), pp.1-10, 2010.
  17. Kim, Y.B., Kim. T.H., Lee, D.G., Kim. J.J., "Performance improvement for Streaming of High Capacity Panoramic Video" Journal of Korean Society for Internet Information, vol. 11, no.2, pp.143-153, 2010.
  18. Nam, Y.Y., Choi, Y.J, Cho, W.D, "Human Activity Recognition using an Image Sensor and a 3-axis Accelerometer Sensor" Journal of Korean Society for Internet Information, vol. 11, no.1, pp.129-141, 2010.
  19. Kim, M.Y., Jeon, H.S., Yeom, J.Y., Park, H.J., "An Improvement for Location Accuracy Algorithm of Moving Indoor Objects" Journal of Korean Society for Internet Information, vol. 11, no.2, pp.61-72, 2010.

Cited by

  1. 스마트시티의 빅 센서 데이터와 빅 GIS 데이터를 융합하여 실시간 온라인 소음지도로 시각화하기 위한 분산병렬처리 방법론 vol.19, pp.4, 2018, https://doi.org/10.7472/jksii.2018.19.4.1