KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Smoke detection in video sequences based on dynamic texture using volume local binary patterns

  • Lin, Gaohua (State Key Laboratory of Fire Science, University of Science and Technology of China) ;
  • Zhang, Yongming (State Key Laboratory of Fire Science, University of Science and Technology of China) ;
  • Zhang, Qixing (State Key Laboratory of Fire Science, University of Science and Technology of China) ;
  • Jia, Yang (School of Computer Science and Technology, Xi'an University of Posts and Telecommunications) ;
  • Xu, Gao (State Key Laboratory of Fire Science, University of Science and Technology of China) ;
  • Wang, Jinjun (State Key Laboratory of Fire Science, University of Science and Technology of China)
  • Received : 2017.03.04
  • Accepted : 2017.06.27
  • Published : 2017.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, a video based smoke detection method using dynamic texture feature extraction with volume local binary patterns is studied. Block based method was used to distinguish smoke frames in high definition videos obtained by experiments firstly. Then we propose a method that directly extracts dynamic texture features based on irregular motion regions to reduce adverse impacts of block size and motion area ratio threshold. Several general volume local binary patterns were used to extract dynamic texture, including LBPTOP, VLBP, CLBPTOP and CVLBP, to study the effect of the number of sample points, frame interval and modes of the operator on smoke detection. Support vector machine was used as the classifier for dynamic texture features. The results show that dynamic texture is a reliable clue for video based smoke detection. It is generally conducive to reducing the false alarm rate by increasing the dimension of the feature vector. However, it does not always contribute to the improvement of the detection rate. Additionally, it is found that the feature computing time is not directly related to the vector dimension in our experiments, which is important for the realization of real-time detection.

Keywords

References

  1. Wang, Yang, and G. Mori. "Human Action Recognition by Semilatent Topic Models," IEEE Transactions on Pattern Analysis & Machine Intelligence 31.10, 1762-74, 2009. https://doi.org/10.1109/TPAMI.2009.43
  2. Fu, Y., Hospedales, T., Xiang, T., & Gong, S. "Attribute learning for understanding unstructured social activity," European Conference on Computer Vision Springer-Verlag, 530-543, 2012.
  3. Fu, Y., Hospedales, T. M., Xiang, T., & Gong, S. "Learning multimodal latent attributes," IEEE Transactions on Pattern Analysis & Machine Intelligence, 36(2), 303-316, 2014. https://doi.org/10.1109/TPAMI.2013.128
  4. Cetin, Enis A, Gunay, et al. "Video fire detection - Review," Digital Signal Processing, 23(6):1827-1843, 2013. https://doi.org/10.1016/j.dsp.2013.07.003
  5. A. Enis Cetin, Bart Merci, Osman Gunay, Behcet Ugur Toreyin and Steven Verstockt, Methods and Techniques for Fire Detection, 39-42, 2016.
  6. Toreyin, B. Ugur, Yigithan Dedeoglu, and A. Enis Cetin. "Contour based smoke detection in video using wavelets," in Proc. of Signal Processing Conference, 2006 14th European. IEEE, 2006.
  7. Chen, Thou-Ho, Ping-Hsueh Wu, and Yung-Chuen Chiou. "An early fire-detection method based on image processing," in Proc. of Image Processing, 2004. ICIP'04. 2004 International Conference on. Vol. 3. IEEE, 2004.
  8. Genovese, A., Labati, R. D., Piuri, V., & Scotti, F. "Wildfire smoke detection using computational intelligence techniques," in Proc. of Computational Intelligence for Measurement Systems and Applications (CIMSA), 2011 IEEE International Conference on. IEEE, 2011.
  9. Yuan, Feiniu. "A fast accumulative motion orientation model based on integral image for video smoke detection," Pattern Recognition Letters 29.7, 925-932, 2008. https://doi.org/10.1016/j.patrec.2008.01.013
  10. Chunyu, Y., Jun, F., Jinjun, W., & Yongming, Z. "Video fire smoke detection using motion and color features," Fire technology 46.3, 651-663, 2010. https://doi.org/10.1007/s10694-009-0110-z
  11. Jia, Y., Yuan, J., Wang, J., Fang, J., Zhang, Q., & Zhang, Y. "A saliency-based method for early smoke detection in video sequences," Fire Technology 5.52, 1271-1292, 2016.
  12. Ojala, Timo, Matti Pietikainen, and Topi Maenpaa. "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Transactions on pattern analysis and machine intelligence 24.7, 971-987, 2002. https://doi.org/10.1109/TPAMI.2002.1017623
  13. Yuan, Feiniu. "Video-based smoke detection with histogram sequence of LBP and LBPV pyramids," Fire safety journal 46.3, 132-139, 2011. https://doi.org/10.1016/j.firesaf.2011.01.001
  14. Yuan, F., Shi, J., Xia, X., Yang, Y., Fang, Y., & Wang, R. "Sub Oriented Histograms of Local Binary Patterns for Smoke Detection and Texture Classification," KSII Transactions on Internet and Information Systems (TIIS) 10.4, 1807-1823, 2016. https://doi.org/10.3837/tiis.2016.04.019
  15. Tian, H., Li, W., Ogunbona, P., Nguyen, D. T., & Zhan, C. "Smoke detection in videos using non-redundant local binary pattern-based features," in Proc. of Multimedia Signal Processing (MMSP), 2011 IEEE 13th International Workshop on. IEEE, 2011.
  16. Zhao, Guoying, and Matti Pietikainen. "Dynamic texture recognition using local binary patterns with an application to facial expressions," IEEE transactions on pattern analysis and machine intelligence 29.6, 915-928, 2007. https://doi.org/10.1109/TPAMI.2007.1110
  17. Zhao, Guoying, and Matti Pietikainen. "Local binary pattern descriptors for dynamic texture recognition," in Proc. of Pattern Recognition, 2006. ICPR 2006. 18th International Conference on. Vol. 2. IEEE, 2006.
  18. Chen, Junzhou, Yong You, and Qiang Peng. "Dynamic analysis for video based smoke detection," International Journal of Computer Science Issues10.2, 298-304, 2013.
  19. Gunay, Osman, and A. Enis Cetin. "Real-time dynamic texture recognition using random sampling and dimension reduction," in Proc. of Image Processing (ICIP), 2015 IEEE International Conference on. IEEE, 2015.
  20. http://signal.ee.bilkent.edu.tr/VisiFire/Demo/SampleClips.html
  21. Jiang, Y. G., Wu, Z., Wang, J., Xue, X., & Chang, S. F. "Exploiting feature and class relationships in video categorization with regularized deep neural networks," IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017.
  22. Boser, Bernhard E., Isabelle M. Guyon, and Vladimir N. Vapnik. "A training algorithm for optimal margin classifiers," Proceedings of the fifth annual workshop on Computational learning theory, ACM, 1992.
  23. Cortes, Corinna, and Vladimir Vapnik. "Support-vector networks," Machine learning 20.3, 273-297, 1995. https://doi.org/10.1007/BF00994018
  24. Li H. D., Yuan F. N. "Image based smoke detection using pyramid texture and edge features," Journal of Image and Graphics, 20(6):0772-0780, 2015.

Cited by

  1. SmokeNet: Satellite Smoke Scene Detection Using Convolutional Neural Network with Spatial and Channel-Wise Attention vol.11, pp.14, 2017, https://doi.org/10.3390/rs11141702