KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Crowd escape event detection based on Direction-Collectiveness Model

  • Wang, Mengdi (School of Control Science and Engineering Shandong University) ;
  • Chang, Faliang (School of Control Science and Engineering Shandong University) ;
  • Zhang, Youmei (School of Control Science and Engineering Shandong University)
  • Received : 2017.07.30
  • Accepted : 2018.04.11
  • Published : 2018.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

Crowd escape event detection has become one of the hottest problems in intelligent surveillance filed. When the 'escape event' occurs, pedestrians will escape in a disordered way with different velocities and directions. Based on these characteristics, this paper proposes a Direction-Collectiveness Model to detect escape event in crowd scenes. First, we extract a set of trajectories from video sequences by using generalized Kanade-Lucas-Tomasi key point tracker (gKLT). Second, a Direction-Collectiveness Model is built based on the randomness of velocity and orientation calculated from the trajectories to express the movement of the crowd. This model can describe the movement of the crowd adequately. To obtain a generalized crowd escape event detector, we adopt an adaptive threshold according to the Direction-Collectiveness index. Experiments conducted on two widely used datasets demonstrate that the proposed model can detect the escape events more effectively from dense crowd.

Keywords

References

  1. Y. Benabbas, N. Ihaddadene, C. Djeraba, "Motion Pattern Extraction and Event Detection for Automatic Visual Surveillance," Eurasip Journal on Image & Video Processing, vol. 8, pp. 1-15, December, 2011.
  2. C. Wang, X. Y. Wu, N. N. Li, et al., "Abnormal detection based on gait analysis," 10th World Congress on Intelligent Control and Automation, pp. 4859-4864, IEEE, Beijing, China, July, 2012.
  3. M. M. Najafabadi, M. Rahmati, "Anomaly detection in structured/unstructured crowd scenes," in Proc. of 7th Int. Conf. on Digital Information Management, pp. 79-83, IEEE, Macao, China, August, 2012.
  4. D. G. Lee, H. I. Suk, S. W. Lee, "Crowd behavior representation using motion influence matrix for anomaly detection," in Proc. of 2nd IAPR Asian Conf. on Pattern Recognition, pp. 110-114, IEEE Computer Society, Naha, Japan, November, 2013.
  5. R. Mehran, A. Oyama, M. Shah, "Abnormal crowd behavior detection using social force model," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, pp. 935-942, IEEE, Miami, Florida, June, 2009.
  6. B. L. Zhou, X. O. Tang, H. P. Zhang, et al., "Measuring crowd collectiveness," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 36, no. 8, pp. 1586-1599, June, 2014. https://doi.org/10.1109/TPAMI.2014.2300484
  7. B. B. Zhan, D. N. Monekosso, P. Remagnino, et al., "Crowd analysis: a survey," Machine Vision and Applications, vol. 19, no. 5, pp. 345-357, April, 2008. https://doi.org/10.1007/s00138-008-0132-4
  8. O. P. Popoola, K. J. Wang, "Video-Based Abnormal Human Behavior Recognition-A Review," IEEE Trans. Systems, Man, and Cybernetics, Part C, vol. 42, no. 6, pp. 865-878, January, 2012. https://doi.org/10.1109/TSMCC.2011.2178594
  9. Y. H. Zhang, L. Qin, H. X. Yao, et al., "Abnormal crowd behavior detection based on social attribute-aware force model," in Proc. of 19th IEEE Int. Conf. Image Processing, pp. 2689-2692, IEEE, Orland, Florida, September, 2012.
  10. S. Zaidenberg, P. Bilinski, F. Bremond, "Towards Unsupervised Sudden Group Movement Discovery for Video Surveillance," in Proc. of 9th Int. Joint Conf. on Computer Vision, Imaging and Computer Graphics Theory and Applications, pp.388-395, IEEE, Lisbon, Portugal, January, 2014.
  11. T. Xu, P. Peng, X. Fang, et al., "Single and multiple view detection, tracking and video analysis in crowded environments," in Proc. of 10th IEEE Int. Conf. on Advanced Video and Signal Based Surveillance, pp. 494-499, Beijing, China, September, 2012.
  12. S. Cosar, G. Donatiello, V. Bogorny, et al., "Towards Abnormal Trajectory and Event Detection in Video Surveillance," IEEE Trans. Circuits and Systems for Video Technology, vol. 27, no. 3, pp. 683-695, March, 2017. https://doi.org/10.1109/TCSVT.2016.2589859
  13. C. Piciarelli, C. Micheloni, G. L. Foresti, "Trajectory-Based Anomalous Event Detection," IEEE Trans. Circuits and Systems for Video Technology, vol. 18, no. 11, pp. 1544-1554, November, 2008. https://doi.org/10.1109/TCSVT.2008.2005599
  14. J. Trojanova, K Krehnac, F Bremond, "Data-Driven Motion Pattern Segmentation in a Crowded Environments," in Proc. of Proceedings of ECCV 2016 Workshops, pp. 760-774, Springer, Amsterdam, Netherlands, October, 2016.
  15. H. Fradi, J. L. Dugelay, "Spatial and temporal variations of feature tracks for crowd behavior analysis," Journal on Multimodal User Interfaces, vol.10, no. 4, pp. 307-317, December, 2016. https://doi.org/10.1007/s12193-015-0179-2
  16. G. G. Xiong, X. Y. Wu, Y. L. Chen, et al., "Abnormal crowd behavior detection based on the energy model," in Proc. of IEEE Int. Conf. on Information and Automation, pp. 495-500, IEEE, Shenzhen, China, June, 2011.
  17. E. Cermeno, S. Mallor, J. A. Siguenza, "Learning crowd behavior for event recognition," in Proc. of IEEE Int. Workshop on Performance Evaluation of Tracking and Surveillance, pp. 1-5, IEEE, Clearwater Beach, Florida, January, 2013.
  18. B. Wang, M. Ye, X. Li, et al., "Abnormal crowd behavior detection using high-frequency and spatio-temporal features," Machine Vision and Applications, vol. 23, no. 3, pp. 501-511, May, 2012. https://doi.org/10.1007/s00138-011-0341-0
  19. L. Kratz, K. Nishino, "Anomaly detection in extremely crowd scenes using spatio-temporal motion pattern models," in Proc. of IEEE Int. Conf. on Computer Vision and Pattern Recognition, pp. 1446-1453, IEEE, Miami, Florida, June, 2009.
  20. Y. Wang, K. Q. Huang, T. N. Tan, "Abnormal Activity Recognition in Office Based on R Transform," in Proc. of 14th IEEE Int. Conf. on Image Processing, pp. 341-344, IEEE, San Antonio, Texas, September, 2007.
  21. F. Nater, H. Grabner, T. Jaeggli, et al., "Tracker trees for unusual event detection," in Proc. of 12th IEEE Int. Conf. on Computer Vision Workshops, pp. 1113-1120, IEEE, Kyoto, Japan, November, 2009.
  22. Y. M. Zhang, F. L. Chang, M. D. Wang, et al., "Auxiliary learning for Crowd Counting via Count-net," Neurocomputing, vol. 273, no. 17, pp. 190-198, August, 2017.
  23. C. S. Liu, F. L. Chang, Z. X. Chen, et al., "Fast Traffic Sign Recognition via High-Contrast Region Extraction and Extended Sparse Representation," IEEE Trans. Intelligent Transportation Systems, vol. 17, no.1, pp.79-92, August, 2015. https://doi.org/10.1109/TITS.2015.2459594
  24. D. H. Hu, X. X. Zhang, J. Yin, et al., "Abnormal activity recognition based on HDP-HMM models," in Proc. of Proceedings of the 21st Int. Joint Conf. on Artificial Intelligence, pp. 1715-1720, Pasadena, California, July, 2009.
  25. D. Zhang, D. G. Perez, S. Bengio, et al., "Semi-Supervised Adapted HMMs for Unusual Event Detection," in Proc. of IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 611-618, San Diego, California, June, 2005.
  26. C. Tomasi, T. Kanade, "Shape and Motion from Image Streams under Orthography: a Factorization Method," International Journal of Computer Vision, vol. 9, no. 2, pp. 137-154, November, 1992. https://doi.org/10.1007/BF00129684
  27. J. Ferryman, A. Shahrokni, "PETS2009: Dataset and challenge," in Proc. of 12th IEEE Int. Workshop on Performance Evaluation of Tracking and Surveillance, pp. 355-360, IEEE, Snowbird, Utah, December, 2009.
  28. UMN Dataset. [Online]. Available: http://mha.cs.umn.edu/movies/crowdactivity-all.avi.
  29. WEB Dataset. [Online]. Available: http://commerce.wazeedigital.com.
  30. S. Wu, H. S. Wong, Z. W. Yu, "A Bayesian Model for Crowd Escape Behavior Detection," IEEE Trans. Circuits and Systems for Video Technology, vol. 24, no. 1, pp. 85-98, August, 2014. https://doi.org/10.1109/TCSVT.2013.2276151
  31. G. G. Xiong, J. Cheng, X. Y. Wu, et al., "An energy model approach to people counting for abnormal crowd behavior detection," Neurocomputing, vol.83, no. 7, pp. 121-135, April, 2012. https://doi.org/10.1016/j.neucom.2011.12.007
  32. Y. Cong, J. S. Yuan, J. Liu, "Abnormal event detection in crowded scenes using sparse representation," Pattern Recognition, vol. 46, no. 7, pp. 1851-1864, July, 2013. https://doi.org/10.1016/j.patcog.2012.11.021