Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

A Deep Learning-based Streetscapes Safety Score Prediction Model using Environmental Context from Big Data

빅데이터로부터 추출된 주변 환경 컨텍스트를 반영한 딥러닝 기반 거리 안전도 점수 예측 모델

  • Lee, Gi-In (Dept. of Media Technology Contents., The Catholic University of Korea) ;
  • Kang, Hang-Bong (Dept. of Media Technology Contents., The Catholic University of Korea)
  • Received : 2017.07.19
  • Accepted : 2017.07.31
  • Published : 2017.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Since the mitigation of fear of crime significantly enhances the consumptions in a city, studies focusing on urban safety analysis have received much attention as means of revitalizing the local economy. In addition, with the development of computer vision and machine learning technologies, efficient and automated analysis methods have been developed. Previous studies have used global features to predict the safety of cities, yet this method has limited ability in accurately predicting abstract information such as safety assessments. Therefore we used a Convolutional Context Neural Network (CCNN) that considered "context" as a decision criterion to accurately predict safety of cities. CCNN model is constructed by combining a stacked auto encoder with a fully connected network to find the context and use it in the CNN model to predict the score. We analyzed the RMSE and correlation of SVR, Alexnet, and Sharing models to compare with the performance of CCNN model. Our results indicate that our model has much better RMSE and Pearson/Spearman correlation coefficient.

Keywords

References

  1. Chatterton, Paul, and R. Hollands, Urban Nightscapes: Youth Cultures, Pleasure Spaces and Corporate Power, Psychology Press, Hove, United Kingdom, 2003.
  2. M. Roberts and A. Eldridge, Planning the Night-time City, Routledge, Abingdon, United Kingdom, 2012.
  3. S.H. Kim, "The Impact of Local Festivals on Local Economy," Korean Public Administration Review, Vol. 39, No. 4, pp. 221-246, 2005.
  4. G. Helms. Towards Safe City Centres?: Remaking the Spaces of an Old-industrial City, Ashgate Publishing Ltd, Aldershot, United Kingdom, 2012.
  5. J. Bachner, Predictive Policing: Preventing Crime with Data and Analytics, IBM Center for the Business of Government, Washington, D.C., 2013.
  6. The Santa Cruz Experiment: Can a City's Crime Be Predicted?(2011). http://www.popsci.com/science/article/2011-10/santa-cruz-experiment (accessed Jul., 16, 2017).
  7. J.Q. Wilson and G.L. Kelling, "Broken Windows," Atlantic Monthly, Vol. 249, No. 3, pp. 29-38, 1982.
  8. G.O. Mohler, M.B. Short, P.J. Brantingham, F.P. Schoengberg, and G.E. Tita. "Self-exciting Point Process Modeling of Crime," Journal of the American Statistical Association, Vol. 106, No. 493, pp. 100-108, 2011. https://doi.org/10.1198/jasa.2011.ap09546
  9. P. Salesses, K. Schechtner, and C.A. Hidalgo, "The Collaborative Image of the City: Mapping the Inequality of Urban Perception," PloS one Vol. 8, No. 7, e68400, 2013. https://doi.org/10.1371/journal.pone.0068400
  10. Ordonez, Vicente, and T.L. Berg. "Learning High-level Judgments of Urban Perception," European Conference on Computer Vision, pp. 494-510, 2014.
  11. A. Khosla, B.A. An, J.J. Lim, and A. Torralba, "Looking Beyond the Visible Scene," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3710-3717, 2014.
  12. N. Naik, J. Philipoom, R. Raskar, and C. Hidalgo, "Streetscore-predicting the Perceived Safety of One Million Streetscapes," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 779-785, 2014.
  13. G.S. Matthew, "Predicting Crime Using Twitter and Kernel Density Estimation," Decision Support Systems, Vol. 61, pp. 115-125, 2014. https://doi.org/10.1016/j.dss.2014.02.003
  14. Chen, Xinyu, Y.W. Cho, and S.Y. Jang. "Crime prediction Using Twitter Sentiment and Weather," Procceding of Systems and Information Engineering Design Symposium, pp. 63-68, 2015.
  15. Xia, Chen, F. Qi, and G. Shi. "Bottom-up Visual Saliency Estimation with Deep Autoencoder-based Sparse Reconstruction," IEEE Transactions on Neural Networks and Learning Systems, Vol. 27, No. 6, pp. 1227-1240, 2016. https://doi.org/10.1109/TNNLS.2015.2512898
  16. J. Masci, U. Meier, D. Ciresan, and J. Schmidhuber, "Stacked Convolutional Auto-encoders for Hierarchical Feature Extraction," Artificial Neural Networks and Machine Learning-ICANN 2011, pp. 52-59, 2011.
  17. S. Chen and T. Joachims, "Predicting Matchups and Preferences in Context," KDD, pp. 775-784, 2016.
  18. R. Herbrich, T. Minka, and T. Graepel, "True-$Skill^{TM}$: A Bayesian Skill Rating System," Advances in Neural Information Processing Systems, pp. 569-576, 2007.
  19. O. Aude and A. Torralba, "Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope," International Journal of Computer Vision, Vol. 42, No. 3, pp. 145-175, 2001. https://doi.org/10.1023/A:1011139631724
  20. P. Florent, J. Sanchez, and T. Mensink, "Improving the Fisher Kernel for Large-scale Image Classification," Computer Vision-ECCV 2010, pp. 143-156, 2010.
  21. J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, et al. "Decaf: A Deep Convolutional Activation Feature for Generic Visual Recognition," Proceeding of International Conference on Machine Learning, pp. 647-655, 2014.
  22. D. Navneet and B. Triggs, "Histograms of Oriented Gradients for Human Detection," Proceeding of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1, pp. 886-893, 2005.
  23. M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, et al. "Tensorflow: Large-scale Machine Learning on Heterogeneous Distributed Systems," arXiv Preprint arXiv: 1603.04467, 2016.
  24. P.M. Conzens, G. Saville, and D. Hillier, "Crime Prevention through Environmental Design (CPTED): A Review and Modern Bibliography," Property Management, Vol. 23, No. 5, pp. 328-356, 2005. https://doi.org/10.1108/02637470510631483
  25. I.H. Choi and S.H. Lee, "Content-based Image Retrieval using Reature Extraction in Wavelet Transform Domain," Journal of Korea Multimedia Society, Vol. 5, No. 4, pp.415-425, 2002.