Journal of Electrical Engineering and Technology

The Korean Institute of Electrical Engineers (대한전기학회)
권호 표지
DOI QR코드

DOI QR Code

Vision-based Predictive Model on Particulates via Deep Learning

  • Kim, SungHwan (Department of Statistics, Keimyung University) ;
  • Kim, Songi (Department of Statistics, Keimyung University)
  • Received : 2017.09.19
  • Accepted : 2018.05.23
  • Published : 2018.09.01
Download PDF
⟨ Previous Next ⟩

Abstract

Over recent years, high-concentration of particulate matters (e.g., a.k.a. fine dust) in South Korea has increasingly evoked considerable concerns about public health. It is intractable to track and report $PM_{10}$ measurements to the public on a real-time basis. Even worse, such records merely amount to averaged particulate concentration at particular regions. Under this circumstance, people are prone to being at risk at rapidly dispersing air pollution. To address this challenge, we attempt to build a predictive model via deep learning to the concentration of particulates ($PM_{10}$). The proposed method learns a binary decision rule on the basis of video sequences to predict whether the level of particulates ($PM_{10}$) in real time is harmful (>$80{\mu}g/m^3$) or not. To our best knowledge, no vision-based $PM_{10}$ measurement method has been proposed in atmosphere research. In experimental studies, the proposed model is found to outperform other existing algorithms in virtue of convolutional deep learning networks. In this regard, we suppose this vision based-predictive model has lucrative potentials to handle with upcoming challenges related to particulate measurement.

Keywords

References

  1. R. Bascom, P. Bromberg, D. Costa, R. Devlin, D. Dockery, and M. Frampton, et al, "Health effects of outdoor air pollution," Am J Respir Crit Care Med, vol. 153, no. 1, pp. 477-498, Jan. 1996. https://doi.org/10.1164/ajrccm.153.2.8564086
  2. B. Brunekreef, and S. T. Holgate, "Air pollution and health," The Lancet, vol. 360, pp. 1233-1242, Oct. 2002. https://doi.org/10.1016/S0140-6736(02)11274-8
  3. M. Kampa, and E. Castanas, "Human health effects of air pollution," Environmental Pollution, vol. 151, no. 2, pp. 362-367, Jan. 2008. https://doi.org/10.1016/j.envpol.2007.06.012
  4. C. M. Wong, N. Vichit-Vadakan, H. Kan, and Z. Qian, "Public Health and Air Pollution in Asia (PAPA): a multicity study of short-term effects of air pollution on mortality," Environmental Health Perspectives, vol. 116, no. 9, pp. 1195-1202, sep. 2008. https://doi.org/10.1289/ehp.11257
  5. X. Xia, A . Zhang, S. Liang, Q. Qi, L. Jiang, and Y. Ye, "The Association between Air Pollution and Population Health Risk for Respiratory Infection: A Case Study of Shenzhen, China," Int J Environ Res Public Health, vol. 14, no.9, pp. 950, Aug. 2017. https://doi.org/10.3390/ijerph14090950
  6. H. J. Kim, M. G. Choi, M. K. Park, and Y. R. Seo, "Predictive and Prognostic Biomarkers of Respiratory Diseases due to Particulate Matter Exposure," J Cancer Prev, vol. 22, no. 1, pp. 6-15 Mar. 2017. https://doi.org/10.15430/JCP.2017.22.1.6
  7. H. C. Kim, E.H. Kim, C. H. Bae, J. H. Cho, B. U. Kim, and S. T. Kim, "Regional contributions to particulate matter concentration in the Seoul metropolitan area, South Korea: seasonal variation and sensitivity to meteorology and emissions inventory," Atoms. Chem. Phys., vol. 17, no. 17, pp. 10315-10332, Sep. 2017. https://doi.org/10.5194/acp-17-10315-2017
  8. S. H. Hwang, J. Y. Lee, S. M. Yi, and H. Kim, "Associations of particulate matter and its components with emergency room visits for cardiovascular and respiratory diseases," PLoS ONE, vol. 12, no. 8, Aug. 2017.
  9. J. A. Stark, "Adaptive image contrast enhancement using generalizations of histogram equalization," IEEE Transactions on Image Processing, vol. 9, no. 5, pp. 889-896, May. 2000. https://doi.org/10.1109/83.841534
  10. R. Eschbach and B. W. Kolpatzik, "Image-dependent color saturation correction in a natural scene pictorial image," US Patent 5,450,217, Sep. 1995.
  11. Y. Y. Schechner, S. G. Narasimhan, and S. K. Nayar, "Instant dehazing of images using polarization," Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 325-332, June 2001.
  12. B. Cai, X. Xu, K. Jia, C. Qing, and D. Tao, "Dehaze Net: An End-to-End System for Single Image Haze Removal," IEEE Transactions on Image Processing, vol. 25, no. 11, pp. 5187-5198, Nov. 2016. https://doi.org/10.1109/TIP.2016.2598681
  13. C. Y. Lee, C. T. Lin, C. T. Hong and M. T. Su, "Smoke Detection Using Spatial and Temporal Analyse," International Journal of Innovative computing, Information and Control, vol. 8, no. 6, pp. 4749-4770, June. 2012.
  14. B. U. Toreyin, Y. Dedeoglu, and A. E. Cetin, "Contour based smoke detection in video using wavelets," European Signal Processing Conference, pp. 123-128, Sep. 2006.
  15. T. H. Chen, Y. H. Yin, S. F. Huang, and Y. T. Ye, "The smoke detection for early fire-alarming system based on video processing," in Intelligent Information Hiding and Multimedia Signal Processing, 2006.
  16. M. S. Singh, V. Pondenkandath, B. Zhou, P. Lukowicz, and M. Liwicki, "Transforming Sensor Data to the Image Domain for Deep Learning - an Application to Footstep Detection," International Joint Conference on Neural Networks (IJCNN), May 2017.
  17. X. Ma, Z. Dai, Z. He, J. Ma, Y. Wang and Y. Wang, "Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction," Sensors (Basel), vol. 17, no. 4, Apr. 2017.
  18. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet Classification with Deep Convolutional NeuralNetworks," In Proceedings of the 25th International Conference on Neural Information Processing Systems, pp. 1097-1105, Dec. 2012.
  19. M. Oquab, L. Bottou, I. Laptev, and J. Sivic, "Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks," Computer Vision and Pattern Recognition, pp. 1717-1724, June. 2014.
  20. S. Lawrence, C. L. Giles, A. C. Tsoi, A.D. Back, "Face recognition: A convolutional neural-network approach," IEEE Trans. Neural Networks, vol. 8, no. 1, pp. 98-113, Feb. 1997. https://doi.org/10.1109/72.554195
  21. S. Ji, W. Xu, M. Yang, and K. Yu, "3D Convolutional Neural Networks for Human Action Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 35, no. 1, pp. 221-231, Jan. 2013. https://doi.org/10.1109/TPAMI.2012.59
  22. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and F. F. Li, "Large-Scale Video Classification with Convolutional Neural Networks," In Processedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1725-1732, June. 2014.
  23. U. Brunelli, V. Piazza, L. Pignato, F. Sorbello, S. Vitabile, "Two-days ahead prediction of daily maximum concentrations of $SO_2$, $O_3$, PM10, $NO_2$, CO in the urban area of Palermo, Italy," Atmospheric Environment, vol. 41, no. 14, pp. 2967-2995, May. 2007. https://doi.org/10.1016/j.atmosenv.2006.12.013
  24. R. Vautard, B. Bessagnet, M. Chin, and L. Menut, "On the contribution of natural Aeolian sources to particulate matter concentrations in Europe: Testing hypotheses with a modelling approach," Atmospheric Environment, vol. 39, no. 18, pp. 3291-3303, June. 2005. https://doi.org/10.1016/j.atmosenv.2005.01.051
  25. T. Ni, B. Han, Z. Bai, "Source Apportionment of PM10 in Four Cities of Northeastern China," Aerosol Air Qual. Res, vol. 12, pp. 571-582, 2012. https://doi.org/10.4209/aaqr.2011.12.0243
  26. J. Hooyberghs, C. Mensink, G. Dumont, F. Fierens, O. Brasseur, "A neural network forecast for daily average PM10 concentrations in Belgium," Atmospheric Environment, vol. 39, no. 18, pp. 3279-3289, June. 2005. https://doi.org/10.1016/j.atmosenv.2005.01.050
  27. E. Stadlober, S. Hormann, and B. Pfeiler, "Quality and performance of a PM10 daily forecasting model," Atmospheric Environment, vol. 42, no. 6, pp. 1098-1109, Feb. 2008. https://doi.org/10.1016/j.atmosenv.2007.10.073
  28. S. Min, B. Lee and S. Yoon, "Deep learning in bioinformatics," Briefings in Bioinformatics, July 2016.
  29. Q. Li, T. W. Cai, X. Wang, et al, "Medical image classification with convolutional neural network," In: 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV), pp. 844-848, Mar. 1997.
  30. N. Liu, J. Han, D. Zhang, et al, "Predicting eye fixations using convolutional neural networks," In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 362-370, June. 2015.
  31. G. Hinton, L. Deng, D. Yu, et al, "Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups," IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82-97, Nov. 2012. https://doi.org/10.1109/MSP.2012.2205597
  32. TN. Sainath, A-R. Mohamed, B. Kingsbury, et al, "Deep convolutional neural networks for LVCSR," In: 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, New York, pp. 8614-8618, 2013.
  33. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "LeNet-5, convolutional neural networks," Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998. https://doi.org/10.1109/5.726791
  34. M. Aubreville, C. Knipfer, N. Oetter, C. Jaremenko, E. Rodner, J. Denzler, C. Bohr, H. Neumann, F. Stelzle, and A. Maier, "Automatic Classification of Cancerous Tissue in Laserendomicroscopy Images of the Oral Cavity using Deep Learning," Computer Vision and Pattern Recognition, vol. 2, Mar. 2017.
  35. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei, "ImageNet Large Scale Visual Recognition Challenge," International Journal of Computer Vision (IJCV), vol. 115, no. 3, pp. 211-252, Dec. 2015. https://doi.org/10.1007/s11263-015-0816-y
  36. T. Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollar, and C. L. Zitnick, "Microsoft coco: Common objects in context," in European Conference on Computer Vision. Springer, vol. 8693 pp. 740-755, 2014.
  37. C. Szegedy, V. Vanhoucke, S. Ioffe, and J. Shlens, "Rethinking the Inception Architecture for Computer Vision," Computer Vision and Pattern Recognition, vol. 3, Dec. 2015.
  38. M. S. Singh, V. Pondenkandath, B. Zhou, P. Lukowicz and M. Liwicki, "Transforming Sensor Data to the Image Domain for Deep Learning - an Application to Footstep Detection," International Joint Conference on Neural Networks (IJCNN), May 2017.
  39. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, "Going deeper with convolutions," Computer Vision and Pattern Recognition, June 2015.
  40. J. Yosinski, J. Clune, Y. Bengio, and H. Lipson, "How transferable are features in deep neural networks?," Advances in Neural Information Processing Systems 27, pp. 3320-3328, Dec. 2014.
  41. L. Rokach, "Ensemble-based classifiers," Artificial Intelligence Review, vol. 33, no. 1-2, pp. 1-39, Feb. 2010. https://doi.org/10.1007/s10462-009-9124-7
  42. H. C. Kim, E. Kim, C. Bae, J. H. Cho, B. Kim, and S. Kim, "Regional contributions to particulate matter concentration in the Seoul metropolitan area, South Korea: seasonal variation and sensitivity to meteorology and emissions inventory," Atmos. Chem. Phys., 17, pp. 10315-10332, 2017. https://doi.org/10.5194/acp-17-10315-2017
  43. S. Kim, "Weighted K-means support vector machine for cancer prediction," SpringerPlus, 5:1162, 2016. https://doi.org/10.1186/s40064-016-2677-4