DOI QR코드

DOI QR Code

Development and Assessment of Real-Time Quality Control Algorithm for PM10 Data Observed by Continuous Ambient Particulate Monitor

부유분진측정기(PM10) 관측 자료 실시간 품질관리 알고리즘 개발 및 평가

  • Kim, Sunyoung (Environmental Meteorology Research Division, National Institute of Meteorological Sciences) ;
  • Lee, Hee Choon (Environmental Meteorology Research Division, National Institute of Meteorological Sciences) ;
  • Ryoo, Sang-Boom (Environmental Meteorology Research Division, National Institute of Meteorological Sciences)
  • 김선영 (국립기상과학원 환경기상연구과) ;
  • 이희춘 (국립기상과학원 환경기상연구과) ;
  • 류상범 (국립기상과학원 환경기상연구과)
  • Received : 2016.06.24
  • Accepted : 2016.09.13
  • Published : 2016.12.31

Abstract

A real-time quality control algorithm for $PM_{10}$ concentration measured by Continuous Ambient Particulate Monitor (FH62C14, Thermo Fisher Scientific Inc.) has been developed. The quality control algorithm for $PM_{10}$ data consists of five main procedures. The first step is valid value check. The values should be within the acceptable range limit. Upper ($5,000{\mu}g\;m^{-3}$) and lower ($0{\mu}g\;m^{-3}$) values of instrument detectable limit have to be eliminated as being unrealistic. The second step is valid error check. Whenever unusual condition occurs, the instrument will save error code. Value having an error code is eliminated. The third step is persistence check. This step checks on a minimum required variability of data during a certain period. If the $PM_{10}$ data do not vary over the past 60 minutes by more than the specific limit ($0{\mu}g\;m^{-3}$) then the current 5-minute value fails the check. The fourth step is time continuity check, which is checked to eliminate gross outlier. The last step is spike check. The spikes in the time series are checked. The outlier detection is based on the double-difference time series, using the median. Flags indicating normal and abnormal are added to the raw data after quality control procedure. The quality control algorithm is applied to $PM_{10}$ data for Asian dust and non-Asian dust case at Seoul site and dataset for the period 2013~2014 at 26 sites in Korea.

Keywords

References

  1. Chae, J.-H., M.-S. Park, and Y.-J. Choi, 2014: The WISE quality control system for integrated meteorological sensor data. Atmosphere, 24, 445-456 (in Korean with English abstract). https://doi.org/10.14191/Atmos.2014.24.3.445
  2. Easterling, D. R., and T. C. Peterson, 1995: A new method for detecting undocumented discontinuities in climatological time series. Int. J. Climatol., 15, 369-377. https://doi.org/10.1002/joc.3370150403
  3. Feng, S., Q. Hu, and W. Qian, 2004: Quality control of daily meteorological data in China, 1951-2000: A new dataset. Int. J. Climatol., 24, 853-870. https://doi.org/10.1002/joc.1047
  4. Fiebrich, C. A., and K. C. Crawford, 2001: The impact of unique meteorological phenomena detected by Oklahoma Mesonet and ARS micronet on automated quality control. Bull. Amer. Meteor. Soc., 82, 2173-2187. https://doi.org/10.1175/1520-0477(2001)082<2173:TIOUMP>2.3.CO;2
  5. Jiang, Z., Z. Liu, T. Wang, C. S. Schwartz, H.-C. Lin, and F. Jiang, 2013: Probing into the impact of 3DVAR assimilation of surface PM10 observations over China using process analysis. J. Geophys. Res., 118, 6738-6749.
  6. Kim, K.-J., S.-H. Lee, D.-R. Hyeon, H.-J. Ko, W.-H. Kim, and C. H. Kang, 2014: Composition comparison of PM10 and PM2.5 file particulate matter for Asian dust and haze events of 2010-2011 at Gosan site in Jeju Island. Anal. Sci. Tech., 17, 1-10 (in Korean with English abstract).
  7. KMA, 2011: Manual for Quality Control of National Climate Data. KMA, 57 pp.
  8. KMA, 2015: The Guidelines for Integrated Data Quality Management of National Climate Data. KMA, 83 pp.
  9. Lanci, M., and C. Lussana, 2009: An automated data quality control procedure applied to a mesoscale meteorological network. Proc., 9th EMS annual meeting/9th European Conf. Applications of Meteorol., Toulouse, 335 pp.
  10. Lee, J.-D., Y. Choi, and C. Park, 2010: Developments of quality control algorithms for Korean temperature data. J. Climate Res., 5, 162-174 (in Korean with English abstract).
  11. Liljegren, J. C., S. Tschopp, K. Rogers, F. Wasmer, and L. Liljegren, 2009: Quality control of meteorological data for the chemical stockpile emergency preparedness program. J. Atmos. Oceanic Technol., 26, 1510-1526. https://doi.org/10.1175/2009JTECHA1268.1
  12. National Institute of Meteorological Science, 2014: Handbook of Asian Dust Observation Environment. KMA, 114 pp.
  13. Nie, S.-P., Y. Luo, W.-P. Li, T.-W. Wu, X.-L. Shi, and Z.-Z. Wang, 2012: Quality control and analysis of global gause-based daily precipitation dataset from 1980 to 2009. Adv. Climate Change Res., 3, 45-53. https://doi.org/10.3724/SP.J.1248.2012.00045
  14. Papale, D., and Coauthors, 2006: Towards a standardized processing of Net Ecosystem Exchange measured with eddy covariance technique: algorithm and uncertainty estimation. Biogeosciences, 3, 71-583. https://doi.org/10.5194/bgd-3-71-2006
  15. Ryoo, S.-B., Y.-H. Kim, T.-H. Kwon, and I.-S. Park, 2006:Inhomogeneities in Korean climate data (I): Due to site relocation. Atmosphere, 16, 215-223 (in Korean with English abstract).
  16. Shin, H.-J., J.-S. Shon, S.-A. Noh, J.-H. Park, M.-D. Lee, J.-C. Kim, and S.-J. Lee, 2014: Air quality data analysis system and air quality data analysis method. KRA-1020140082564, 22 pp.
  17. Thermo Fisher Scientific, 2010: FH62C14 Continuous Ambient Particulate Monitor Instruction Manual.
  18. WMO, 2013: Guide to the Implementation of a Quality Management System for National Meteorological and Hydrological Services. WMO-No.1100, 85 pp.
  19. Zahumensky, I., 2004: Guidelines on Quality Control Procedures for Data from Automatic Weather Stations. WMO CIMO/OPAG-SURFACE/ET-ST&MT-1/Doc., 6.1(2), 10 pp.

Cited by

  1. Research on Data Mining Algorithm of Meteorological Observation Based on Data Quality Control Algorithm vol.102, pp.2, 2018, https://doi.org/10.1007/s11277-018-5258-8