Journal of the Korea institute for structural maintenance and inspection (한국구조물진단유지관리공학회 논문집)

Korea Institute for Structural Maintenance Inspection (한국구조물진단유지관리공학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Atmospheric Turbulence-Induced Errors in Vision Sensor based Structural Displacement Measurement

대기외란시 비전센서를 활용한 구조물 동적 변위 측정 성능에 관한 연구

  • Junho Gong (Department of Future & Smart Construction Research, Korea Institute of Civil Engineering and Building Technology)
  • 공준호 (한국건설기술연구원 미래스마트건설연구본부)
  • Received : 2024.05.21
  • Accepted : 2024.05.29
  • Published : 2024.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

This study proposes a multi-scale template matching technique with image pyramids (TMI) to measure structural dynamic displacement using a vision sensor under atmospheric turbulence conditions and evaluates its displacement measurement performance. To evaluate displacement measurement performance according to distance, the three-story shear structure was designed, and an FHD camera was prepared to measure structural response. The initial measurement distance was set at 10m, and increased with an increment of 10m up to 40m. The atmospheric disturbance was generated using a heating plate under indoor illuminance condition, and the image was distorted by the optical turbulence. Through preliminary experiments, the feasibility of displacement measurement of the feature point-based displacement measurement method and the proposed method during atmospheric disturbances were compared and verified, and the verification results showed a low measurement error rate of the proposed method. As a result of evaluating displacement measurement performance in an atmospheric disturbance environment, there was no significant difference in displacement measurement performance for TMI using an artificial target depending on the presence or absence of atmospheric disturbance. However, when natural targets were used, RMSE increased significantly at shooting distances of 20 m or more, showing the operating limitations of the proposed technique. This indicates that the resolution of the natural target decreases as the shooting distance increases, and image distortion due to atmospheric disturbance causes errors in template image estimation, resulting in a high displacement measurement error.

본 연구는 대기외란 조건에서 비전센서를 활용하여 구조물의 동적 변위 측정을 위하여 멀티스케일 템플릿 매칭 기법 (TMI: Template Matching with Image pyramids)을 제안하고 제안기법의 변위 측정 성능을 조사하기 위해 진행되었다. 촬영거리에 따른 변위 측정 성능을 평가하기 위해 3층 전단 구조물을 설계하였으며, FHD(1920×1080)급 카메라를 준비하여 변위 계측에 사용하였다. 최초 촬영거리를 10m로 설정하였고, 10m씩 멀어지면서 최대 40m까지 변위 측정 실험을 진행하였다. 실내 조도 조건(450lux)에서 발열 기구를 활용하여 대기외란을 발생시켰으며, 대기외란으로 이미지를 왜곡시켰다. 사전실험을 통해 대기외란시 특징점 기반 변위 측정 방법과 제안기법의 변위 측정 타당성을 비교 검증하였으며, 검증 결과 제안기법의 낮은 측정 에러율을 나타냈다. 대기외란 환경에서 변위 측정 성능평가 결과, 인공 타겟을 활용한 TMI는 대기외란 유무에 따라 변위 측정 성능에 큰 차이가 없었다. 하지만 자연 타겟을 활용하였을 때, 20m 이상의 촬영거리에서 RMSE가 크게 상승하여 제안기법의 운용 한계를 보여줬다. 이는 촬영거리 증가에 따라 자연 타겟의 해상도가 저하되며, 대기외란으로 인한 이미지 왜곡이 템플릿 이미지 추정에 오류가 발생 되어 변위 측정 오차가 높게 발생하는 경향을 나타냈다.

Keywords

Acknowledgement

본 연구는 과학기술정보통신부 한국건설기술연구원 연구운영비지원(주요사업)사업으로 수행되었습니다(20240143-001, 미래 건설산업견인 및 신시장 창출을 위한 스마트 건설기술 연구).

References

  1. ASCE (2021), 2021 Report Card for America's Infrastructures, American Society of Civil Engineers.
  2. ICE (2014), The State of the Nation: Infrastructure 2014, Institution of Civil Engineers.
  3. Spencer Jr, B. F., Hoskere, V., and Narazaki, Y. (2019), Advances in computer vision-based civil infrastructure inspection and monitoring, Engineering, 5(2), 199-222.
  4. Celik, O., Dong, C. Z., and Catbas, F. N. (2018), A computer vision approach for the load time history estimation of lively individuals and crowds, Computers & Structures, 200, 32-52.
  5. Kim, S. W., Jeon, B. G., Kim, N. S., and Park, J. C. (2013), Vision-based monitoring system for evaluating cable tensile forces on a cable-stayed bridge, Structural Health Monitoring, 12(5-6), 440-456.
  6. Cha, Y. J., Chen, J. G., and Buyukozturk, O. (2017), Output-only computer vision based damage detection using phase-based optical flow and unscented Kalman filters, Engineering Structures, 132, 300-313.
  7. Feng, D., and Feng, M. Q. (2015), Model updating of railway bridge using in situ dynamic displacement measurement under trainloads, Journal of Bridge Engineering, 20(12), 04015019.
  8. Poozesh, P., Sarrafi, A., Mao, Z., and Niezrecki, C. (2017), Modal parameter estimation from optically-measured data using a hybrid output-only system identification method, Measurement, 110, 134-145.
  9. Lee, J. J., and Shinozuka, M. (2006), A vision-based system for remote sensing of bridge displacement, Ndt & E International, 39(5), 425-431.
  10. Feng, D., Feng, M. Q., Ozer, E., and Fukuda, Y. (2015), A vision-based sensor for noncontact structural displacement measurement, Sensors, 15(7), 16557-16575.
  11. Yoon, H., Elanwar, H., Choi, H., Golparvar-Fard, M., and Spencer Jr, B. F. (2016), Target-free approach for vision-based structural system identification using consumer-grade cameras, Structural Control and Health Monitoring, 23(12), 1405-1416.
  12. Xu, Y., and Brownjohn, J. M. (2018). Review of machine-vision based methodologies for displacement measurement in civil structures. Journal of Civil Structural Health Monitoring, 8, 91-110.
  13. Kohut, P., Holak, K., Uhl, T., Ortyl, L., Owerko, T., Kuras, P., and Kocierz, R. (2013), Monitoring of a civil structure's state based on noncontact measurements, Structural Health Monitoring, 12(5-6), 411-429.
  14. Lee, J., Cho, S., and Sim, S. (2014), Vision-Based Displacement Measurement System Operable at Arbitrary Positions, Journal of the Korea Institute for Structural Maintenance and Inspection, 18(6), 123-130 (in Korean).
  15. Luo, L., Feng, M. Q., and Wu, J. (2020), A comprehensive alleviation technique for optical-turbulence-induced errors in vision-based displacement measurement, Structural Control and Health Monitoring, 27(3), e2496.
  16. Liu, J., Xue, B., and Cui, L. (2016, November), Analysis of statistical properties of atmospheric turbulence-induced image dancing based on Hilbert transform and dense optical flow, 2016 IEEE 13th International Conference on Signal Processing (ICSP), IEEE, 702-707.
  17. Badali, A. P., Zhang, Y., Carr, P., Thomas, P. J., and Hornsey, R. I. (2005, October). Scale factor in digital cameras. In Photonic Applications in Biosensing and Imaging (Vol. 5969, pp. 556-565). SPIE.
  18. Hijazi, A., Friedl, A., and Kahler, C. J. (2011), Influence of camera's optical axis non-perpendicularity on measurement accuracy of two-dimensional digital image correlation, Jordan Journal of Mechanical and Industrial Engineering, 5(4), 1-10.
  19. Fukuda, Y., Feng, M. Q., and Shinozuka, M. (2010), Cost-effective vision-based system for monitoring dynamic response of civil engineering structures, Structural Control and Health Monitoring, 17(8), 918-936.
  20. Lucas, B. D., and Kanade, T. (1981, August), An iterative image registration technique with an application to stereo vision, Proceeding of 7th international joint conference on Artificial intelligence, Canadam Vol. 2, 674-679.
  21. Tomasi, C., and Kanade, T. (1991), Detection and tracking of point, Int J Comput Vis, 9, 137-154.
  22. Shi, J. and Tomasi, C. (1994, June), Good features to track, 1994 Proceedings of IEEE conference on computer vision and pattern recognition, IEEE, Seattle WA USA, 593-600.
  23. Bay, H., Tuytelaars, T., and Van Gool, L. (2006), Surf: Speeded up robust features, Computer Vision-ECCV 2006: 9th European Conference on Computer Vision, Springer Berlin Heidelberg, Graz, Austria, 404-417.
  24. Lowe, D. G. (2004), Distinctive image features from scale-invariant keypoints, International Journal of Computer Vision, 60, 91-110.
  25. Alcantarilla, P. F., Bartoli, A., and Davison, A. J. (2012), KAZE features, Computer Vision-ECCV 2012: 12th European Conference on Computer Vision, Springer Berlin Heidelberg, 214-227.
  26. Alsaade, F. (2012), Fast and accurate template matching algorithm based on image pyramid and sum of absolute difference similarity measure, Research Journal of Information Technology, 4(4), 204-211.
  27. MacLean, J., and Tsotsos, J. (2000, September), Fast pattern recognition using gradient-descent search in an image pyramid, 15th International Conference on Pattern Recognition, IEEE, 873-877.
  28. Lewis, J. P. (1995, May), Fast normalized cross-correlation, Vision Interface, 120-123.
  29. Cho, D., and Gong, J. (2023), A Feasibility Study on Extension of Measurement Distance in Vision Sensor Using Super-Resolution for Dynamic Response Measurement, Sensors, 23(20), 8496.
  30. Savitzky, A., and Golay, M. J. (1964), Smoothing and differentiation of data by simplified least squares procedures, Analytical Chemistry, 36(8), 1627-1639.