Smart Structures and Systems

Techno-Press (테크노프레스)
권호 표지
DOI QR코드

DOI QR Code

Image-based structural dynamic displacement measurement using different multi-object tracking algorithms

  • Ye, X.W. (Department of Civil Engineering, Zhejiang University) ;
  • Dong, C.Z. (Department of Civil Engineering, Zhejiang University) ;
  • Liu, T. (Department of Civil Engineering, Zhejiang University)
  • Received : 2015.12.31
  • Accepted : 2016.04.08
  • Published : 2016.06.25
⟨ Previous Next ⟩

Abstract

With the help of advanced image acquisition and processing technology, the vision-based measurement methods have been broadly applied to implement the structural monitoring and condition identification of civil engineering structures. Many noncontact approaches enabled by different digital image processing algorithms are developed to overcome the problems in conventional structural dynamic displacement measurement. This paper presents three kinds of image processing algorithms for structural dynamic displacement measurement, i.e., the grayscale pattern matching (GPM) algorithm, the color pattern matching (CPM) algorithm, and the mean shift tracking (MST) algorithm. A vision-based system programmed with the three image processing algorithms is developed for multi-point structural dynamic displacement measurement. The dynamic displacement time histories of multiple vision points are simultaneously measured by the vision-based system and the magnetostrictive displacement sensor (MDS) during the laboratory shaking table tests of a three-story steel frame model. The comparative analysis results indicate that the developed vision-based system exhibits excellent performance in structural dynamic displacement measurement by use of the three different image processing algorithms. The field application experiments are also carried out on an arch bridge for the measurement of displacement influence lines during the loading tests to validate the effectiveness of the vision-based system.

Keywords

Acknowledgement

Supported by : National Science Foundation of China

References

  1. Cheng, Y.Z. (1995), "Mean shift, mode seeking, and clustering", IEEE T. Pattern. Anal., 17(8), 790-799. https://doi.org/10.1109/34.400568
  2. Comaniciu, D., Ramesh, V. and Meer, P. (2003), "Kernel-based object tracking", IEEE T. Pattern. Anal., 25(5), 564-577. https://doi.org/10.1109/TPAMI.2003.1195991
  3. Feng, D.M., Feng, M.Q., Ozer, E. and Fukuda, Y. (2015), "A vision-based sensor for noncontact structural displacement measurement", Sensors, 15, 16557-16575. https://doi.org/10.3390/s150716557
  4. Fukuda, Y., Feng, M.Q., Narita, Y., Kaneko, S.I. and Tanaka, T. (2013), "Vision-based displacement sensor for monitoring dynamic response using robust object search algorithm", IEEE Sens. J., 13(12), 4725-4732. https://doi.org/10.1109/JSEN.2013.2273309
  5. Fukunaga, K. and Hostetler, L.D. (1975), "The estimation of the gradient of a density function, with application in pattern recognition", IEEE T. Inform. Theory, 21(1), 32-40. https://doi.org/10.1109/TIT.1975.1055330
  6. Guo, J. and Zhu, C.A. (2016), "Dynamic displacement measurement of large-scale structures based on the Lucas-Kanade template tracking algorithm", Mech. Syst. Signal. Pr., 66-67, 425-436. https://doi.org/10.1016/j.ymssp.2015.06.004
  7. Henke, K., Pawlowski, R., Schregle, P. and Winter, S. (2015), "Use of digital image processing in the monitoring of deformations in building structures", J. Civil Struct. Health Monit., 5, 141-152. https://doi.org/10.1007/s13349-014-0091-6
  8. Ho, H.N., Lee, J.H., Park, Y.S. and Lee, J.J. (2012), "A synchronized multipoint vision-based system for displacement measurement of civil infrastructures", Sci. World J., 2012, 519146.
  9. Jauregui, D.V., White, K.R., Woodward, C.B. and Leitch, K.R. (2003), "Noncontact photogrammetric measurement of vertical bridge deflection", J. Bridge Eng. - ASCE, 8(4), 212-222. https://doi.org/10.1061/(ASCE)1084-0702(2003)8:4(212)
  10. Ji. Y.F. and Chang, C.C. (2007), "Nontarget stereo vision technique for spatiotemporal response measurement of line-like structures", J Eng Mech- ASCE. 134(6), 466-474.
  11. Ji. Y.F. and Chang, C.C. (2008), "Nontarget image-based technique for small cable vibration measurement", J. Bridge Eng. - ASCE, 13(1), 34-42.
  12. Mansoori, E.G., Zolghadri, M.J. and Katebi, S.D. (2007), "A weighting function for improving fuzzy classification systems performance", Fuzzy Set Syst., 158, 583-591. https://doi.org/10.1016/j.fss.2006.10.004
  13. Ni, Y.Q., Ye, X.W. and Ko, J.M. (2010), "Monitoring-based fatigue reliability assessment of steel bridges: analytical model and application", J. Struct. Eng. - ASCE, 136(12), 1563-1573. https://doi.org/10.1061/(ASCE)ST.1943-541X.0000250
  14. Ni, Y.Q., Ye, X.W. and Ko, J.M. (2012), "Modeling of stress spectrum using long-term monitoring data and finite mixture distributions", J. Eng. Mech. - ASCE, 138(2), 175-183. https://doi.org/10.1061/(ASCE)EM.1943-7889.0000313
  15. Olaszek, P. (1999), "Investigation of the dynamic characteristic of bridge structures using a computer vision method", Measurement, 25, 227-236. https://doi.org/10.1016/S0263-2241(99)00006-8
  16. Park, J.W., Lee, J.J., Jung. H.J. and Myung, H. (2010), "Vision-based displacement measurement method for high-rise building structures using partitioning approach", NDT&E Int., 43, 642-647. https://doi.org/10.1016/j.ndteint.2010.06.009
  17. Perlibakas, V. (2004), "Distance measures for PCA-based face recognition", Pattern Recogn. Lett., 25, 711-724. https://doi.org/10.1016/j.patrec.2004.01.011
  18. Russell, S.J. and Norvig, P. (2010), Artificial Intelligence: A Modern Approach, 3rd Ed, Pearson Prentice Hall, Upper Saddle River, NJ.
  19. Wahbeh, A.M., Caffrey, J.P. and Masri, S.F. (2003), "A vision-based approach for the direct measurement of displacements in vibrating systems", Smart Mater. Struct., 12, 785-794. https://doi.org/10.1088/0964-1726/12/5/016
  20. Ye, X.W., Ni, Y.Q., Wai, T.T., Wong, K.Y., Zhang, X.M. and Xu, F. (2013), "A vision-based system for dynamic displacement measurement of long-span bridges: algorithm and verification", Smart Struct. Syst., 12(3-4), 363-379. https://doi.org/10.12989/sss.2013.12.3_4.363
  21. Ye, X.W., Ni, Y.Q., Wong, K.Y. and Ko, J.M. (2012), "Statistical analysis of stress spectra for fatigue life assessment of steel bridges with structural health monitoring data", Eng. Struct., 45, 166-176. https://doi.org/10.1016/j.engstruct.2012.06.016
  22. Ye, X.W., Yi, T.H., Dong, C.Z., Liu, T. and Bai, H. (2015), "Multi-point displacement monitoring of bridges using a vision-based approach", Wind Struct., 20(2), 315-326. https://doi.org/10.12989/was.2015.20.2.315

Cited by

  1. Stay cable tension estimation using a vision-based monitoring system under various weather conditions vol.7, pp.3, 2017, https://doi.org/10.1007/s13349-017-0226-7
  2. Reference-Free Displacement Estimation of Bridges Using Kalman Filter-Based Multimetric Data Fusion vol.2016, 2016, https://doi.org/10.1155/2016/3791856
  3. Identification of structural dynamic characteristics based on machine vision technology 2018, https://doi.org/10.1016/j.measurement.2017.09.043
  4. A Review of Machine Vision-Based Structural Health Monitoring: Methodologies and Applications vol.2016, 2016, https://doi.org/10.1155/2016/7103039
  5. Geotechnical monitoring and analyses on the stability and health of a large cross-section railway tunnel constructed in a seismic area 2017, https://doi.org/10.1016/j.measurement.2017.10.039
  6. Marker-free monitoring of the grandstand structures and modal identification using computer vision methods pp.1741-3168, 2018, https://doi.org/10.1177/1475921718806895
  7. A parallel stereovision method used for monitoring the collapse of a three-story frame model subjected to seismic loading vol.14, pp.9, 2018, https://doi.org/10.1177/1550147718800626
  8. Detection of slip for CFRP-concrete interface using stereovision method corrected by epipolar constraint vol.25, pp.10, 2018, https://doi.org/10.1002/stc.2212
  9. Stereovision monitoring of deflection of concrete beam strengthened with ultraviolet-cured glass-fiber reinforced polymer in a destructive test pp.2048-4046, 2020, https://doi.org/10.1177/1461348418821762
  10. 시설물 모니터링을 위한 기준영상 기반 스마트폰 영상의 기하보정 vol.33, pp.2, 2016, https://doi.org/10.7780/kjrs.2017.33.2.10
  11. Numerical and experimental verifications on damping identification with model updating and vibration monitoring data vol.20, pp.2, 2016, https://doi.org/10.12989/sss.2017.20.2.127
  12. Strain-based structural condition assessment of an instrumented arch bridge using FBG monitoring data vol.20, pp.2, 2016, https://doi.org/10.12989/sss.2017.20.2.139
  13. Development of a double-sliding friction damper (DSFD) vol.20, pp.2, 2016, https://doi.org/10.12989/sss.2017.20.2.151
  14. Outlier detection of GPS monitoring data using relational analysis and negative selection algorithm vol.20, pp.2, 2016, https://doi.org/10.12989/sss.2017.20.2.219
  15. Analysis and probabilistic modeling of wind characteristics of an arch bridge using structural health monitoring data during typhoons vol.63, pp.6, 2016, https://doi.org/10.12989/sem.2017.63.6.809
  16. Structural health monitoring data reconstruction of a concrete cable-stayed bridge based on wavelet multi-resolution analysis and support vector machine vol.20, pp.5, 2016, https://doi.org/10.12989/cac.2017.20.5.555
  17. Structural performance monitoring of an urban footbridge vol.5, pp.1, 2016, https://doi.org/10.12989/smm.2018.5.1.129
  18. Structural health monitoring of a high-speed railway bridge: five years review and lessons learned vol.21, pp.5, 2016, https://doi.org/10.12989/sss.2018.21.5.695
  19. Real-time geometry identification of moving ships by computer vision techniques in bridge area vol.23, pp.4, 2016, https://doi.org/10.12989/sss.2019.23.4.359
  20. Crack Propagation and Fracture Process Zone (FPZ) of Wood in the Longitudinal Direction Determined Using Digital Image Correlation (DIC) Technique vol.11, pp.13, 2019, https://doi.org/10.3390/rs11131562
  21. A Robust Vision-Based Method for Displacement Measurement under Adverse Environmental Factors Using Spatio-Temporal Context Learning and Taylor Approximation vol.19, pp.14, 2016, https://doi.org/10.3390/s19143197
  22. Image‐based concrete crack assessment using mask and region‐based convolutional neural network vol.26, pp.8, 2016, https://doi.org/10.1002/stc.2381
  23. A review on deep learning-based structural health monitoring of civil infrastructures vol.24, pp.5, 2016, https://doi.org/10.12989/sss.2019.24.5.567
  24. Flexible camera series network for deformation measurement of large scale structures vol.24, pp.5, 2016, https://doi.org/10.12989/sss.2019.24.5.587
  25. Local damage detection of a fan blade under ambient excitation by three-dimensional digital image correlation vol.24, pp.5, 2016, https://doi.org/10.12989/sss.2019.24.5.597
  26. Development of monocular video deflectometer based on inclination sensors vol.24, pp.5, 2016, https://doi.org/10.12989/sss.2019.24.5.607
  27. A completely non-contact recognition system for bridge unit influence line using portable cameras and computer vision vol.24, pp.5, 2019, https://doi.org/10.12989/sss.2019.24.5.617
  28. Structural modal identification and MCMC-based model updating by a Bayesian approach vol.24, pp.5, 2016, https://doi.org/10.12989/sss.2019.24.5.631
  29. Vision-based support in the characterization of superelastic U-shaped SMA elements vol.24, pp.5, 2016, https://doi.org/10.12989/sss.2019.24.5.641
  30. Drift error compensation for vision-based bridge deflection monitoring vol.24, pp.5, 2016, https://doi.org/10.12989/sss.2019.24.5.649
  31. Assessment of speckle image through particle size and image sharpness vol.24, pp.5, 2016, https://doi.org/10.12989/sss.2019.24.5.659
  32. Structural crack detection using deep learning-based fully convolutional networks vol.22, pp.16, 2016, https://doi.org/10.1177/1369433219836292
  33. A non-target structural displacement measurement method using advanced feature matching strategy vol.22, pp.16, 2019, https://doi.org/10.1177/1369433219856171
  34. Thickness Measurement of Water Film/Rivulets Based on Grayscale Index vol.11, pp.23, 2016, https://doi.org/10.3390/rs11232871
  35. Nonlinear finite element model updating with a decentralized approach vol.24, pp.6, 2016, https://doi.org/10.12989/sss.2019.24.6.683
  36. Multi-sensor data fusion based assessment on shield tunnel safety vol.24, pp.6, 2016, https://doi.org/10.12989/sss.2019.24.6.693
  37. Development and testing of a composite system for bridge health monitoring utilising computer vision and deep learning vol.24, pp.6, 2019, https://doi.org/10.12989/sss.2019.24.6.723
  38. Machine learning approaches for wind speed forecasting using long-term monitoring data: a comparative study vol.24, pp.6, 2016, https://doi.org/10.12989/sss.2019.24.6.733
  39. Autonomous pothole detection using deep region-based convolutional neural network with cloud computing vol.24, pp.6, 2019, https://doi.org/10.12989/sss.2019.24.6.745
  40. Creep of stainless steel under heat flux cyclic loading (500-1000℃) with different mechanical preloads in a vacuum environment using 3D-DIC vol.24, pp.6, 2016, https://doi.org/10.12989/sss.2019.24.6.759
  41. A vision-based system for long-distance remote monitoring of dynamic displacement: experimental verification on a supertall structure vol.24, pp.6, 2016, https://doi.org/10.12989/sss.2019.24.6.769
  42. Test on the anchoring components of steel shear keys in precast shear walls vol.24, pp.6, 2019, https://doi.org/10.12989/sss.2019.24.6.783
  43. Two-dimensional deformation measurement in the centrifuge model test using particle image velocimetry vol.24, pp.6, 2016, https://doi.org/10.12989/sss.2019.24.6.793
  44. Structural displacement monitoring using deep learning-based full field optical flow methods vol.16, pp.1, 2020, https://doi.org/10.1080/15732479.2019.1650078
  45. Computer Vision-Based Human Comfort Assessment of Stadiums vol.34, pp.2, 2016, https://doi.org/10.1061/(asce)cf.1943-5509.0001345
  46. Streamlined bridge inspection system utilizing unmanned aerial vehicles (UAVs) and machine learning vol.164, pp.None, 2020, https://doi.org/10.1016/j.measurement.2020.108048
  47. 3D modelling and visualization for Vision-based Vibration Signal Processing and Measurement vol.30, pp.1, 2016, https://doi.org/10.1515/jisys-2020-0123
  48. Vision-Based Vibration Monitoring of Structures and Infrastructures: An Overview of Recent Applications vol.6, pp.1, 2016, https://doi.org/10.3390/infrastructures6010004
  49. A review of computer vision-based structural health monitoring at local and global levels vol.20, pp.2, 2016, https://doi.org/10.1177/1475921720935585
  50. Displacement Identification by Computer Vision for Condition Monitoring of Rail Vehicle Bearings vol.21, pp.6, 2016, https://doi.org/10.3390/s21062100
  51. Fast operational modal analysis of a single-tower cable-stayed bridge by a Bayesian method vol.174, pp.None, 2021, https://doi.org/10.1016/j.measurement.2021.109048
  52. Surface crack detection based on image stitching and transfer learning with pretrained convolutional neural network vol.28, pp.8, 2021, https://doi.org/10.1002/stc.2766
  53. NOVEL APPROACH TO EXTRACT DENSE FULL-FIELD DYNAMIC PARAMETERS OF LARGE-SCALE BRIDGES USING SPATIAL SEQUENCE VIDEO vol.27, pp.8, 2016, https://doi.org/10.3846/jcem.2021.15797
  54. Cost-effective, vision-based multi-target tracking approach for structural health monitoring vol.32, pp.12, 2016, https://doi.org/10.1088/1361-6501/ac2551