Smart Structures and Systems

Techno-Press (테크노프레스)
권호 표지
DOI QR코드

DOI QR Code

Real-time structural health monitoring system based on streaming data

  • Zhang, Qilin (College of Civil Engineering, Tongji University) ;
  • Sun, Siyuan (College of Civil Engineering, Tongji University) ;
  • Yang, Bin (College of Civil Engineering, Tongji University) ;
  • Wuchner, Roland (Technical University of Munich) ;
  • Pan, Licheng (College of Civil Engineering, Tongji University) ;
  • Zhu, Haitao (College of Civil Engineering, Tongji University)
  • Received : 2020.11.03
  • Accepted : 2021.03.20
  • Published : 2021.08.25
⟨ Previous Next ⟩

Abstract

In this paper, a novel real-time structural health monitoring (SHM) system based on streaming data is proposed. In contrast to a traditional SHM system, the proposed system implements a series of optimizations for data transmission and processing to reduce the latency and better satisfy the real-time requirement. The concept of the watermark in the streaming system is adopted to address the problem of when to trigger the time window calculation under the real-time requirement. Moreover, a well-designed parallel mechanism is used to satisfy the multistage computation requirement in the parallel data stream. A case study in which the proposed system is applied to the Shanghai Tower is presented. The peak picking method is used as an example in the test environment to track the latency of each main operation under different parallelism schemes. The results show that computing in parallel effectively reduces the latency and provides a reference for integrating the random decrement technique (RDT), stochastic subspace identification (SSI), or other more complex but effective algorithms in parallel into the system in the future. The total latency under the test environment from data generation to data transmission to the web server is approximately only 200-400 ms, which indicates the excellent real-time performance of the system.

Keywords

Acknowledgement

Special thanks to Hong Kong Polytechnic University and Tongji Architectural Design (Group) Co., Ltd., for their contribution in the construction of the structural health monitoring system of the Shanghai Tower.

References

  1. Akidau, T., Balikov, A., Bekiroglu, K., Chernyak, S., Haberman, J., Lax, R., McVeety, S., Mills, D., Nordstrom, P. and Whittle, S. (2013), "MillWheel: fault-tolerant stream processing at internet scale", Proceedings of the VLDB Endowment, 6, 1033-1044. https://doi.org/10.14778/2536222.2536229
  2. Akidau, T., Bradshaw, R., Chambers, C., Chernyak, S., FernandezMoctezuma, R.J., Lax, R., McVeety, S., Mills, D., Perry, F., Schmidt, E. and Whittle, S. (2015), "The dataflow model: a practical approach to balancing correctness, latency, and cost in massive-scale, unbounded, out-of-order data processing", Proceedings of the VLDB Endowment, 8, 1792-1803. https://doi.org/10.14778/2824032.2824076
  3. Akidau, T., Chernyak, S. and Lax, R. (2017), Streaming Systems.
  4. Arnold, D., Lutz, S., Dach, R., Jaggi, A. and Steinborn, J. (2016), "Near real-time coordinate estimation from double-difference GNSS data", In: IAG 150 Years, pp. 691-697. https://doi.org/10.1007/1345_2015_173
  5. ASF (2003), Apache Hadoop; http://hadoop.apache.org/
  6. ASF (2011), Apache Kafka; https://kafka.apache.org/
  7. ASF (2014), Apache Flink: Stateful Computations over Data Streams; https://flink.apache.org/
  8. ASF (2016), Apache Beam; https://beam.apache.org/
  9. Candy, J. (2019), "Stochastic Subspace Identification", In: ModelBased Processing, pp. 309-389. https://doi.org/10.1002/9781119457695.ch7
  10. Clough, R. and Penzien, J. (2003), Dynamics of structures.
  11. Dean, J. and Ghemawat, S. (2004), "MapReduce: Simplified data processing on large clusters".
  12. Federal Standard 1037C (1997), Federal Standard 1037C: Glossary of Telecommunications Terms, National Telecommunication Information Administration, USA.
  13. Fette, I. and Melnikov, A. (2011), "The websocket protocol".
  14. Google (2013), Datafolw I Google Cloud; https://cloud.google.com/dataflow.
  15. Hasani, Z., Kon-Popovska, M. and Velinov, G. (2014), "Lambda architecture for real time big data analytic", ICT Innovations, 133-143.
  16. Ibrahim, S.R. (2012), "Random decrement technique for modal identification of structures", J. Spacecr. Rockets, 14, 696. https://doi.org/10.2514/3.57251
  17. Kaya, Y. and Safak, E. (2015), "Real-time analysis and interpretation of continuous data from structural health monitoring (SHM) systems", Bull. Earthq. Eng., 13, 917-934. https://doi.org/10.1007/s10518-014-9642-9
  18. Kijewski-Correa, T., Kwon, D.K., Kareem, A., Bentz, A., Guo, Y., Bobby, S. and Abdelrazaq, A. (2013), "SmartSync: An integrated real-time structural health monitoring and structural identification system for tall buildings", J. Struct. Eng., 139, 1675-1687. https://doi.org/10.1061/(ASCE)ST.1943-541X.0000560
  19. Kleppmann, M. (2015), "A Critique of the CAP Theorem".
  20. Ko, J.M. and Ni, Y.Q. (2005), "Technology developments in structural health monitoring of large-scale bridges", Eng. Struct., 27, 1715-1725. https://doi.org/10.1016/j.engstruct.2005.02.021
  21. Kreps, J. (2014a), Questioning the Lambda Architecture; https://www.oreilly.com/radar/questioning-the-lambdaarchitecture.
  22. Kreps, J. (2014b), I heart logs: Event data, stream processing, and data integration.
  23. Li, H., Zhou, W.S., Ou, J.P. and Yang, Y.S. (2006), "A study on system integration technique of intelligent monitoring systems for soundness of long-span bridges", China Civil Eng. J., 39, 46-52.
  24. Li, H., Zhang, Q.L., Yang, B., Lu, J. and Hu, J. (2015), "Development and application of construction monitoring system for Shanghai Tower", Smart Struct. Syst., Int. J., 15(4), 1019-1039. https://doi.org/10.12989/sss.2015.15.4.1019
  25. Mandal, K. (2018), "Evolution of Streaming ETL Technologies".
  26. Martin (1965), Programming real-time computer systems.
  27. Marz, N. (2011), How to beat the CAP theorem; http://nathanmarz.com/blog/how-to-beat-the-cap-theorem.html.
  28. Masri, S.F., Sheng, L.H., Caffrey, J.P., Nigbor, R.L., Wahbeh, M. and Abdel-Ghaffar, A.M. (2004), "Application of a web-enabled real-time structural health monitoring system for civil infrastructure systems", Smart Mater. Struct., 13, 1269-1283. https://doi.org/10.1088/0964-1726/13/6/001
  29. Sivasankar, D. and Sakthivel, P. (2017), "Enhancing Quality of Service in Real Time Communication services for Network on Chip", Int. J. Electron. Eng. Res., 9, 233-240.
  30. Orcutt, J. and Vernon, F. (2014), "A Modern Operating System for Near-real-time Environmental Observatories", In: EGU General Assembly Conference Abstracts, p. 14949.
  31. Su, J.Z., Xia, Y., Chen, L., Zhao, X., Zhang, Q.L., Xu, Y.L., Ding, J.M., Xiong, H.B., Ma, R.J., Lv, X.L. and Chen, A.R. (2013), "Long-term structural performance monitoring system for the Shanghai Tower", J. Civil Struct. Health Monitor., 3, 49-61. https://doi.org/10.1007/s13349-012-0034-z
  32. Tantalaki, N., Souravlas, S. and Roumeliotis, M. (2020), "A review on big data real-time stream processing and its scheduling techniques", Int. J. Parallel Emerg. Distrib. Syst., 35, 571-601. https://doi.org/10.1080/17445760.2019.1585848
  33. Xia, J., Poon, D. and Mass, D. (2010), "Case Study: Shanghai Tower", CTBUH J, 2010, 12-18.
  34. Yi, T.H., Li, H.N. and Gu, M. (2013), "Recent research and applications of GPS-based monitoring technology for high-rise structures", Struct. Control Health Monitor., 20, 649-670. https://doi.org/10.1002/stc.1501
  35. Yi, T.H., Huang, H.B. and Li, H.N. (2017), "Development of sensor validation methodologies for structural health monitoring: A comprehensive review", Measurement, 109, 200-214. https://doi.org/10.1016/j.measurement.2017.05.064
  36. Zhang, Q., Yang, B., Liu, T., Li, H. and Lv, J. (2015), "Structural health monitoring of Shanghai tower considering timedependent effects", Smart Struct. Syst., Int. J., 4(1), 39-44. https://doi.org/10.21022/IJHRB.2015.4.1.039
  37. Zhou, G.D., Yi, T.H. and Chen, B. (2016), "Innovative design of a health monitoring system and its implementation in a complicated long-span arch bridge", J. Aerosp. Eng., 30(3), B4016006. https://doi.org/10.1061/(ASCE)AS.1943-5525.0000603