• Title/Summary/Keyword: Real time visual inspection

Search Result 71, Processing Time 0.028 seconds

A semi-supervised interpretable machine learning framework for sensor fault detection

  • Martakis, Panagiotis;Movsessian, Artur;Reuland, Yves;Pai, Sai G.S.;Quqa, Said;Cava, David Garcia;Tcherniak, Dmitri;Chatzi, Eleni
    • Smart Structures and Systems
    • /
    • v.29 no.1
    • /
    • pp.251-266
    • /
    • 2022
  • Structural Health Monitoring (SHM) of critical infrastructure comprises a major pillar of maintenance management, shielding public safety and economic sustainability. Although SHM is usually associated with data-driven metrics and thresholds, expert judgement is essential, especially in cases where erroneous predictions can bear casualties or substantial economic loss. Considering that visual inspections are time consuming and potentially subjective, artificial-intelligence tools may be leveraged in order to minimize the inspection effort and provide objective outcomes. In this context, timely detection of sensor malfunctioning is crucial in preventing inaccurate assessment and false alarms. The present work introduces a sensor-fault detection and interpretation framework, based on the well-established support-vector machine scheme for anomaly detection, combined with a coalitional game-theory approach. The proposed framework is implemented in two datasets, provided along the 1st International Project Competition for Structural Health Monitoring (IPC-SHM 2020), comprising acceleration and cable-load measurements from two real cable-stayed bridges. The results demonstrate good predictive performance and highlight the potential for seamless adaption of the algorithm to intrinsically different data domains. For the first time, the term "decision trajectories", originating from the field of cognitive sciences, is introduced and applied in the context of SHM. This provides an intuitive and comprehensive illustration of the impact of individual features, along with an elaboration on feature dependencies that drive individual model predictions. Overall, the proposed framework provides an easy-to-train, application-agnostic and interpretable anomaly detector, which can be integrated into the preprocessing part of various SHM and condition-monitoring applications, offering a first screening of the sensor health prior to further analysis.

Development of Fender Segmentation System for Port Structures using Vision Sensor and Deep Learning (비전센서 및 딥러닝을 이용한 항만구조물 방충설비 세분화 시스템 개발)

  • Min, Jiyoung;Yu, Byeongjun;Kim, Jonghyeok;Jeon, Haemin
    • Journal of the Korea institute for structural maintenance and inspection
    • /
    • v.26 no.2
    • /
    • pp.28-36
    • /
    • 2022
  • As port structures are exposed to various extreme external loads such as wind (typhoons), sea waves, or collision with ships; it is important to evaluate the structural safety periodically. To monitor the port structure, especially the rubber fender, a fender segmentation system using a vision sensor and deep learning method has been proposed in this study. For fender segmentation, a new deep learning network that improves the encoder-decoder framework with the receptive field block convolution module inspired by the eccentric function of the human visual system into the DenseNet format has been proposed. In order to train the network, various fender images such as BP, V, cell, cylindrical, and tire-types have been collected, and the images are augmented by applying four augmentation methods such as elastic distortion, horizontal flip, color jitter, and affine transforms. The proposed algorithm has been trained and verified with the collected various types of fender images, and the performance results showed that the system precisely segmented in real time with high IoU rate (84%) and F1 score (90%) in comparison with the conventional segmentation model, VGG16 with U-net. The trained network has been applied to the real images taken at one port in Republic of Korea, and found that the fenders are segmented with high accuracy even with a small dataset.

Displacement Measurement of a Floating Structure Model Using a Video Data (동영상을 이용한 부유구조물 모형의 변위 관측)

  • Han, Dong Yeob;Kim, Hyun Woo;Kim, Jae Min
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.31 no.2
    • /
    • pp.159-164
    • /
    • 2013
  • It is well known that a single moving camera video is capable of extracting the 3-dimensional position of an object. With this in mind, current research performed image-based monitoring to establish a floating structure model using a camcorder system. Following this, the present study extracted frame images from digital camcorder video clips and matched the interest points to obtain relative 3D coordinates for both regular and irregular wave conditions. Then, the researchers evaluated the transformation accuracy of the modified SURF-based matching and image-based displacement estimation of the floating structure model in regular wave condition. For the regular wave condition, the wave generator's setting value was 3.0 sec and the cycle of the image-based displacement result was 2.993 sec. Taking into account mechanical error, these values can be considered as very similar. In terms of visual inspection, the researchers observed the shape of a regular wave in the 3-dimensional and 1-dimensional figures through the projection on X Y Z axis. In conclusion, it was possible to calculate the displacement of a floating structure module in near real-time using an average digital camcorder with 30fps video.

Cloud Detection Using HIMAWARI-8/AHI Based Reflectance Spectral Library Over Ocean (Himawari-8/AHI 기반 반사도 분광 라이브러리를 이용한 해양 구름 탐지)

  • Kwon, Chaeyoung;Seo, Minji;Han, Kyung-Soo
    • Korean Journal of Remote Sensing
    • /
    • v.33 no.5_1
    • /
    • pp.599-605
    • /
    • 2017
  • Accurate cloud discrimination in satellite images strongly affects accuracy of remotely sensed parameter produced using it. Especially, cloud contaminated pixel over ocean is one of the major error factors such as Sea Surface Temperature (SST), ocean color, and chlorophyll-a retrievals,so accurate cloud detection is essential process and it can lead to understand ocean circulation. However, static threshold method using real-time algorithm such as Moderate Resolution Imaging Spectroradiometer (MODIS), Advanced Himawari Imager (AHI) can't fully explained reflectance variability over ocean as a function of relative positions between the sun - sea surface - satellite. In this paper, we assembled a reflectance spectral library as a function of Solar Zenith Angle (SZA) and Viewing Zenith Angle (VZA) from ocean surface reflectance with clear sky condition of Advanced Himawari Imager (AHI) identified by NOAA's cloud products and spectral library is used for applying the Dynamic Time Warping (DTW) to detect cloud pixels. We compared qualitatively between AHI cloud property and our results and it showed that AHI cloud property had general tendency toward overestimation and wrongly detected clear as unknown at high SZA. We validated by visual inspection with coincident imagery and it is generally appropriate.

A Study on the Control of Hazard Facilities Management system in Urban area by utilizing GIS (지리정보시스템(GIS)을 이용한 도심지 내의 위해시설 관리시스템 구축에 관한 연구)

  • Ham, Eun-Gu;Roh, Sam-Kew
    • Journal of the Korean Society of Hazard Mitigation
    • /
    • v.5 no.4 s.19
    • /
    • pp.9-15
    • /
    • 2005
  • This research developed the RMIS(Risk Management Information System) which focus on works of risk management fields required of apply of a space information, and focus on the DB to establish and apply the space information efficiently with research scope on the LPG refueling station in city. On the basis of the RMIS, this research provides the baseline to lead on an efficiency of safety inspection of LPG refueling station, advance risk assessment, and efficient making decision of an accident correspondence assessment with interlocking the GIS representing risk through the automation of a quantitative risk assessment standardize requirement to control at real-time. The RMIS development process is as follows. firstly, Relational Database(RDB) was developed by using fundamental data both On-site and Off-site relating data as peforming risk assessment on the LPG refueling station in city. Second, the risk management integral database system was developed to monitor and control the risk efficiently for user with using the Visual Basic Program. Third, through interlocking the risk management integral database system and the GIS(Falcon-map) was suggested the decision making method. Represented results through out the RMIS program development are as follows. Firstly, the RMIS was established the mutual information to advance management the risk efficiently for user and inspector with using the risk management data. Second, as this study managed risk for on-site and off-site separately and considered effect for inside and outside of facility, constructed the basis on safety management which can respond to major accident. Third, it was composed the baseline to making decision that on the basis of user interface.

Development of Intelligent Compaction System for Efficient Quality Control (효율적 품질관리를 위한 지능형 다짐 시스템 개발)

  • Lee, Soomin;Park, Sangil;Lee, Riho;Seo, Jongwon
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.38 no.5
    • /
    • pp.751-760
    • /
    • 2018
  • Currently, the quality measurement of the work is carried out by the supervisor's visual inspection, as the workers individually judge the number of resolutions, thickness, speed and vibration. After work, we are conducting follow-up work through traditional spot test, which is less representative. Therefore, it is impossible to check the results of the resolution, and there is always the possibility that problems will arise due to poor construction. This study demonstrates the feasibility of using the continuous compaction strength measurement method by comparing the continuous compaction strength measurement method and the conventional compaction strength measurement method after performing the compaction in the actual field scale in various test conditions. The validity is verified by analyzing the Compaction Meter Value of an Intelligent Compaction roller composed of a Global Positioning System and an accelerometer, Based on the proven results, a full range of quality can be confirmed without a single test. The quality confirmation is visualized in the compaction control program developed in this study, This enables the field manager to perform real-time quality monitoring at the same time as compaction.

Quantitative Deterioration and Maintenance Profiles of Typical Steel Bridges based on Response Surface Method (응답면 기법을 이용한 강교의 열화 및 보수보강 정량화 이력 모델)

  • Park, Seung-Hyun;Park, Kyung Hoon;Kim, Hee Joong;Kong, Jung-Sik
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.28 no.6A
    • /
    • pp.765-778
    • /
    • 2008
  • Performance Profiles are essential to predict the performance variation over time for the bridge management system (BMS) based on risk management. In general, condition profiles based on experts opinion and/or visual inspection records have been used widely because obtaining profiles based on real performance is not easy. However, those condition profiles usually don't give a good consistency to the safety of bridges, causing practical problems for the effective bridge management. The accuracy of performance evaluation is directly related to the accuracy of BMS. The reliability of the evaluation is important to produce the optimal solution for distributing maintenance budget reasonably. However, conventional methods of bridge assessment are not suitable for a more sophisticated decision making procedure. In this study, a method to compute quantitative performance profiles has been proposed to overcome the limitations of those conventional models. In Bridge Management Systems, the main role of performance profiles is to compute and predict the performance of bridges subject to lifetime activities with uncertainty. Therefore, the computation time for obtaining an optimal maintenance scenario is closely related to the efficiency of the performance profile. In this study, the Response Surface Method (RSM) based on independent and important design variables is developed for the rapid computation. Steel box bridges have been investigated because the number of independent design variables can be reduced significantly due to the high dependency between design variables.

Filament, the Universal Nersery of Stars: Progress Report on TRAO Survery of Nearby Filamentary Filamentary Molecular Clouds

  • Kim, ShinYoung;Chung, Eun Jung;Lee, Chang Won;Myers, Philip C.;Caselli, Paola;Tafalla, Mario;Kim, Gwanjeong;Kim, Miryang;Soam, Archana;Gophinathan, Maheswar;Liu, Tie;Kim, Kyounghee;Kwon, Woojin;Kim, Jongsoo
    • The Bulletin of The Korean Astronomical Society
    • /
    • v.42 no.2
    • /
    • pp.79.2-79.2
    • /
    • 2017
  • To dynamically and chemically understand how filaments, dense cores, and stars form under different environments, we are conducting a systematic mapping survey of nearby molecular clouds using the TRAO 14 m telescope with high ($N_2H^+$ 1-0, $HCO^+$ 1-0, SO 32-21, and $NH_2D$ v=1-0) and low ($^{13}CO$ 1-0, $C^{18}O$ 1-0) density tracers. The goals of this survey are to obtain the velocity distribution of low dense filaments and their dense cores for the study of their origin of the formation, to understand whether the dense cores form from any radial accretion or inward motions toward dense cores from their surrounding filaments, and to study the chemical differentiation of the filaments and the dense cores. Until the 2017A season, the real OTF observation time is ~760 hours. We have almost completed mapping observation with four molecular lines ($^{13}CO$ 1-0, $C^{18}O$ 1-0, $N_2H^+$ 1-0, and $HCO^+$ 1-0) on the six regions of molecular clouds (L1251 of Cepheus, Perseus West, Polaris South, BISTRO region of Serpens, California, and Orion B). The cube data for $^3CO$ and $C^{18}O$ lines were obtained for a total of 6 targets, 57 tiles, 676 maps, and $7.1deg^2$. And $N_2H^+$ and $HCO^+$ data were added for $2.2deg^2$ of dense regions. All OTF data were regridded to a cell size of 44 by 44 arcseconds. The $^{13}CO$ and $C^{18}O$ data show the RMS noise level of about (0.1-0.2) K and $N_2H^+$ and $HCO^+$ data show about (0.07-0.2) K at the velocity resolution of 0.06 km/s. Additional observations will be made on some regions that have not reached the noise level for analysis. To identify filaments, we are using and testing programs (DisPerSE, Dendrogram, FIVE) and visual inspection for 3D image of cube data. A basic analysis of the physical and chemical properties of each filament is underway.

  • PDF

Impact Monitoring of Composite Structures using Fiber Bragg Grating Sensors (광섬유 브래그 격자 센서를 이용한 복합재 구조물의 충격 모니터링 기법 연구)

  • Jang, Byeong-Wook;Park, Sang-Oh;Lee, Yeon-Gwan;Kim, Chun-Gon;Park, Chan-Yik;Lee, Bong-Wan
    • Composites Research
    • /
    • v.24 no.1
    • /
    • pp.24-30
    • /
    • 2011
  • Low-velocity impact can cause various damages which are mostly hidden inside the laminates or occur in the opposite side. Thus, these damages cannot be easily detected by visual inspection or conventional NDT systems. And if they occurred between the scheduled NDT periods, the possibilities of extensive damages or structural failure can be higher. Due to these reasons, the built-in NDT systems such as real-time impact monitoring system are required in the near future. In this paper, we studied the impact monitoring system consist of impact location detection and damage assessment techniques for composite flat and stiffened panel. In order to acquire the impact-induced acoustic signals, four multiplexed FBG sensors and high-speed FBG interrogator were used. And for development of the impact and damage occurrence detections, the neural networks and wavelet transforms were adopted. Finally, these algorithms were embodied using MATLAB and LabVIEW software for the user-friendly interface.

A Study on Tire Surface Defect Detection Method Using Depth Image (깊이 이미지를 이용한 타이어 표면 결함 검출 방법에 관한 연구)

  • Kim, Hyun Suk;Ko, Dong Beom;Lee, Won Gok;Bae, You Suk
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.11 no.5
    • /
    • pp.211-220
    • /
    • 2022
  • Recently, research on smart factories triggered by the 4th industrial revolution is being actively conducted. Accordingly, the manufacturing industry is conducting various studies to improve productivity and quality based on deep learning technology with robust performance. This paper is a study on the method of detecting tire surface defects in the visual inspection stage of the tire manufacturing process, and introduces a tire surface defect detection method using a depth image acquired through a 3D camera. The tire surface depth image dealt with in this study has the problem of low contrast caused by the shallow depth of the tire surface and the difference in the reference depth value due to the data acquisition environment. And due to the nature of the manufacturing industry, algorithms with performance that can be processed in real time along with detection performance is required. Therefore, in this paper, we studied a method to normalize the depth image through relatively simple methods so that the tire surface defect detection algorithm does not consist of a complex algorithm pipeline. and conducted a comparative experiment between the general normalization method and the normalization method suggested in this paper using YOLO V3, which could satisfy both detection performance and speed. As a result of the experiment, it is confirmed that the normalization method proposed in this paper improved performance by about 7% based on mAP 0.5, and the method proposed in this paper is effective.