• Smart Structures and Systems
• /
• 제30권5호
• /
• pp.521-535
• /
• 2022

Efficient management of deteriorating civil infrastructure is one of the most important research topics in many developed countries. In particular, the remote displacement measurement of bridges using linear variable differential transformers, global positioning systems, laser Doppler vibrometers, and computer vision technologies has been attempted extensively. This paper proposes a remote displacement measurement system using closed-circuit televisions (CCTVs) and a computer-vision-based method for in-situ bridge bearings having relatively large displacement due to temperature change in long term. The hardware of the system is composed of a reference target for displacement measurement, a CCTV to capture target images, a gateway to transmit images via a mobile network, and a central server to store and process transmitted images. The usage of CCTV capable of night vision capture and wireless data communication enable long-term 24-hour monitoring on wide range of bridge area. The computer vision algorithm to estimate displacement from the images involves image preprocessing for enhancing the circular features of the target, circular Hough transformation for detecting circles on the target in the whole field-of-view (FOV), and homography transformation for converting the movement of the target in the images into an actual expansion displacement. The simple target design and robust circle detection algorithm help to measure displacement using target images where the targets are far apart from each other. The proposed system is installed at the Tancheon Overpass located in Seoul, and field experiments are performed to evaluate the accuracy of circle detection and displacement measurements. The circle detection accuracy is evaluated using 28,542 images captured from 71 CCTVs installed at the testbed, and only 48 images (0.168%) fail to detect the circles on the target because of subpar imaging conditions. The accuracy of displacement measurement is evaluated using images captured for 17 days from three CCTVs; the average and root-mean-square errors are 0.10 and 0.131 mm, respectively, compared with a similar displacement measurement. The long-term operation of the system, as evaluated using 8-month data, shows high accuracy and stability of the proposed system.

• 대한토목학회논문집
• /
• 제39권5호
• /
• pp.631-636
• /
• 2019

최근 많은 연구자들이 대규모 현장에 투입된 건설자원의 유형과 위치를 자동 파악하는 영상분석기술을 활발히 개발하고 있다. 하지만 기존의 방법들은 인식하고자 하는 건설 물체(작업자, 중장비, 자재 등)를 학습용 이미지 데이터에 표시하는 Labeling 작업을 요구하고 이에 불필요한 시간과 노력이 낭비된다는 한계가 있다. 이러한 한계를 보완하기 위해서 본 연구는 액티브 러닝을 활용한 영상기반 건설현장 물체 자동 인식 프레임 워크를 제안함을 목표로 한다. 개발 프레임워크 검증을 목적으로 건설분야 Benchmark 데이터셋을 이용하여 실제 실험을 진행하였다. 그 결과, 액티브 러닝을 통해 학습한 모델은 다양한 특성을 지닌 건설물체를 성공적으로 인식할 수 있었고, 기존의 학습 DB 구축 방식과 비교할 때 더 적은 데이터 수와 반복학습 횟수로도 높은 성능을 가지는 영상분석모델을 개발할 수 있었다. 결과적으로 기존에 요구되던 학습 DB 구축을 위한 Labeling 작업을 줄일 뿐만 아니라 총 시간과 비용을 최소화할 수 있다.

• 대한원격탐사학회지
• /
• 제24권3호
• /
• pp.235-243
• /
• 2008

Object tracking is a common vision task to detect and trace objects between consecutive frames. It is also important for a variety of applications such as surveillance, video based traffic monitoring system, and so on. An efficient moving vehicle clustering and tracking algorithm suitable for traffic monitoring system is proposed in this paper. First, automatic background extraction method is used to get a reliable background as a reference. The moving blob(object) is then separated from the background by mean shift method. Second, the scale invariant feature based method extracts the salient features from the clustered foreground blob. It is robust to change the illumination, scale, and affine shape. The simulation results on various road situations demonstrate good performance achieved by proposed method.

• 제어로봇시스템학회논문지
• /
• 제22권8호
• /
• pp.579-584
• /
• 2016

When surgical instruments are tracked in an image-guided surgical navigation system, a stereo vision system with high accuracy is generally used, which is called optical tracker. However, this optical tracker has the disadvantage that a line-of-sight between the tracker and surgical instrument must be maintained. Therefore, to complement the disadvantage of optical tracking systems, an internal vision sensor is attached to a surgical instrument in this paper. Monitoring the target marker pattern attached on patient with this vision sensor, this surgical instrument is possible to be tracked even when the line-of-sight of the optical tracker is occluded. To verify the system's effectiveness, a series of basic experiments is carried out. Lastly, an integration experiment is conducted. The experimental results show that rotational error is bounded to max $1.32^{\circ}$ and mean $0.35^{\circ}$, and translation error is in max 1.72mm and mean 0.58mm. Finally, it is confirmed that the proposed tool tracking method using an internal vision sensor is useful and effective to overcome the occlusion problem of the optical tracker.

• 한국산학기술학회논문지
• /
• 제13권12호
• /
• pp.6098-6104
• /
• 2012

현재 철도 역사의 승객 위험영역과 보안영역 등의 감시를 위해 수십대의 CCTV를 널리 이용하고 있다. 그중에서 가장 빈번한 사고가 발생되는 곳은 승객의 열차 승하차가 이루어지는 승강장 영역이다. 하지만 사고 예방과 신속한 대응을 위해 역무원이 여러 대의 CCTV를 항시 모니터링 하기는 불가능하다. 따라서 위험상황을 자동으로 인지할 수 있는 영상처리 기술을 이용한 승강장 모니터링 시스템이 요구되며, 이를 위해서는 우선적으로 승강장에서의 정확한 열차상태 판단이 필요하다. 본 논문은 비전기반 승강장 모니터링 시스템을 위한 승강장에서의 열차상태에 대한 검지방법을 제안한다. 제안된 검지 방법은 승강장에서의 열차 점유영역을 분석하여 열차의 진입(IN), 진출(OUT), 정지(ON), 없음(OFF)의 4가지 생태를 판별한다. 제안된 검지방법의 성능 평가을 위해 서울메트로 4호선 동작역과 남태령역을 대상으로 열차상태 검지결과를 제시하였다.

• Journal of Information Processing Systems
• /
• 제17권2호
• /
• pp.227-241
• /
• 2021

Object detection techniques based on deep learning such as YOLO have high detection performance and precision in a single channel video stream. In order to expand to multiple channel object detection in real-time, however, high-performance hardware is required. In this paper, we propose a novel back-end server framework, a real-time AI vision platform (RAVIP), which can extend the object detection function from single channel to simultaneous multi-channels, which can work well even in low-end server hardware. RAVIP assembles appropriate component modules from the RODEM (real-time object detection module) Base to create per-channel instances for each channel, enabling efficient parallelization of object detection instances on limited hardware resources through continuous monitoring with respect to resource utilization. Through practical experiments, RAVIP shows that it is possible to optimize CPU, GPU, and memory utilization while performing object detection service in a multi-channel situation. In addition, it has been proven that RAVIP can provide object detection services with 25 FPS for all 16 channels at the same time.

• 산업경영시스템학회지
• /
• 제46권4호
• /
• pp.181-189
• /
• 2023

In this paper, we present a case study of developing MVIS (Machine Vision Inspection System) designed for exterior quality inspection of stamping dies used in the production of automotive exterior components in a small to medium-sized factory. While the primary processes within the factory, including machining, transportation, and loading, have been automated using PLCs, CNC machines, and robots, the final quality inspection process still relies on manual labor. We implement the MVIS with general-purpose industrial cameras and Python-based open-source libraries and frameworks for rapid and low-cost development. The MVIS can play a major role on improving throughput and lead time of stamping dies. Furthermore, the processed inspection images can be leveraged for future process monitoring and improvement by applying deep learning techniques.

• Agricultural and Biosystems Engineering
• /
• 제1권1호
• /
• pp.22-29
• /
• 2000

The development of bio-response feedback control system known as the speaking plant approach has been a challenging task for plant production engineers and scientists. In order to achieve the aim of developing such a bio-response feedback control system, the primary concern should be to develop a practical non-invasive technique for monitoring plant growth. Those who are skilled in raising plants can sense whether their plants are under adequate water conditions or not, for example, by merely observing minor color and tone changes before the plants wilt. Consequently, using machine vision, it may be possible to recognize changes in indices that describe plant conditions based on the appearance of growing plants. The interpretation of image information of plants may be based on image features extracted from the original pictorial image. In this study, the performance of a finite element retina was optimized by a genetic algorithm. The optimized finite element retina was evaluated based on the performance of neural plant growth monitor that requires input data given by the finite element retina.

• 국제학술발표논문집
• /
• The 6th International Conference on Construction Engineering and Project Management
• /
• pp.304-309
• /
• 2015

On construction sites, it is important to monitor the performance of construction equipment and workers to achieve successful construction project management; especially, vision-based detection methods have advantages for the real-time site data collection for safety and productivity analyses. Although many researchers developed vision-based detection methods with acceptable performance, there are still limitations to be addressed: 1) sensitiveness to the shape and appearance changes of moving objects in difference working postures, and 2) high computation time. To deal with the limitations, this paper proposes a detection algorithm of construction equipment based on Integral Channel Features. For validation, 16,850 frames of video streams were recorded and analyzed. The results showed that the proposed method worked in high performance in terms of accuracy and processing time. In conclusion, the developed method can help to understand useful site information including working pattern, working time and input manpower analyses.

• Smart Structures and Systems
• /
• 제24권5호
• /
• pp.567-585
• /
• 2019

In the past two decades, structural health monitoring (SHM) systems have been widely installed on various civil infrastructures for the tracking of the state of their structural health and the detection of structural damage or abnormality, through long-term monitoring of environmental conditions as well as structural loadings and responses. In an SHM system, there are plenty of sensors to acquire a huge number of monitoring data, which can factually reflect the in-service condition of the target structure. In order to bridge the gap between SHM and structural maintenance and management (SMM), it is necessary to employ advanced data processing methods to convert the original multi-source heterogeneous field monitoring data into different types of specific physical indicators in order to make effective decisions regarding inspection, maintenance and management. Conventional approaches to data analysis are confronted with challenges from environmental noise, the volume of measurement data, the complexity of computation, etc., and they severely constrain the pervasive application of SHM technology. In recent years, with the rapid progress of computing hardware and image acquisition equipment, the deep learning-based data processing approach offers a new channel for excavating the massive data from an SHM system, towards autonomous, accurate and robust processing of the monitoring data. Many researchers from the SHM community have made efforts to explore the applications of deep learning-based approaches for structural damage detection and structural condition assessment. This paper gives a review on the deep learning-based SHM of civil infrastructures with the main content, including a brief summary of the history of the development of deep learning, the applications of deep learning-based data processing approaches in the SHM of many kinds of civil infrastructures, and the key challenges and future trends of the strategy of deep learning-based SHM.