• The KIPS Transactions:PartB
• /
• v.11B no.3
• /
• pp.327-336
• /
• 2004

For visual inspection system in real industrial environment, it is one of most important tasks to design fast and stable pattern matching algorithm. This paper presents an edge-based point correlation algorithm avoiding full search in visual inspection system. Conventional algorithms based on NGC(normalized gray-level correlation) have to overcome some difficulties for applying to automated inspection system in factory environment. First of all, NGC algorithms need high time complexity and thus high performance hardware to satisfy real-time process. In addition, lighting condition in realistic factory environments if not stable and therefore intensity variation from uncontrolled lights gives many roubles for applying directly NGC as pattern matching algorithm in this paper, we propose an algorithm to solve these problems from using thinned and binarized edge data and skipping full point search with edge-map analysis. A point correlation algorithm with the thinned edges is introduced with image pyramid technique to reduce the time complexity. Matching edges instead of using original gray-level pixel data overcomes NGC problems and pyramid of edges also provides fast and stable processing. All proposed methods are preyed from experiments using real images.

• Journal of Construction Engineering and Project Management
• /
• v.5 no.4
• /
• pp.16-22
• /
• 2015

This paper presents an automated computer vision-based system to update BIM data by leveraging multi-modal visual data collected from existing buildings under inspection. Currently, visual inspections are conducted for building envelopes or mechanical systems, and auditors analyze energy-related contextual information to examine if their performance is maintained as expected by the design. By translating 3D surface thermal profiles into energy performance metrics such as actual R-values at point-level and by mapping such properties to the associated BIM elements using XML Document Object Model (DOM), the proposed method shortens the energy performance modeling gap between the architectural information in the as-designed BIM and the as-is building condition, which improve the reliability of building energy analysis. Several case studies were conducted to experimentally evaluate their impact on BIM-based energy analysis to calculate energy load. The experimental results on existing buildings show that (1) the point-level thermography-based thermal resistance measurement can be automatically matched with the associated BIM elements; and (2) their corresponding thermal properties are automatically updated in gbXML schema. This paper provides practitioners with insight to uncover the fundamentals of how multi-modal visual data can be used to improve the accuracy of building energy modeling for retrofit analysis. Open research challenges and lessons learned from real-world case studies are discussed in detail.

• International conference on construction engineering and project management
• /
• 2015.10a
• /
• pp.532-536
• /
• 2015

This paper presents an automated computer vision-based system to update BIM data by leveraging multi-modal visual data collected from existing buildings under inspection. Currently, visual inspections are conducted for building envelopes or mechanical systems, and auditors analyze energy-related contextual information to examine if their performance is maintained as expected by the design. By translating 3D surface thermal profiles into energy performance metrics such as actual R-values at point-level and by mapping such properties to the associated BIM elements using XML Document Object Model (DOM), the proposed method shortens the energy performance modeling gap between the architectural information in the as-designed BIM and the as-is building condition, which improve the reliability of building energy analysis. The experimental results on existing buildings show that (1) the point-level thermography-based thermal resistance measurement can be automatically matched with the associated BIM elements; and (2) their corresponding thermal properties are automatically updated in gbXML schema. This paper provides practitioners with insight to uncover the fundamentals of how multi-modal visual data can be used to improve the accuracy of building energy modeling for retrofit analysis. Open research challenges and lessons learned from real-world case studies are discussed in detail.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.17 no.1
• /
• pp.453-458
• /
• 2016

One of the most common applications of machine vision is quality inspections in automated production. In this study, a welding inspection system that is controlled by a PC and a PLC equipped with a multi-camera setup was developed. The system was designed to measure the primary dimensions, such as the length and width of the welding areas. The TCP/IP protocols and multi-threading techniques were used for parallel control of the optical components and physical distribution. A coaxial light was used to maintain uniform lighting conditions and enhance the image quality of the weld areas. The core image processing system was established through a combination of various algorithms from the OpenCV library. The proposed vision inspection system was fully validated for an actual weld production line and was shown to satisfy the functional and performance requirements.

• International conference on construction engineering and project management
• /
• 2020.12a
• /
• pp.399-408
• /
• 2020

The construction industry is suffering from aging workers, frequent accidents, as well as low productivity. With the rapid development of information technologies in recent years, automatic construction, especially automatic cranes, is regarded as a promising solution for the above problems and attracting more and more attention. However, in practice, limited by the complexity and dynamics of construction environment, manual inspection which is time-consuming and error-prone is still the only way to recognize the search object for the operation of crane. To solve this problem, an image-processing-based automated object recognition approach is proposed in this paper, which is a fusion of Convolutional-Neutral-Network (CNN)-based and traditional object detections. The search object is firstly extracted from the background by the trained Faster R-CNN. And then through a series of image processing including Canny, Hough and Endpoints clustering analysis, the vertices of the search object can be determined to locate it in 3D space uniquely. Finally, the features (e.g., centroid coordinate, size, and color) of the search object are extracted for further recognition. The approach presented in this paper was implemented in OpenCV, and the prototype was written in Microsoft Visual C++. This proposed approach shows great potential for the automatic operation of crane. Further researches and more extensive field experiments will follow in the future.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.18 no.4
• /
• pp.959-979
• /
• 2024

Rice pest identification is essential in modern agriculture for the health of rice crops. As global rice consumption rises, yields and quality must be maintained. Various methodologies were employed to identify pests, encompassing sensor-based technologies, deep learning, and remote sensing models. Visual inspection by professionals and farmers remains essential, but integrating technology such as satellites, IoT-based sensors, and drones enhances efficiency and accuracy. A computer vision system processes images to detect pests automatically. It gives real-time data for proactive and targeted pest management. With this motive in mind, this research provides a novel farmland fertility algorithm with a deep learning-based automated rice pest detection and classification (FFADL-ARPDC) technique. The FFADL-ARPDC approach classifies rice pests from rice plant images. Before processing, FFADL-ARPDC removes noise and enhances contrast using bilateral filtering (BF). Additionally, rice crop images are processed using the NASNetLarge deep learning architecture to extract image features. The FFA is used for hyperparameter tweaking to optimise the model performance of the NASNetLarge, which aids in enhancing classification performance. Using an Elman recurrent neural network (ERNN), the model accurately categorises 14 types of pests. The FFADL-ARPDC approach is thoroughly evaluated using a benchmark dataset available in the public repository. With an accuracy of 97.58, the FFADL-ARPDC model exceeds existing pest detection methods.

• Structural Engineering and Mechanics
• /
• v.87 no.3
• /
• pp.211-219
• /
• 2023

The structural health of a pipeline is usually assessed by visual inspection. In addition to the fact that this method is expensive and time consuming, inspection of the whole structure is not possible due to limited access to some points. Therefore, adopting a damage detection method without the mentioned limitations is important in order to increase the safety of the structure. In recent years, vibration-based methods have been used to detect damage. These methods detect structural defects based on the fact that the dynamic responses of the structure will change due to damage existence. Therefore, the location and extent of damage, before and after the damage, are determined. In this study, fuzzy genetic algorithm has been used to monitor the structural health of the pipeline to create a fuzzy automated system and all kinds of possible failure scenarios that can occur for the structure. For this purpose, the results of an experimental model have been used. Its numerical model is generated in ABAQUS software and the results of the analysis are used in the fuzzy genetic algorithm. Results show that the system is more accurate in detecting high-intensity damages, and the use of higher frequency modes helps to increase accuracy. Moreover, the system considers the damage in symmetric regions with the same degree of membership. To deal with the uncertainties, some error values are added, which are observed to be negligible up to 10% of the error.

• Journal of the Computational Structural Engineering Institute of Korea
• /
• v.31 no.3
• /
• pp.147-153
• /
• 2018

Cracking in concrete structure must be examined according to appropriate methods, to ensure structural serviceability and to prevent structural deterioration, since cracks opened wide for a long time expedite corrosion of rebar. A site investigation is conducted in a regular basis to monitor structural deterioration by tracking growing cracks. However, the visual inspection are labor intensive. and judgment are subject. To overcome the limit of the on-site visual investigation image processing for identifying the cracks of concrete structures by analyzing 2D images has been developed. This study develops a unique 3D technique utilizing a line laser and its projection image onto concrete surfaces. Automated process of crack detection is developed by the algorithms of automatizing crack map generation and image data acquisition. Performance of the developed method is experimentally evaluated.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2019.05a
• /
• pp.220-222
• /
• 2019

Korean automobile industry has been slow down since 2016. The most fundamental solution for solving this problem is to develop competitive parts. There are two important factors for developing competitive parts. The most important is product design technology, and the second most important is production technology. Production technology is important because it requires lowering the production cost except for the material cost and continuously maintaining the quality. In this paper, an intelligent smart inspection system is proposed and designed to inspect automobile parts of company C. At present, the basic and detailed design of this system has been completed and it is in the development progress stage. If the system is successfully developed, it is expected that the quality inspection stage of company C will be automated and the defect rate will be reduced.

• International conference on construction engineering and project management
• /
• 2024.07a
• /
• pp.303-310
• /
• 2024

In this study, we conducted a work analysis at an active building construction site, utilizing three-axis acceleration sensors affixed to four plaster-board-pasting workers for five days. Although acceleration data is less accurate than visual or image recognition in identifying specific tasks, it can be easily captured using smartphones, even in challenging conditions such as poorly lit or obstructed construction sites. This accessibility facilitates continuous data collection over extended periods, enabling automated analysis without significant cost or time investment. In addition, this method can identify trends in worker behavior that elude conventional visual inspection. Our approach encompasses various evaluation indices, beginning with an analysis of average work time per plasterboard sheet and the differentiation of walking motions using acceleration data. Furthermore, we introduced a new evaluation index that quantifies the distribution of high- and low-intensity work based on acceleration readings. Through comparative analysis with evaluation indices from previous studies, we confirmed common trends and discussed the strengths and limitations of our proposed index. Our findings suggest a correlation between work experience and performance, as evidenced by smoother operational patterns among seasoned workers. In particular, proficient workers exhibited fewer instances of extremely intense or sporadic movements. This observation underscores the influence of experience on work dynamics.