• International conference on construction engineering and project management
• /
• 2015.10a
• /
• pp.304-309
• /
• 2015

On construction sites, it is important to monitor the performance of construction equipment and workers to achieve successful construction project management; especially, vision-based detection methods have advantages for the real-time site data collection for safety and productivity analyses. Although many researchers developed vision-based detection methods with acceptable performance, there are still limitations to be addressed: 1) sensitiveness to the shape and appearance changes of moving objects in difference working postures, and 2) high computation time. To deal with the limitations, this paper proposes a detection algorithm of construction equipment based on Integral Channel Features. For validation, 16,850 frames of video streams were recorded and analyzed. The results showed that the proposed method worked in high performance in terms of accuracy and processing time. In conclusion, the developed method can help to understand useful site information including working pattern, working time and input manpower analyses.

• Journal of Drive and Control
• /
• v.17 no.3
• /
• pp.1-8
• /
• 2020

Recently, a special purpose machine with two manipulators and quadruped crawler system has been developed for rapid life-saving and initial restoration work at disaster sites. This special purpose machine provides the driver with various environmental recognition functions for accurate and rapid task determination. In particular, the human detection technology assists the driver in poor working conditions such as low-light, dust, water vapor, fog, rain, etc. to prevent secondary human accidents when moving and working. In this study, a human detection module is developed to be mounted on a special purpose machine. A thermal sensor and CCD camera were used to detect victims and nearby workers in response to the difficult environmental conditions present at disaster sites. The performance of various AI-based life detection algorithm were verified and then applied to the task of detecting various objects with different postures and exposure conditions. In addition, image visibility improvement technology was applied to further improve the accuracy of human detection.

• International conference on construction engineering and project management
• /
• 2022.06a
• /
• pp.736-743
• /
• 2022

Construction workers experience a high rate of fatal incidents from mobile equipment in the industry. One of the major causes is the decline in the acoustic condition of workers due to the constant exposure to construction noise. Previous studies have proposed various ways in which audio sensing and machine learning techniques can be used to track equipment's movement on the construction site but not on the audibility of safety signals. This study develops a novel framework to help automate safety surveillance in the construction site. This is done by detecting the audio sound at a different signal-to-noise ratio of -10db, -5db, 0db, 5db, and 10db to notify the worker of imminent dangers of mobile equipment. The scope of this study is focused on developing a signal processing model to help improve the audible sense of mobile equipment for workers. This study includes three-phase: (a) collect audio data of construction equipment, (b) develop a novel audio-based machine learning model for automated detection of collision hazards to be integrated into intelligent hearing protection devices, and (c) conduct field experiments to investigate the system' efficiency and latency. The outcomes showed that the proposed model detects equipment correctly and can timely notify the workers of hazardous situations.

• Journal of KIBIM
• /
• v.11 no.2
• /
• pp.24-32
• /
• 2021

Recently, starting with smart construction research, interest in technology that automates construction site management using artificial intelligence technology is increasing. In order to automate construction site management, it is necessary to recognize objects such as construction equipment or workers, and automatically analyze the relationship between them. For example, if the relationship between workers and construction equipment at a construction site can be known, various use cases of site management such as work productivity, equipment operation status monitoring, and safety management can be implemented. This study derives a real-time object detection platform architecture that is required when performing construction site management using deep learning technology, which has recently been increasingly used. To this end, deep learning models that support real-time object detection are investigated and analyzed. Based on this, a deep learning model development process required for real-time construction site object detection is defined. Based on the defined process, a prototype that learns and detects construction site objects is developed, and then platform development considerations and architecture are derived from the results.

• Proceedings of the Korean Institute of Building Construction Conference
• /
• 2023.05a
• /
• pp.173-174
• /
• 2023

In this paper, we introduce a model for detecting Personal Protective Equipment (PPE) using YOLO (You Only Look Once), an object detection neural network. PPE is used to maintain a safe working environment, and proper use of PPE protects workers' safety and health. However, failure to wear PPE or wearing it improperly can cause serious safety issues. Therefore, a PPE detection system is crucial in industrial settings.

• Journal of the Korea Institute of Building Construction
• /
• v.23 no.1
• /
• pp.81-92
• /
• 2023

According to the 2020 industrial accident reports of the Ministry of Employment and Labor, the number of fatal accidents in the construction industry over the past 5 years has been higher than in other industries. Of these more than 50% of fatal accidents are initially caused by fall accidents. The central government is intensively managing falling/jamming protection device and the use of personal protective equipment to eradicate the inappropriate factors disrupting safety at construction sites. In addition, although efforts have been made to prevent safety accidents with the proposal of the Special Act on Construction Safety, fatalities on construction sites are constantly occurring. Therefore, this study developed a model that automatically detects the wearing state of the worker's safety helmet and belt using computer vision technology. In considerations of conditions occurring at construction sites, we suggest an optimization method, which has been verified in terms of the accuracy and operation speed of the proposed model. As a result, it is possible to improve the efficiency of inspection and patrol by construction site managers, which is expected to contribute to reinforcing competency of safety management.

• Journal of the Society of Disaster Information
• /
• v.18 no.2
• /
• pp.269-279
• /
• 2022

Purpose: The purpose of this study is to develop a deep learning-based personal protective equipment detection model for disaster prevention at construction sites, and to apply it to actual construction sites and to analyze the results. Method: In the method of conducting this study, the dataset on the real environment was constructed and the developed personal protective equipment(PPE) detection model was applied. The PPE detection model mainly consists of worker detection and PPE classification model.The worker detection model uses a deep learning-based algorithm to build a dataset obtained from the actual field to learn and detect workers, and the PPE classification model applies the PPE detection algorithm learned from the worker detection area extracted from the work detection model. For verification of the proposed model, experimental results were derived from data obtained from three construction sites. Results: The application of the PPE recognition model to construction site brings up the problems related to mis-recognition and non-recognition. Conclusions: The analysis outcomes were produced to apply the object recognition technology to a construction site, and the need for follow-up research was suggested through representative cases of worker recognition and non-recognition, and mis-recognition of personal protective equipment.

• International conference on construction engineering and project management
• /
• 2015.10a
• /
• pp.313-316
• /
• 2015

Construction is one of the most dangerous job sectors, which reports tens of thousands of time-loss injuries and deaths every year. These disasters incur delays and additional costs to the projects. The safety management needs to be on the top primary tasks throughout the construction to avoid fatal accidents and to foster safe working environments. One of the safety regulations that are frequently violated is the wearing of personal protection equipment (PPE). In order to facilitate monitoring of the compliance of the PPE wearing regulations, this paper proposes a vision based method that automatically identifies whether workers wear hard hats and safety vests. The method involves three modules - human body detection, identification of safety vest wearing, and hard hat detection. First, human bodies are detected in the video frames captured by real-time on-site construction cameras. The detected human bodies are classified into with/without wearing safety vests based on the color features of their upper parts. Finally, hard hats are detected on the nearby regions of the detected human bodies and the locations of the detected hard hats and human bodies are correlated to reveal their corresponding matches. In this way, the proposed method provides any appearance of the workers without wearing hard hats or safety vests. The method has been tested on onsite videos and the results signify its potential to facilitate site safety monitoring.

• International conference on construction engineering and project management
• /
• 2020.12a
• /
• pp.455-462
• /
• 2020

Noise which is unwanted sound is a serious pollutant that can affect human health, as well as the working and living environment if exposed to humans. However, current noise management on the construction project is generally conducted after the noise exceeds the regulation standard, which increases the conflicts with inhabitants near the construction site and threats to the safety and productivity of construction workers. To overcome the limitations of the current noise management methods, the activities of construction equipment which is the main source of construction noise need to be managed throughout the construction period in real-time. Therefore, this paper proposed a framework for automatically detecting noise sources in construction sites in real-time based on convolutional neural networks (CNNs) according to the following four steps: (i) Step 1: Definition of the noise sources; (ii) Step 2: Data preparation; (iii) Step 3: Noise source classification using the audio CNN; and (iv) Step 4: Noise source detection using the visual CNN. The short-time Fourier transform (STFT) and temporal image processing are used to contain temporal features of the audio and visual data. In addition, the AlexNet and You Only Look Once v3 (YOLOv3) algorithms have been adopted to classify and detect the noise sources in real-time. As a result, the proposed framework is expected to immediately find construction activities as current noise sources on the video of the construction site. The proposed framework could be helpful for environmental construction managers to efficiently identify and control the noise by automatically detecting the noise sources among many activities carried out by various types of construction equipment. Thereby, not only conflicts between inhabitants and construction companies caused by construction noise can be prevented, but also the noise-related health risks and productivity degradation for construction workers and inhabitants near the construction site can be minimized.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.43 no.1
• /
• pp.99-107
• /
• 2023

Recently, the rate of death and safety accidents at construction sites is the highest among all kinds of industries. In order to apply artificial intelligence technology to construction sites, it is essential to secure a dataset which can be used as a basic training data. In this paper, a number of image data were collected through actual construction site, for which major construction equipment objects mainly operated in civil engineering sites were defined. The optimal training dataset construction was completed by annotation process of about 90,000 image dataset. Reliability of the dataset was verified with the mAP of over 90 % in use of YOLO, a representative model in the field of object detection. The construction equipment training dataset built in this study has been released which is currently available on the public data portal of the Ministry of Public Administration and Security. This dataset is expected to be freely used for any application of object detection technology on construction sites especially in the field of construction safety in the future.