• Journal of Digital Contents Society
• /
• v.19 no.4
• /
• pp.757-770
• /
• 2018

Foreground extraction is the most significant step in thermal imaging based surveillance systems. This step needs to be efficient in terms of time and memory consumption in order for the system to provide real time results but usually this efficiency reciprocates with the accurateness of the ROI detection. In this study, novel selective histogram bins based two background & foreground separation approaches for thermal videos processing have been proposed which exploit the temporal-consistency property of the thermal images in a given environment and can save over 80% memory than their simplest counterpart temporal median filtering.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.3
• /
• pp.1301-1314
• /
• 2018

In this paper, we present a low-cost fire detection system using a thermal camera and a smartphone. The developed system collects thermal and RGB videos from the developed camera. To detect fire, candidate fire regions are extracted from videos obtained using a thermal camera. The block mean of variation of adjacent frames is measured to analyze the dynamic characteristics of the candidate fire regions. After analyzing the dynamic characteristics of regions of interest, a fire is determined by the candidate fire regions. In order to evaluate the performance of our system, we compared with a smoke detector, a heat detector, and a flame detector. In the experiments, our fire detection system showed the excellent performance in detecting fire with an overall accuracy rate of 97.8 %.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.8 no.10
• /
• pp.3475-3489
• /
• 2014

Here we present a simple flame detection method for an infrared (IR) thermal camera based real-time fire surveillance digital signal processor (DSP) system. Infrared thermal cameras are especially advantageous for unattended fire surveillance. All-weather monitoring is possible, regardless of illumination and climate conditions, and the data quantity to be processed is one-third that of color videos. Conventional IR camera-based fire detection methods used mainly pixel-based temporal correlation functions. In the temporal correlation function-based methods, temporal changes in pixel intensity generated by the irregular motion and spreading of the flame pixels are measured using correlation functions. The correlation values of non-flame regions are uniform, but the flame regions have irregular temporal correlation values. To satisfy the requirement of early detection, all fire detection techniques should be practically applied within a very short period of time. The conventional pixel-based correlation function is computationally intensive. In this paper, we propose an IR camera-based simple flame detection algorithm optimized with a compact embedded DSP system to achieve early detection. To reduce the computational load, block-based calculations are used to select the candidate flame region and measure the temporal motion of flames. These functions are used together to obtain the early flame detection algorithm. The proposed simple algorithm was tested to verify the required function and performance in real-time using IR test videos and a real-time DSP system. The findings indicated that the system detected the flames within 5 to 20 seconds, and had a correct flame detection ratio of 100% with an acceptable false detection ratio in video sequence level.

• Proceedings of the Korean Information Science Society Conference
• /
• 2012.06b
• /
• pp.369-371
• /
• 2012

Shadow detection and elimination is a critical issue in vision-based system to improve the detection performance of moving objects. However, traditional algorithms are useless at night time because they used the chromaticity and brightness information from the color image sequence. To obtain the high detection performance, we can use the thermal camera and there are shadows by the heat not the light. We proposed a novel algorithm to detect and eliminate the shadows using the thermal intensity and the locality property. By combining two results of the intensity-based and locality-based, we can detect the shadows by the heat and improve the detection performance of moving object.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.25 no.12
• /
• pp.1935-1941
• /
• 2021

In order to develop an algorithm using deep learning, which has been recently applied to various fields, it is necessary to have rich, high-quality learning data. In this paper, we propose an acquisition system for biological signals that simultaneously collects bio-signal data such as optical videos, thermal videos, and voices, which are mainly used in developing deep learning algorithms and useful in derivation of information, and transmit them to the server. To increase the portability of the collector, it was made based on Raspberry Pi, and the collected data is transmitted to the server through the wireless Internet. To enable simultaneous data collection from multiple collectors, an ID for login was assigned to each subject, and this was reflected in the database to facilitate data management. By presenting an example of biological data collection for fatigue measurement, we prove the application of the proposed acquisition system.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.14 no.5
• /
• pp.2156-2170
• /
• 2020

This paper presents a fire detection algorithm with a minimal false detection rate, intended for a thermal imaging surveillance environment, whose properties vary depending on temporal conditions of day or night and environmental changes. This algorithm was designed to minimize the false detection alarm rate while ensuring a high detection rate, as required in fire detection applications. It was necessary to reduce false fire detections due to non-flame elements occurring when existing fixed threshold-based fire detection methods were applied. To this end, adaptive flame thresholds that varied depending on the characteristics of input images, as well as the center of gravity of the heat-source and hot-source regions, were analyzed in an attempt to minimize such non-flame elements in the phase of selecting flame candidate blocks. Also, to remove any false detection elements caused by camera shaking, one of the most frequently raised issues at outdoor sites, preliminary decision thresholds were adaptively set to the motion pixel ratio of input images to maximize the accuracy of the preliminary decision. Finally, in addition to the preliminary decision results, the texture correlation and intensity of the flame candidate blocks were averaged for a specific period of time and tested for their conformity with the fire decision conditions before making the final decision. To verify the fire detection performance of the proposed algorithm, a total of ten test videos were subjected to computer simulation. As a result, the fire detection accuracy of the proposed algorithm was determined to be 94.24%, with minimum false detection, demonstrating its improved performance and practicality compared to previous fixed threshold-based algorithms.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2023.11a
• /
• pp.637-640
• /
• 2023

This paper presents multimodal image fusion with human pose for detecting abnormal human behaviors in low illumination conditions. Detecting human behaviors in low illumination conditions is challenging due to its limited visibility of the objects of interest in the scene. Multimodal image fusion simultaneously combines visual information in the visible spectrum and thermal radiation information in the long-wave infrared spectrum. We propose an abnormal event detection scheme based on the multimodal fused image and the human poses using the keypoints to characterize the action of the human body. Our method assumes that human behaviors are well correlated to body keypoints such as shoulders, elbows, wrists, hips. In detail, we extracted the human keypoint coordinates from human targets in multimodal fused videos. The coordinate values are used as inputs to train a multilayer perceptron network to classify human behaviors as normal or abnormal. Our experiment demonstrates a significant result on multimodal imaging dataset. The proposed model can capture the complex distribution pattern for both normal and abnormal behaviors.

• Journal of Aerospace System Engineering
• /
• v.17 no.2
• /
• pp.38-44
• /
• 2023

This study aims to determine how agricultural drones are operated for flight tests using a 5G communication in order to carry out a mission such as sensing agricultural crop healthy status with special cameras. Drones were installed with a multi-spectral and IR camera to capture images of crop status in separate altitudes with different speeds. A multi-spectral camera can capture crop image data using five different particular wavelengths with a built-in GPS so that captured images with synchronized time could provide better accuracy of position and altitude during the flight time. Captured thermal videos are then sent to a ground server to be analyzed via 5G communication. Thus, combining two cameras can result in better visualization of vegetation areas. The flight test verified how agricultural drones equipped with special cameras could collect image data in vegetation areas.

• KEPCO Journal on Electric Power and Energy
• /
• v.5 no.3
• /
• pp.149-156
• /
• 2019

In the field of maintenance of power transmission lines, drones have been used for their patrol and inspection by KEPCO since 2017. This drone technology was originally developed by KEPCO Research Institute, and now workers from four regional offices of KEPCO have directly applied this technology to the drone patrol and inspection tasks. In the drone inspection system, a drone with an optical zooming camera and a thermal camera can fly automatically along the transmission lines by the ground control system developed by KEPCO Research Institute, but its camera gimbal has been remotely controlled by a field worker. Especially the drone patrol and inspection has been mainly applied for the transmission lines in the inaccessible areas such as regions with river-crossings, sea-crossings and mountains. There are often communication disruptions between the drone and its remote controller in such extreme fields of mountain areas with many barriers. This problem may cause the camera gimbal be out of control, even though the inspection drone flies along the flight path well. In addition, interference with the reception of real-time transmitted videos makes the field worker unable to operate it. To solve these problems, we have developed the auto-tracking camera gimbal system with deep learning method. The camera gimbal can track the transmission line automatically, even when the transmitted video on a remote controller is intermittently unavailable. To show the effectiveness of our camera gimbal system, its field test results will be presented in this paper.