• Journal of Electrical Engineering and Technology
• /
• 제6권6호
• /
• pp.806-816
• /
• 2011

Interest about social security has recently increased in favor of safety for infrastructure. In addition, advances in computer vision and pattern recognition research are leading to video-based surveillance systems with improved scene analysis capabilities. However, such video surveillance systems, which are controlled by human operators, cannot actively cope with dynamic and anomalous events, such as having an invader in the corporate, commercial, or public sectors. For this reason, intelligent surveillance systems are increasingly needed to provide active social security services. In this study, we propose a core technique for intelligent surveillance system that is based on swarm robot technology. We present techniques for invader enclosing using swarm robots based on multiple distributed object environment. The proposed methods are composed of three main stages: location estimation of the object, specified object tracking, and decision of the cooperative behavior of the swarm robots. By using particle filter, object tracking and location estimation procedures are performed and a specified enclosing point for the swarm robots is located on the interactive positions in their coordinate system. Furthermore, the cooperative behaviors of the swarm robots are determined via the result of path navigation based on the combination of potential field and wall-following methods. The results of each stage are combined into the swarm robot-based invader-enclosing technique on multiple distributed object environments. Finally, several simulation results are provided to further discuss and verify the accuracy and effectiveness of the proposed techniques.

• International Journal of Advanced Culture Technology
• /
• 제8권1호
• /
• pp.207-212
• /
• 2020

The human centric lighting (HCL) control is a major focus point of the smart lighting system design to provide energy efficient and people mood rhythmic motivation lighting in smart buildings. This paper proposes the HCL control using indoor surveillance camera to improve the human motivation and well-beings in the indoor environments like residential and industrial buildings. In this proposed approach, the indoor surveillance camera video streams are used to predict the day lights and occupancy, occupancy specific emotional features predictions using the advanced computer vision techniques, and this human centric features are transmitted to the smart building light management system. The smart building light management system connected with internet of things (IoT) featured lighting devices and controls the light illumination of the objective human specific lighting devices. The proposed concept experimental model implemented using RGB LED lighting devices connected with IoT features open-source controller in the network along with networked video surveillance solution. The experiment results are verified with custom made automatic lighting control demon application integrated with OpenCV framework based computer vision methods to predict the human centric features and based on the estimated features the lighting illumination level and colors are controlled automatically. The experiment results received from the demon system are analyzed and used for the real-time development of a lighting system control strategy.

• 반도체디스플레이기술학회지
• /
• 제14권3호
• /
• pp.37-43
• /
• 2015

In this paper, a new background subtraction algorithm for video based fence monitoring surveillance systems is proposed. We adopt the sampling based background subtraction technique and focus on the two main issues: handling highly dynamic environment and handling the flickering nature of pulse based IR (infrared) lamp. Natural scenes from fence monitoring system are usually composed of several dynamic entities such as swaying trees, moving water, waves and rain. To deal with such dynamic backgrounds, we utilize the confidence factor for each background value of the input image. For the flickering IR lamp, the original sampling based technique is extended to handle double background models. Experimental results revealed that our method works well in real fence monitoring surveillance systems.

• 한국컴퓨터정보학회논문지
• /
• 제22권12호
• /
• pp.79-85
• /
• 2017

In this paper, we propose a CNN-based swimmer detection algorithm. Every year, water safety accidents have been occurred frequently, and accordingly, intelligent video surveillance systems are being developed to prevent accidents. Intelligent video surveillance system is a real-time system that detects objects which users want to do. It classifies or detects objects in real-time using algorithms such as GMM (Gaussian Mixture Model), HOG (Histogram of Oriented Gradients), and SVM (Support Vector Machine). However, HOG has a problem that it cannot accurately detect the swimmer in a complex and dynamic environment such as a beach. In other words, there are many false positives that detect swimmers as waves and false negatives that detect waves as swimmers. To solve this problem, in this paper, we propose a swimmer detection algorithm using CNN (Convolutional Neural Network), specialized for small object sizes, in order to detect dynamic objects and swimmers more accurately and efficiently in complex environment. The proposed CNN sets the size of the input image and the size of the filter used in the convolution operation according to the size of objects. In addition, the aspect ratio of the input is adjusted according to the ratio of detected objects. As a result, experimental results show that the proposed CNN-based swimmer detection method performs better than conventional techniques.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제12권9호
• /
• pp.4355-4374
• /
• 2018

Crowd escape event detection has become one of the hottest problems in intelligent surveillance filed. When the 'escape event' occurs, pedestrians will escape in a disordered way with different velocities and directions. Based on these characteristics, this paper proposes a Direction-Collectiveness Model to detect escape event in crowd scenes. First, we extract a set of trajectories from video sequences by using generalized Kanade-Lucas-Tomasi key point tracker (gKLT). Second, a Direction-Collectiveness Model is built based on the randomness of velocity and orientation calculated from the trajectories to express the movement of the crowd. This model can describe the movement of the crowd adequately. To obtain a generalized crowd escape event detector, we adopt an adaptive threshold according to the Direction-Collectiveness index. Experiments conducted on two widely used datasets demonstrate that the proposed model can detect the escape events more effectively from dense crowd.

• 제어로봇시스템학회논문지
• /
• 제16권1호
• /
• pp.69-76
• /
• 2010

The segmentation of moving object in video sequence is a core technique of intelligent image processing system such as video surveillance, traffic monitoring and human tracking. A typical method to segment a moving region from the background is the background subtraction. The steps of background subtraction involve calculating a reference image, subtracting new frame from reference image and then thresholding the subtracted result. One of famous background modeling is Gaussian mixture model (GMM). Even though the method is known efficient and exact, GMM suffers from a problem that includes false pixels in ROI (region of interest), specifically shadow pixels. These false pixels cause fail of the post-processing tasks such as tracking and object recognition. This paper presents a method for removing false pixels included in ROT. First, we subdivide a ROI by using shape characteristics of detected objects. Then, a method is proposed to classify pixels from using histogram characteristic and comparing difference of energy that converts the color value of pixel into grayscale value, in order to estimate whether the pixels belong to moving object area or shadow area. The method is applied to real video sequence and the performance is verified.

• 국제학술발표논문집
• /
• The 10th International Conference on Construction Engineering and Project Management
• /
• pp.1282-1282
• /
• 2024

Given the widespread use of intelligent surveillance cameras at construction sites, recent studies have introduced vision-based deep learning approaches. These studies have focused on enhancing the performance of vision-based excavator activity recognition to automatically monitor productivity metrics such as activity time and work cycle. However, acquiring a large amount of training data, i.e., videos captured from actual construction sites, is necessary for developing a vision-based excavator activity recognition model. Yet, complexities of dynamic working environments and security concerns at construction sites pose limitations on obtaining such videos from various surveillance camera locations. Consequently, this leads to performance degradation in excavator activity recognition models, reducing the accuracy and efficiency of heavy equipment productivity analysis. To address these limitations, this study aimed to conduct sensitivity analysis of excavator activity recognition performance based on surveillance camera location, utilizing synthetic videos generated from a game-engine-based virtual environment (Unreal Engine). Various scenarios for surveillance camera placement were devised, considering horizontal distance (20m, 30m, and 50m), vertical height (3m, 6m, and 10m), and horizontal angle (0° for front view, 90° for side view, and 180° for backside view). Performance analysis employed a 3D ResNet-18 model with transfer learning, yielding approximately 90.6% accuracy. Main findings revealed that horizontal distance significantly impacted model performance. Overall accuracy decreased with increasing distance (76.8% for 20m, 60.6% for 30m, and 35.3% for 50m). Particularly, videos with a 20m horizontal distance (close distance) exhibited accuracy above 80% in most scenarios. Moreover, accuracy trends in scenarios varied with vertical height and horizontal angle. At 0° (front view), accuracy mostly decreased with increasing height, while accuracy increased at 90° (side view) with increasing height. In addition, limited feature extraction for excavator activity recognition was found at 180° (backside view) due to occlusion of the excavator's bucket and arm. Based on these results, future studies should focus on enhancing the performance of vision-based recognition models by determining optimal surveillance camera locations at construction sites, utilizing deep learning algorithms for video super resolution, and establishing large training datasets using synthetic videos generated from game-engine-based virtual environments.

• 한국ITS학회 논문지
• /
• 제8권4호
• /
• pp.93-101
• /
• 2009

산업 사회가 급속도로 발전함에 따라 전 세계적으로 전쟁, 테러, 강력 범죄가 증가하고 있다. 이러한 위험 요소들은 인명 피해 및 자원에 대한 파괴로 이어지는 주된 원인이 된다. 최근 강력 범죄의 잦은 발생으로 사회적 불안감이 조장되고 있으며 이러한 이유로 더 나은 안전, 보안 시스템 분야를 점검하는 계기가 되었다. 보안 시스템의 대표적인 장비라고 할 수 있는 CCTV카메라 시스템은 각 지역 자체적으로 공공장소 등과 같이 유동인구가 많은 지역에 확대 설치될 계획이다. 이것은 감시의 목적뿐만 아니라 보안 기술의 중요성에 대한 인식이 점차 높아짐에 따라 최소 인력으로 최대한의 감시 효과를 가질 수 있는 지능형 영상 보안 기술의 확대 보급을 요구하고 있다. 본 논문에서는 이러한 지능형 감시 카메라의 동향 및 시나리오에 대해서 살펴본다.

• 한국통신학회논문지
• /
• 제39C권8호
• /
• pp.731-737
• /
• 2014

본 논문에서는 감시 카메라 환경에서 발생할 수 있는 군중의 비정상 행동 검출 방법을 제안한다. 군중들의 비정상 행동을 산발적으로 퍼지면서 뛰는 행동, 한쪽 방향으로 갑자기 뛰는 행동 두 가지로 정의하였다. 이를 검출하기 위하여 영상에서 움직임 벡터를 추출하여 군중의 비정상 행동 검출에 적합한 서술자 MHOF(Multi-scale Histogram of Optical Flow)와 DCHOF(Directional Change Histogram of Optical Flow)제안하였으며, 이를 이진 분류기인 SVM(Support Vector Machine)을 이용하여 검출하였다. 제안한 방법은 공개 데이터셋인 UMN 데이터와 PETS 2009 데이터를 이용하여 성능을 평가하였고 다른 방법론과의 비교를 통해 제안하는 알고리즘의 우수성을 입증하였다.

• 한국지능시스템학회논문지
• /
• 제26권4호
• /
• pp.259-266
• /
• 2016

최근 감시와 보안을 목적으로 활발하게 CCTV가 설치되고 있고, 지능형 감시시스템은 영상에서 객체의 검출 및 감시 등으로 광범위하게 응용되고 있다. 본 연구에서는 지능형 영상 감시 시스템에서 HOG 특징과 FCM 기반의 RBFNN 분류기를 이용한 상반신 검출 방법을 제안한다. HOG는 보행자를 검출하기 위해 기존에 제안되었던 특징으로 본 논문에서는 이를 사용해 상반신의 고유한 기울기를 학습하였다. HOG 특징은 입력 이미지의 크기에 비례하는 고차원의 특징 벡터로 기울기를 표현하기 때문에 RBFNN분류기의 입력데이터로 쓰려면 차원 축소가 필요하다. 이를 위해 PCA 알고리즘을 RBFNN 분류기 앞에 적용하여 HOG 특징의 차원을 저차원으로 축소하였다. 컴퓨터 실험에서는 미리 분류된 상반신 영상과 사람이 아닌 영상을 통해 분류기를 훈련시킨 후 테스트 영상과 동영상을 이용하여 제안된 상반신 검출 방법의 성능을 평가하였다.