• 한국지능시스템학회논문지
• /
• 제25권2호
• /
• pp.147-154
• /
• 2015

본 논문에서는 승강기용 냉각장치의 에너지 절감을 위한 사람 검출과 퍼지 온도 제어 시스템을 제안한다. 기존의 냉매를 사용하는 냉각장치의 문제점들을 개선하기 위해 사람 검출과 퍼지 온도 제어 시스템으로 열전냉각장치를 구동시켜 에너지 절감을 하고 자동적으로 효율적인 온도 관리를 한다. 제안된 시스템은 사람 검출을 통해 승강기 탑승 인원수를 확인하고 나서 퍼지 시스템에서 탑승 인원수와 계절 평균 기온을 기반으로 온도 제어를 한다. 사람 검출 방법은 승강기에서 조감도 카메라를 기반으로 사람의 머리 부분을 특징으로 사용하여 탑승 인원수를 검지한다. 퍼지 시스템은 look-up table 방법으로서 검지된 인원수와 기온을 고려하여 승강기의 내부 온도를 결정한다. 제안된 시스템은 사람 검출과 온도 제어를 통해 냉각장치의 에너지를 절감시킨다. 실험을 통해 에너지 절감을 확인하고 제안된 시스템의 성능을 검증한다.

• JSTS:Journal of Semiconductor Technology and Science
• /
• 제14권2호
• /
• pp.212-226
• /
• 2014

This paper presents the design and implementation of a pipelined architecture and a method for real-time human detection using depth image from a Time-of-Flight (ToF) camera. In the proposed method, we use Euclidean Distance Transform (EDT) in order to extract human body location, and we then use the 1D, 2D scanning window in order to extract human joint location. The EDT-based human extraction method is robust against noise. In addition, the 1D, 2D scanning window helps extracting human joint locations easily from a distance image. The proposed method is designed using Verilog HDL (Hardware Description Language) as the dedicated hardware architecture based on pipeline architecture. We implement the dedicated hardware architecture on a Xilinx Virtex6 LX750 Field Programmable Gate Arrays (FPGA). The FPGA implementation can run 80 MHz of maximum operating frequency and show over 60fps of processing performance in the QVGA ($320{\times}240$) resolution depth image.

• Journal of Information Processing Systems
• /
• 제14권1호
• /
• pp.150-161
• /
• 2018

We propose a novel deep neural network model for detecting human activities in untrimmed videos. The process of human activity detection in a video involves two steps: a step to extract features that are effective in recognizing human activities in a long untrimmed video, followed by a step to detect human activities from those extracted features. To extract the rich features from video segments that could express unique patterns for each activity, we employ two different convolutional neural network models, C3D and I-ResNet. For detecting human activities from the sequence of extracted feature vectors, we use BLSTM, a bi-directional recurrent neural network model. By conducting experiments with ActivityNet 200, a large-scale benchmark dataset, we show the high performance of the proposed DeepAct model.

• International Journal of Computer Science & Network Security
• /
• 제21권2호
• /
• pp.221-228
• /
• 2021

Recent improvements on the quality, fidelity and availability of biometric data have led to effective human physical activity detection (HPAD) in real time which adds significant value to applications such as human behavior identification, healthcare monitoring, and user authentication. Current approaches usually use machine-learning techniques for human physical activity recognition based on the data collected from wearable accelerometer sensor from a single wearable smart device on the user. However, collecting data from a single wearable smart device may not provide the complete user activity data as it is usually attached to only single part of the user's body. In addition, in case of the absence of the single sensor, then no data can be collected. Hence, in this paper, a continuous HPAD will be presented to effectively perform user activity detection with mobile service infrastructure using multiple wearable smart devices, namely smartphone and smartwatch placed in various locations on user's body for more accurate HPAD. A case study on a comprehensive dataset of classified human physical activities with our HAPD approach shows substantial improvement in HPAD accuracy.

• 정보처리학회논문지B
• /
• 제19B권2호
• /
• pp.127-134
• /
• 2012

영상디지털도어록(Video digital door lock, VDDL) 시스템은 문으로 출입하는 사람을 검출하고 사람 영상을 획득한다. 도어록 설계 시 고려할 사항은 배터리 기반으로 동작하므로 속도가 빠른 사람 검출 알고리즘을 적용하여 전류소모를 최소화해야 한다. 그리고 도어록은 고정된 카메라에서 영상을 촬영하므로 배경영상을 이용한 사람 검출이 높은 신뢰성을 얻을 수 있다. 본 논문에서는 이러한 요구조건에 충족하며 VDDL에 적합한 단일 사람검출 알고리즘을 다루고 있는데, 획득한 영상에서 이동하는 물체를 감지하고 영상처리를 통해 물체가 사람인지를 판별한다. 제안된 영상처리 알고리즘은 두 단계로 이루어져 있다. 첫째, 배경영상과 피부색 정보를 통해 사람 이미지 영역을 구한다. 둘째, 인체비례 정보를 기반으로 폴라 히스토그램을 이용하여 사람 유무를 판단한다. 개발된 알고리즘은 도어록에 설치하고 실험을 통해 성능을 확인하였다.

• 방송공학회논문지
• /
• 제21권2호
• /
• pp.252-260
• /
• 2016

사람 검출의 성능은 카메라의 위치 및 각도 등에 큰 영향을 받는다. 이로 인해 획득한 2D 영상에서 사람은 위치에 따라 각기 다른 크기를 갖는 형태로 나타난다. 이렇게 다양한 크기를 갖는 사람들을 모두 검출하는 것은 실시간 시스템의 구현을 어렵게 만드는 요인이 된다. 그러나 만일 영상의 특정 위치의 사람의 크기를 예측할 수 있다면, 해당 위치의 사람 검출을 위한 연산량이 크게 감소될 수 있을 것이다. 본 논문에서는 실내 공간의 구조를 깊이맵으로 구성하고, 실내 공간에 존재하는 사람의 영상을 3D 공간에 재구성함으로써 크기를 예측하는 기법을 제안한다. 3D 공간에서는 어느 위치에서든지 사람의 크기가 일관되므로 이를 2D 영상으로 투영하게 되면 2D 영상의 좌표에 따른 정확한 사람의 크기를 추정할 수 있다. 실험 결과로부터 제안 방법이 효과적으로 사람의 크기를 예측할 수 있고, 기존이 기계학습 기반 사람 검출 방법들의 처리속도가 감소됨을 증명하였다.

• ETRI Journal
• /
• 제42권2호
• /
• pp.230-238
• /
• 2020

Human-object interaction (HOI) detection is a popular computer vision task that detects interactions between humans and objects. This task can be useful in many applications that require a deeper understanding of semantic scenes. Current HOI detection networks typically consist of a feature extractor followed by detection layers comprising small filters (eg, 1 × 1 or 3 × 3). Although small filters can capture local spatial features with a few parameters, they fail to capture larger context information relevant for recognizing interactions between humans and distant objects owing to their small receptive regions. Hence, we herein propose a three-stream HOI detection network that employs a context convolution module (CCM) in each stream branch. The CCM can capture larger contexts from input feature maps by adopting combinations of large separable convolution layers and residual-based convolution layers without increasing the number of parameters by using fewer large separable filters. We evaluate our HOI detection method using two benchmark datasets, V-COCO and HICO-DET, and demonstrate its state-of-the-art performance.

• 한국멀티미디어학회논문지
• /
• 제24권3호
• /
• pp.416-422
• /
• 2021

Due to the large differences in human activity within classes, the large similarity between classes, and the problems of visual angle and occlusion, it is difficult to extract features manually, and the detection rate of human behavior is low. In order to better solve these problems, an improved Faster R-CNN-based detection algorithm is proposed in this paper. It achieves multi-object recognition and localization through a second-order detection network, and replaces the original feature extraction module with Dense-Net, which can fuse multi-level feature information, increase network depth and avoid disappearance of network gradients. Meanwhile, the proposal merging strategy is improved with Soft-NMS, where an attenuation function is designed to replace the conventional NMS algorithm, thereby avoiding missed detection of adjacent or overlapping objects, and enhancing the network detection accuracy under multiple objects. During the experiment, the improved Faster R-CNN method in this article has 84.7% target detection result, which is improved compared to other methods, which proves that the target recognition method has significant advantages and potential.

• 센서학회지
• /
• 제13권3호
• /
• pp.188-194
• /
• 2004

With a remarkable advance in CMOS (complimentary metal-oxide-semiconductor) process technology, a variety of vision sensors with signal processing circuits for complicated functions are actively being developed. Especially, as the principles of signal processing in human retina have been revealed, a series of vision chips imitating human retina have been reported. Human retina is able to detect the edge and motion of an object effectively. The edge detection among the several functions of the retina is accomplished by the cells called photoreceptor, horizontal cell and bipolar cell. We designed a CMOS vision chip by modeling cells of the retina as hardwares involved in edge and motion detection. The designed vision chip was fabricated using $0.6{\mu}m$ CMOS process and the characteristics were measured. Having reliable output characteristics, this chip can be used at the input stage for many applications, like targe tracking system, fingerprint recognition system, human-friendly robot system and etc.

• 제어로봇시스템학회논문지
• /
• 제17권3호
• /
• pp.229-235
• /
• 2011

To make a robust object tracking and identifying system for an intelligent robot and/or home system, heterogeneous sensor fusion between visible ray system and infrared ray system is proposed. The proposed system separates the object by combining the ROI (Region of Interest) estimated from two different images based on a heterogeneous sensor that consolidates the ordinary CCD camera and the IR (Infrared) camera. Human's body and face are detected in both images by using different algorithms, such as histogram, optical-flow, skin-color model and Haar model. Also the pose of human body is estimated from the result of body detection in IR image by using PCA algorithm along with AdaBoost algorithm. Then, the results from each detection algorithm are fused to extract the best detection result. To verify the heterogeneous sensor fusion system, few experiments were done in various environments. From the experimental results, the system seems to have good tracking and identification performance regardless of the environmental changes. The application area of the proposed system is not limited to robot or home system but the surveillance system and military system.