• The Journal of the Korea institute of electronic communication sciences
• /
• v.18 no.6
• /
• pp.1307-1312
• /
• 2023

In this paper, we propose a hybrid camera system that combines cameras with different focal lengths and LiDAR (Light Detection and Ranging) sensors to address the core components of autonomous driving perception technology, which include object recognition and distance measurement. We extract objects within the scene and generate precise location and distance information for these objects using the proposed hybrid camera system. Initially, we employ the YOLO7 algorithm, widely utilized in the field of autonomous driving due to its advantages of fast computation, high accuracy, and real-time processing, for object recognition within the scene. Subsequently, we use multi-focal cameras to create depth maps to generate object positions and distance information. To enhance distance accuracy, we integrate the 3D distance information obtained from LiDAR sensors with the generated depth maps. In this paper, we introduce not only an autonomous vehicle platform capable of more accurately perceiving its surroundings during operation based on the proposed hybrid camera system, but also provide precise 3D spatial location and distance information. We anticipate that this will improve the safety and efficiency of autonomous vehicles.

• Journal of Intelligence and Information Systems
• /
• v.21 no.1
• /
• pp.83-98
• /
• 2015

Many TV viewers use mainly portal sites in order to retrieve information related to broadcast while watching TV. However retrieving information that people wanted needs a lot of time to retrieve the information because current internet presents too much information which is not required. Consequentially, this process can't satisfy users who want to consume information immediately. Interactive video is being actively investigated to solve this problem. An interactive video provides clickable objects, areas or hotspots to interact with users. When users click object on the interactive video, they can see additional information, related to video, instantly. The following shows the three basic procedures to make an interactive video using interactive video authoring tool: (1) Create an augmented object; (2) Set an object's area and time to be displayed on the video; (3) Set an interactive action which is related to pages or hyperlink; However users who use existing authoring tools such as Popcorn Maker and Zentrick spend a lot of time in step (2). If users use wireWAX then they can save sufficient time to set object's location and time to be displayed because wireWAX uses vision based annotation method. But they need to wait for time to detect and track object. Therefore, it is required to reduce the process time in step (2) using benefits of manual annotation method and vision-based annotation method effectively. This paper proposes a novel annotation method allows annotator to easily annotate based on face area. For proposing new annotation method, this paper presents two steps: pre-processing step and annotation step. The pre-processing is necessary because system detects shots for users who want to find contents of video easily. Pre-processing step is as follow: 1) Extract shots using color histogram based shot boundary detection method from frames of video; 2) Make shot clusters using similarities of shots and aligns as shot sequences; and 3) Detect and track faces from all shots of shot sequence metadata and save into the shot sequence metadata with each shot. After pre-processing, user can annotates object as follow: 1) Annotator selects a shot sequence, and then selects keyframe of shot in the shot sequence; 2) Annotator annotates objects on the relative position of the actor's face on the selected keyframe. Then same objects will be annotated automatically until the end of shot sequence which has detected face area; and 3) User assigns additional information to the annotated object. In addition, this paper designs the feedback model in order to compensate the defects which are wrong aligned shots, wrong detected faces problem and inaccurate location problem might occur after object annotation. Furthermore, users can use interpolation method to interpolate position of objects which is deleted by feedback. After feedback user can save annotated object data to the interactive object metadata. Finally, this paper shows interactive video authoring system implemented for verifying performance of proposed annotation method which uses presented models. In the experiment presents analysis of object annotation time, and user evaluation. First, result of object annotation average time shows our proposed tool is 2 times faster than existing authoring tools for object annotation. Sometimes, annotation time of proposed tool took longer than existing authoring tools, because wrong shots are detected in the pre-processing. The usefulness and convenience of the system were measured through the user evaluation which was aimed at users who have experienced in interactive video authoring system. Recruited 19 experts evaluates of 11 questions which is out of CSUQ(Computer System Usability Questionnaire). CSUQ is designed by IBM for evaluating system. Through the user evaluation, showed that proposed tool is useful for authoring interactive video than about 10% of the other interactive video authoring systems.

• The Transactions of the Korean Institute of Electrical Engineers A
• /
• v.49 no.10
• /
• pp.516-523
• /
• 2000

In this paper, intelligent methods using digital protective relay in power supervisory control system is developed in order to protect power systems by means of timely fault detection and diagnosis during operation for induction motor which has various load environments and capacities in power systems. The spectrum pattern of input currents was used to monitor to state of induction motors, and by clustering the spectrum pattern of input currents, the newly occurrence of spectrums pattern caused by faults were detected. For diagnosis of the fault detected, the fuzzy fault tree was derived, and the fuzzy relation equation representing the relation between an induction motor fault and each fault type, was solved. The solution of the fuzzy relation equation shows the possibility of each fault's occurring. The results obtained are summarized as follows: 1) The test result on the basis of KEMC1120 and IEC60255, show that the operation time error of the digital motor protective relay is improved within ${\pm}5%$. 2) Using clustering algorithm by unsupervisory learning, an on-line fault detection method, not affected by the characteristics of loads and rates, was implemented, and the degree of dependency by experts during fault detection was reduced. 3) With the fuzzy fault tree, fault diagnosis process became systematic and expandable to the whole system, and the diagnosis for sub-systems can be made as an object-oriented module.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.47 no.2
• /
• pp.10-20
• /
• 2024

In recent automated manufacturing systems, compressed air-based pneumatic cylinders have been widely used for basic perpetration including picking up and moving a target object. They are relatively categorized as small machines, but many linear or rotary cylinders play an important role in discrete manufacturing systems. Therefore, sudden operation stop or interruption due to a fault occurrence in pneumatic cylinders leads to a decrease in repair costs and production and even threatens the safety of workers. In this regard, this study proposed a fault detection technique by developing a time-variant deep learning model from multivariate sensor data analysis for estimating a current health state as four levels. In addition, it aims to establish a real-time fault detection system that allows workers to immediately identify and manage the cylinder's status in either an actual shop floor or a remote management situation. To validate and verify the performance of the proposed system, we collected multivariate sensor signals from a rotary cylinder and it was successful in detecting the health state of the pneumatic cylinder with four severity levels. Furthermore, the optimal sensor location and signal type were analyzed through statistical inferences.

• 한국초전도학회:학술대회논문집
• /
• v.11
• /
• pp.34-34
• /
• 2001

• Journal of Broadcast Engineering
• /
• v.12 no.3
• /
• pp.289-292
• /
• 2007

A background initialization algorithm based on the spatiotemporal similarity measure in a motion tracking system is proposed. From the accumulated difference between the base frame and the other frames in a subinterval, the regions affected by moving objects are located. The median is applied over the subsequence in the subinterval in which co-located regions share the similarity. The outputs from each subinterval are filtered by second stage median filter. The proposed method showed good results even in the busy and crowded sequences where the real background does not exit.

• Annual Conference of KIPS
• /
• 2012.11a
• /
• pp.549-551
• /
• 2012

본 논문에서는 기존의 화소값 차영상 기법이 저속으로 움직이는 물체의 동작정보 감지에 취약한 점을 보완하기 위하여 실시간 영상 처리를 목적으로 연속된 프레임(Frame)에서 움직임이 있는 프레임을 찾아내고, 움직임 영역을 추출하는 움직임 검출에 관한 연구를 통해 웹캠 기반의 객체 감지시스템을 제안하였다. 제안 시스템은 단일 객체뿐 아니라 다중 객체의 움직임까지 파악할 수 있다는 장점을 가지고 있다.

• Proceedings of the Korean Society of Surveying, Geodesy, Photogrammetry, and Cartography Conference
• /
• 2006.04a
• /
• pp.177-180
• /
• 2006

In this paper we proposed a method of automatic point segmentation acquired by 2D laser scanner to recognize moving objects. Recently, Laser scanner is noticed as a new method in the field of close range 3D modeling. But the majority of the researches are pointed on precise 3D modeling of static objects using expensive 3D laser scanner. 2D laser scanner is relatively cheap and can obtain 2D coordinate information of moving object's surface or can be utilized as 3D laser scanner by rotating the system body. In these reasons, some researches are in progress, which are adopting 2D laser scanner to robot control systems or detection of objects moving along linear trajectory. In our study, we automatically segmented point data of 2D laser scanner thus we could recognize each of the object passing through a section.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2011.05a
• /
• pp.476-477
• /
• 2011

본 논문에서는 홈 헬스케어 환경에서 위험 동작이 발생할 경우 이를 검지하는 방법으로, 물체 검출을 위해 입력받은 영상으로 부터 배경모델을 생성하여 이를 이용해 관심 물체를 검출한다. 검출된 물체 영역 내에서 중심점의 주변 탐색을 통해 관심 물체를 추적하며, 관심 물체의 모멘트 분석 정보와 깊이 정보를 활용하여 정상 동작이 아닌 낙상과 같은 비정상적인 위험 동작이 발생되었을 경우 검출할 수 있다. 기존 비전 센서 기반 방법들은 2차원 영상 정보를 이용하기 때문에 다양한 낙상 동작에 대해 낮은 검출율을 보이고 있다. 이에 대한 개선책으로 깊이정보를 활용하여 검출함으로써 신뢰성있는 검출율을 보여주는 실시간 비전 센서 기반을 둔 위험 낙상 검출기를 제안한다.

• Proceedings of the IEEK Conference
• /
• 2008.06a
• /
• pp.1211-1212
• /
• 2008

In this paper, we propose image process modeling as a part of location based surveillance system for unauthorized target recognition and tracking in harbor, airport, military zone. For this, we compress and store background image in lower resolution and perform object extraction and motion tracking by using sobel edge detection and difference picture method between real images and a background image. In addition to, we use Independent Component Analysis Neural Network for moving target recognition. Experiments are performed for object extraction and tracking of moving targets on road by using static camera in 20m height building and it shows the robust results.