• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.34 no.12C
• /
• pp.1147-1153
• /
• 2009

We propose a novel image segmentation and segment-based stereo matching technique using color, depth, and motion information. Proposed technique firstly splits reference images into foreground region or background region using depth information from depth camera. Then each region is segmented into small segments with color information. Moreover, extracted segments in current frame are tracked in the next frame in order to maintain depth consistency between frames. The initial depth from the depth camera is also used to set the depth search range for stereo matching. Proposed segment-based stereo matching technique was compared with conventional one without foreground and background separation and other conventional one without motion tracking of segments. Simulation results showed that the improvement of segment extraction and depth estimation consistencies by proposed technique compared to conventional ones especially at the static background region.

• Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
• /
• v.21 no.8
• /
• pp.87-95
• /
• 2007

In this paper, we analyzed the mr detection and the stability of the object tracking system by an adaptive stereo object hacking using region-based MAD(Mean Absolute Difference) algorithm and the modified PID(Proportional Integral Derivative)-based pan/tilt controller. That is, in the proposed system, the location coordinates of the target object in the right and left images are extracted from the sequential stereo input image by applying a region-based MAD algorithm and the configuration parameter of the stereo camera, and then these values could effectively control to pan/tilt of the stereo camera under the noisy circumstances through the modified PID controller. Accordingly, an adaptive control effect of a moving object can be analyzed through the advanced system with the proposed 3D robot vision, in which the possibility of real-time implementation of the robot vision system is also confirmed.

• Journal of the HCI Society of Korea
• /
• v.6 no.1
• /
• pp.9-16
• /
• 2011

The previous researches of 3D object modeling have been performed in a limited environment where a target object only exists. However, in order to model an object in the real environment, we need to consider a dynamic environment, which has various objects and a frequently changing background. Therefore, this paper presents a segmentation and tracking method for a foreground which includes a target object in the dynamic environment. By using depth information than color information, the foreground region can be segmented and tracked more robustly. In addition, the foreground region can be tracked on the sequential images by referring depth distributions of the foreground region because both the position and the status in the consecutive images of the foreground region are almost unchanged. Experimental results show that our proposed method can robustly segment and track the foreground region in various conditions of the real environment. Moreover, as an application of the proposed method, it is presented a method for modeling an object extracting the object regions from the foreground region that is segmented and tracked.

• Journal of Power System Engineering
• /
• v.19 no.2
• /
• pp.27-32
• /
• 2015

This paper describes a distance measurement system with high accuracy that utilizes a stereo-based camera and a pan-tilt unit for automatically maintaining the positional relationship between a vessel and a target on the side of a facility at a close range. The measurement system offers an advantage in that it can measure the distance to a target while tracking it. In order to improve the ability to control the position of a vessel between it and a target while maintaining the distance especially at a close range, the accuracy of the measurement system has to be improved. The accuracy of the distance measured by our system is increased with revisions of the conclusively generated data of distance measurement. We verified the accuracy of our system from an experiment, which generated results that had an accuracy of 30 mm for distances in the range between 2-8 m.

• The Journal of Korea Robotics Society
• /
• v.6 no.3
• /
• pp.210-219
• /
• 2011

This paper studies how to combine devices such as monocular/stereo cameras, motors for panning/tilting, fisheye lens and convex mirrors, in order to solve vision-based robotic problems. To overcome the well-known trade-offs between optical properties, we present two mixed versions of the new systems. The first system is the robot photographer with a conventional pan/tilt perspective camera and fisheye lens. The second system is the omnidirectional detector for a complete 360-degree field-of-view surveillance system. We build an original device that combines a stereo-catadioptric camera and a pan/tilt stereo-perspective camera, and also apply it in the real environment. Compared to the previous systems, we show benefits of two proposed systems in aspects of maintaining both high-speed and high resolution with collaborative moving cameras and having enormous search space with hybrid configuration. The experimental results are provided to show the effectiveness of the mixing collaborative and hybrid systems.

• Annual Conference of KIPS
• /
• 2005.05a
• /
• pp.209-212
• /
• 2005

모션 캡쳐 기술은 영화나 게임 혹은 애니메이션과 같은 다양한 분야에서 새롭게 시도되고 있다. 기존의 모션 캡쳐 방식은 마커라는 불편한 인식장치로 인하여 움직임에 적지 않은 제약을 받을 뿐만 아니라 엄청난 고가 장비를 필요로 한다. 갈수록 좀 더 편리한 모션 캡쳐 기술이 요구됨에 따라 실시간으로 물체의 위치를 트래킹(위치추적)하고, 스테레오 비전을 이용하여 3 차원 재 구축을 수행해 입체적인 가상모델을 생성하여 보았다. 본 논문에서는 효율적인 트래킹 연산에 의한 움직임 제약을 최소화한 개선된 알고리즘을 설계, 구현하였고, 저렴한 웹 캠을 이용하여 스테레오 비전방식(Stereo Vision Based)을 접목시켜 기존의 고가 장비들과 유사한 환경을 이 시스템으로도 가능하다는 것을 확인하였다.

• Proceedings of the KIEE Conference
• /
• 2003.11c
• /
• pp.507-510
• /
• 2003

In this paper, optical sensor system using PSD(Position Sensitive Detection) is proposed to obtain the three dimensional position of moving markers attached to human body. To find the coordinates of an moving marrer with stereo vision system, two different sight rays of an moving marker are required. Usually, those are acquired with two optical sensors synchronized at the same time. PSD sensor is used to measure the position of an incidence light in real-time. To get the three-dimension position of light source on moving markers, a conventional camera calibration method are used. In this research, we realized a low cost motion capture system. The proposed system shows high three-dimension measurement accuracy and fast sampling frequency.

• Journal of Institute of Control, Robotics and Systems
• /
• v.22 no.8
• /
• pp.579-584
• /
• 2016

When surgical instruments are tracked in an image-guided surgical navigation system, a stereo vision system with high accuracy is generally used, which is called optical tracker. However, this optical tracker has the disadvantage that a line-of-sight between the tracker and surgical instrument must be maintained. Therefore, to complement the disadvantage of optical tracking systems, an internal vision sensor is attached to a surgical instrument in this paper. Monitoring the target marker pattern attached on patient with this vision sensor, this surgical instrument is possible to be tracked even when the line-of-sight of the optical tracker is occluded. To verify the system's effectiveness, a series of basic experiments is carried out. Lastly, an integration experiment is conducted. The experimental results show that rotational error is bounded to max $1.32^{\circ}$ and mean $0.35^{\circ}$, and translation error is in max 1.72mm and mean 0.58mm. Finally, it is confirmed that the proposed tool tracking method using an internal vision sensor is useful and effective to overcome the occlusion problem of the optical tracker.

• Journal of Astronomy and Space Sciences
• /
• v.30 no.4
• /
• pp.279-290
• /
• 2013

Due to the continuous space development by mankind, the number of space objects including space debris in orbits around the Earth has increased, and accordingly, difficulties of space development and activities are expected in the near future. In this study, among the stages for space debris removal, the implementation of a vision-based approach technique for approaching space debris from a far-range rendezvous state to a proximity state, and the ground test performance results were described. For the vision-based object tracking, the CAM-shift algorithm with high speed and strong performance, and the Kalman filter were combined and utilized. For measuring the distance to a tracking object, a stereo camera was used. For the construction of a low-cost space environment simulation test bed, a sun simulator was used, and in the case of the platform for approaching, a two-dimensional mobile robot was used. The tracking status was examined while changing the position of the sun simulator, and the results indicated that the CAM-shift showed a tracking rate of about 87% and the relative distance could be measured down to 0.9 m. In addition, considerations for future space environment simulation tests were proposed.

• Proceedings of the IEEK Conference
• /
• 1998.10a
• /
• pp.973-976
• /
• 1998

스테레오 물체추적 시스템은 스테레오 비젼 시스템의 입체 영상에서 나타나는 스테레오 시차를 없애 주는 주시각 제어와 이동 물체를 영상의 중앙에 위치시키기 위한 팬/틸트 제어를 통해 이동 물체를 추적하게 된다. 본 논문에서는 스테레오 물체추적 시스템의 새로운 접근방법으로 적응적 물체 추적이 가능한 광 JTC를 이용해 이동 물체를 추적하는 스테레오 물체추적 시뮬레이터를 구현하였다. 이를 이용하여 여러 종류의 입력 영상에 따른 광 JTC 의 추적 결과를 분석하여 실험 결과를 예측할 수 있었으며, 이를 광학적으로 구현할 경우 배경 잡음에 강하고 실 시간적 물체 추적이 가능한 스테레오 물체추적 시스템을 구현할 수 있음을 제시하였다.