• International Journal of Control, Automation, and Systems
• /
• v.5 no.6
• /
• pp.663-673
• /
• 2007

This paper presents a new moving obstacle detection method using an optical flow in mobile robot with an omnidirectional camera. Because an omnidirectional camera consists of a nonlinear mirror and CCD camera, the optical flow pattern in omnidirectional image is different from the pattern in perspective camera. The geometry characteristic of an omnidirectional camera has influence on the optical flow in omnidirectional image. When a mobile robot with an omnidirectional camera moves, the optical flow is not only theoretically calculated in omnidirectional image, but also investigated in omnidirectional and panoramic images. In this paper, the panoramic image is generalized from an omnidirectional image using the geometry of an omnidirectional camera. In particular, Focus of expansion (FOE) and focus of contraction (FOC) vectors are defined from the estimated optical flow in omnidirectional and panoramic images. FOE and FOC vectors are used as reference vectors for the relative evaluation of optical flow. The moving obstacle is turned out through the relative evaluation of optical flows. The proposed algorithm is tested in four motions of a mobile robot including straight forward, left turn, right turn and rotation. The effectiveness of the proposed method is shown by the experimental results.

• The Journal of the Korea Contents Association
• /
• v.10 no.6
• /
• pp.10-17
• /
• 2010

This paper presents a calibration method of an omnidirectional stereo camera which may be essentially performed for distance measurement to a certain point. In the calibration of the omnidirectional stereo camera, the independent calibrations of two cameras or the calibration of a stereo camera having the small baseline is feasible applying many methods studied in the past. However, the baseline should be large enough for long distance measurement by the omnidirectional stereo camera, since it is not easy to calibrate two cameras with a large baseline at the same time. It is because a test pattern for the calibration, which is simultaneously captured by two omnidirectional cameras, appears too small in at least one of the omnidirectional cameras. It causes inaccurate calibration. In this paper, therefore, we propose a calibration method of the omnidirectional stereo camera with a large baseline and empirically verify its feasibility.

• Journal of Korea Game Society
• /
• v.7 no.4
• /
• pp.63-70
• /
• 2007

Since the fisheye lens has a wide field of view, it can capture the scene and illumination from all directions from far less number of omnidirectional images. Due to these advantages of the omnidirectional camera, it is widely used in surveillance and reconstruction of 3D structure of the scene In this paper, we present a new self-calibration algorithm of omnidirectional camera from uncalibrated images by considering the inlier distribution. First, one parametric non-linear projection model of omnidirectional camera is estimated with the known rotation and translation parameters. After deriving projection model, we can compute an essential matrix of the camera with unknown motions, and then determine the camera information: rotation and translations. The standard deviations are used as a quantitative measure to select a proper inlier set. The experimental results showed that we can achieve a precise estimation of the omnidirectional camera model and extrinsic parameters including rotation and translation.

• The Journal of Korea Robotics Society
• /
• v.3 no.2
• /
• pp.91-98
• /
• 2008

This paper describes the recognition method of moving objects in mobile robot with an omnidirectional camera. The moving object is detected using the specific pattern of an optical flow in omnidirectional image. This paper consists of two parts. In the first part, the pattern of an optical flow is investigated in omnidirectional image. The optical flow in omnidirectional image is influenced on the geometry characteristic of an omnidirectional camera. The pattern of an optical flow is theoretically and experimentally investigated. In the second part, the detection of moving objects is presented from the estimated optical flow. The moving object is extracted through the relative evaluation of optical flows which is derived from the pattern of optical flow. In particular, Focus-Of-Expansion (FOE) and Focus-Of-Contraction (FOC) vectors are defined from the estimated optical flow. They are used as reference vectors for the relative evaluation of optical flows. The proposed algorithm is performed in four motions of a mobile robot such as straight forward, left turn, right turn and rotation. Experimental results using real movie show the effectiveness of the proposed method.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.45 no.6
• /
• pp.125-132
• /
• 2008

Omnidirectional camera system with a wide view angle is widely used in surveillance and robotics areas. In general, most of previous studies on estimating a projection model and the extrinsic parameters from the omnidirectional images assume corresponding points previously established among views. This paper presents a novel omnidirectional camera calibration based on automatic contour matching. In the first place, we estimate the initial parameters including translation and rotations by using the epipolar constraint from the matched feature points. After choosing the interested points adjacent to more than two contours, we establish a precise correspondence among the connected contours by using the initial parameters and the active matching windows. The extrinsic parameters of the omnidirectional camera are estimated minimizing the angular errors of the epipolar plane of endpoints and the inverse projected 3D vectors. Experimental results on synthetic and real images demonstrate that the proposed algorithm obtains more precise camera parameters than the previous method.

• Journal of Institute of Control, Robotics and Systems
• /
• v.15 no.4
• /
• pp.400-405
• /
• 2009

A new method for the catadioptric omnidirectional stereo vision with single camera is presented in this paper. The proposed method uses a concave lens with a convex mirror. Since the optical part of the proposed method is simple and commercially available, the resultant omnidirectional stereo system becomes versatile and cost-effective. The closed-form solution for 3D distance computation is presented based on the simple optics including the reflection and the reflection of the convex mirror and the concave lens. The compactness of the system and the simplicity of the image processing make the omnidirectional stereo system appropriate for real-time applications such as autonomous navigation of a mobile robot or the object manipulation. In order to verify the feasibility of the proposed method, an experimental prototype is implemented.

• Journal of IKEEE
• /
• v.21 no.3
• /
• pp.268-271
• /
• 2017

In this paper, we propose the development of high resolution $360^{\circ}$ omnidirectional IP camera with 12 million pixels. The proposed 12-megapixel high-resolution $360^{\circ}$ omnidirectional IP camera consists of a lens unit with $360^{\circ}$ omnidirectional viewing angle and a 12-megapixel high-resolution IP camera unit. The lens section of $360^{\circ}$ omnidirectional viewing angle adopts the isochronous lens design method and the catadioptric facet production method to obtain the image without peripheral distortion which is inevitably generated in the fisheye lens. The 12 megapixel high-resolution IP camera unit consists of a CMOS sensor & ISP unit, a DSP unit, and an I / O unit, and converts the image input to the camera into a digital image to perform image distortion correction, image correction and image compression And then transmits it to the NVR (Network Video Recorder). In order to evaluate the performance of the proposed 12-megapixel high-resolution $360^{\circ}$ omnidirectional IP camera, 12.3 million pixel image efficiency, $360^{\circ}$ omnidirectional lens angle of view, and electromagnetic certification standard were measured.

• Journal of Institute of Control, Robotics and Systems
• /
• v.19 no.11
• /
• pp.955-959
• /
• 2013

It is possible to obtain an omnidirectional stereo image via a single camera by using a catadioptric approach with a convex mirror and concave lens. In order to measure three-dimensional distance using the imaging system, the optical parameters of the system are required. In this paper, a calibration procedure to extract the parameters of the imaging system is described. Based on the parameters, experiments are carried out to verify the performance of the three-dimensional distance measurement of a single camera omnidirectional stereo imaging system.

• Transportation Technology and Policy
• /
• v.7 no.2
• /
• pp.39-44
• /
• 2010

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.44 no.5
• /
• pp.35-44
• /
• 2007

Since the omnidirectional camera system with a very large field of view could take many information about environment scene from few images, various researches for calibration and 3D reconstruction using omnidirectional image have been presented actively. Most of line segments of man-made objects we projected to the contours by using the omnidirectional camera model. Therefore, the corresponding contours among images sequences would be useful for computing the camera transformations including rotation and translation. This paper presents a novel two step minimization method to estimate the extrinsic parameters of the camera from the corresponding contours. In the first step, coarse camera parameters are estimated by minimizing an angular error function between epipolar planes and back-projected vectors from each corresponding point. Then we can compute the final parameters minimizing a distance error of the projected contours and the actual contours. Simulation results on the synthetic and real images demonstrated that our algorithm can achieve precise contour matching and camera motion estimation.