• Journal of Institute of Control, Robotics and Systems
• /
• v.19 no.8
• /
• pp.667-675
• /
• 2013

This paper presents vision-based techniques for underwater landmark detection, map-based localization, and SLAM (Simultaneous Localization and Mapping) in structured underwater environments. A variety of underwater tasks require an underwater robot to be able to successfully perform autonomous navigation, but the available sensors for accurate localization are limited. A vision sensor among the available sensors is very useful for performing short range tasks, in spite of harsh underwater conditions including low visibility, noise, and large areas of featureless topography. To overcome these problems and to a utilize vision sensor for underwater localization, we propose a novel vision-based object detection technique to be applied to MCL (Monte Carlo Localization) and EKF (Extended Kalman Filter)-based SLAM algorithms. In the image processing step, a weighted correlation coefficient-based template matching and color-based image segmentation method are proposed to improve the conventional approach. In the localization step, in order to apply the landmark detection results to MCL and EKF-SLAM, dead-reckoning information and landmark detection results are used for prediction and update phases, respectively. The performance of the proposed technique is evaluated by experiments with an underwater robot platform in an indoor water tank and the results are discussed.

• The Journal of Korea Robotics Society
• /
• v.11 no.4
• /
• pp.226-234
• /
• 2016

In this study, a model-referenced underwater navigation algorithm is proposed for high-precise underwater navigation using monocular vision near underwater structures. The main idea of this navigation algorithm is that a 3D model-based pose estimation is combined with the inertial navigation using an extended Kalman filter (EKF). The spatial information obtained from the navigation algorithm is utilized for enabling the underwater robot to navigate near underwater structures whose geometric models are known a priori. For investigating the performance of the proposed approach the model-referenced navigation algorithm was applied to an underwater robot and a set of experiments was carried out in a water tank.

• Journal of the Institute of Electronics Engineers of Korea SC
• /
• v.48 no.6
• /
• pp.91-98
• /
• 2011

This paper proposes an efficient and accurate vision based recognition and tracking framework for texture free objects. We approached this problem with a two phased algorithm: detection phase and tracking phase. In the detection phase, the algorithm extracts shape context descriptors that used for classifying objects into predetermined interesting targets. Later on, the matching result is further refined by a minimization technique. In the tracking phase, we resorted to meanshift tracking algorithm based on Bhattacharyya coefficient measurement. In summary, the contributions of our methods for the underwater robot vision are four folds: 1) Our method can deal with camera motion and scale changes of objects in underwater environment; 2) It is inexpensive vision based recognition algorithm; 3) The advantage of shape based method compared to a distinct feature point based method (SIFT) in the underwater environment with possible turbidity variation; 4) We made a quantitative comparison of our method with a few other well-known methods. The result is quite promising for the map based underwater SLAM task which is the goal of our research.

• Journal of the Korean Society of Industry Convergence
• /
• v.21 no.6
• /
• pp.389-394
• /
• 2018

Remotely operated vehicle(ROV) and autonomous underwater vehicle(AUV) have been used for underwater surveys, underwater exploration, resource harvesting, offshore plant maintenance and repair, and underwater construction. It is hard for people to work in the deep sea. Therefore, we need a vision control system of underwater submersible that can replace human eyes. However, many people have difficulty in developing a deep-sea image control system due to the deep sea special environment such as high pressure, brine, waterproofing and communication. In this paper, we will develop an Ethernet based remote image control system that can control the image mounted on ROV.

• Journal of Ocean Engineering and Technology
• /
• v.32 no.6
• /
• pp.511-517
• /
• 2018

This paper proposes a vision-based underwater laser scanner with separate structures for an underwater camera and a line laser projector. Because the two devices can be adaptively placed regardless of the features of the unmanned underwater vehicle (UUV), the scanner has significant advantages in relation to its availability and flexibility. Position calibration between the underwater camera and laser projector guarantees a 3D measuring performance with high accuracy. To verify the proposed underwater laser scanner, a test-bed system was manufactured, which consisted of the laser projector, camera, Pan&Tilt, and Attitude and Heading Reference System (AHRS). A camera-laser calibration test and simple 3D reconstruction test were performed in a water tank and the experimental results are reported.

• The Journal of Korea Robotics Society
• /
• v.7 no.2
• /
• pp.142-149
• /
• 2012

The camera has limitations of poor visibility in underwater environment due to the limited light source and medium noise of the environment. However, its usefulness in close range has been proved in many studies, especially for navigation. Thus, in this paper, vision-based object detection and tracking techniques using artificial objects for underwater robots have been studied. We employed template matching and mean shift algorithms for the object detection and tracking methods. Also, we propose the weighted correlation coefficient of adaptive threshold -based and color-region-aided approaches to enhance the object detection performance in various illumination conditions. The color information is incorporated into the template matched area and the features of the template are used to robustly calculate correlation coefficients. And the objects are recognized using multi-template matching approach. Finally, the water basin experiments have been conducted to demonstrate the performance of the proposed techniques using an underwater robot platform yShark made by KORDI.

• Proceedings of the Korea Committee for Ocean Resources and Engineering Conference
• /
• 2000.10a
• /
• pp.90-95
• /
• 2000

This paper presents the vergence control of a parallel stereo camera and its application to underwater stereo camera to enhance the working efficiency of underwater vehicles that equips with manipulators in seabed operation. The stereo camera consists of two parallel lenses mounted on a lateral moving base and two CCD cameras mounted on a longitudinal moving base, which is embedded in a small pressure canister for underwater application. Because the lateral shift is related to the backward shift with a nonlinear relation, only one control input is needed to control the vergence and focus of the camera with a special driving device. We can get a clear stereo vision with the camera for all the range of objects in air and in water, especially in short range objects. The control system of the camera is so simple that we are able to realize a small stereo camera system and to apply it to a stereo vision system for underwater vehicles. This paper also shows how to acquire the distance information of an underwater object with this stereo camera. Whenever we focus on an underwater object with the camera, we can obtain the three-dimensional images and the distance information in real-time.

• Journal of Ocean Engineering and Technology
• /
• v.15 no.1
• /
• pp.79-84
• /
• 2001

This paper present the control of the image disparity of a parallel stereo camera and its application to an underwater stereo camera to enhance the working efficiency of underwater vehicles that are equiped with manipulators in seabed operation. The stereo camera consists of two parallel lenses mounted on a lateral moving base and two CCD cameras mounted on a longitudinal moving base, which is embedded in a small pressure canister for underwater application. Because the lateral shift is related to the backward shift with a nonlinear relation, only one control input is needed to control the vergence and focus of the camera with a special driving device. We can get clear stereo vision with the camera for all the range of objects in air and in water, especially in short range object. The control system of the camera is so simple that we are able to realize a small stereo camera system and apply it to a stereo vision system for underwater vehicles. This paper also shows how to acquire the distance information of an underwater object with this stereo camera. Whenever we focus on an underwater object with the camera, we can obtain three-dimensional images and distance information in real-time.

• Journal of Ocean Engineering and Technology
• /
• v.19 no.2 s.63
• /
• pp.82-89
• /
• 2005

This study deals with the development of the extended Kalman filter(EKF) algorithm for the localization of underwater mining vehicles. Both simulation and experimental studies in a test bed are carried out. For the experiments, a scale dawn tracked vehicle is run in a soil bin containing cohesive soil of bentonite-water mixture. To develop the EKF algorithm, we use a kinematic model including the inner/outer track slips and the slip angle for the vehicle. The measurements include the inner and outer wheel speeds from encoders, the heading angle from a compass sensor and a fiber optic rate gyro, and x and y coordinate position values from a vision system. The vision sensor replaces the LBL(Long Base Line) sonar system used in the real underwater positioning situations. Artificial noise signals mimicking the real LBL noise signal are added to the vision sensor information. To know the mean slip values of the tracks in both straight and cornering maneuver, several trial running experiments are executed before applying the EKF algorithm. Experimental results show the effectiveness of the EKF algorithm in rejecting the sensor measurements noise. Also, the simulation and experimental results show close correlations.

• The Journal of the Acoustical Society of Korea
• /
• v.42 no.4
• /
• pp.370-376
• /
• 2023

In the underwater image, it is not clear to distinguish the shape of the target due to underwater noise and low resolution. In addition, as an input of deep learning, underwater images require pre-processing and segmentation must be preceded. Even after pre-processing, the target is not clear, and the performance of detection and identification by deep learning may not be high. Therefore, it is necessary to distinguish and clarify the target. In this study, the importance of target shadows is confirmed in underwater images, object detection and target area acquisition by shadows, and data containing only the shape of targets and shadows without underwater background are generated. We present the process of converting the shadow image into a 3-mode image in which the target is white, the shadow is black, and the background is gray. Through this, it is possible to provide an image that is clearly pre-processed and easily discriminated as an input of deep learning. In addition, if the image processing code using Open Source Computer Vision (OpenCV)Library was used for processing, the processing speed was also suitable for real-time processing.